00000100:00100000:0.0:1746143747.657495:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621529216 00000100:00100000:0.0:1746143747.657503:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621529216 00000100:00100000:0.0:1746143747.657524:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9584 00000100:00100000:0.0:1746143747.657530:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963621529216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143747.657538:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.657547:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e59e000/0x87925e4cb73a2e6c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407568 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.657572:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626376320:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143747.657595:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.661036:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.663682:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.672722:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.679901:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.679966:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621530240 00000100:00100000:0.0:1746143747.679974:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621530240 00000100:00100000:0.0:1746143747.680032:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9586 00000100:00100000:0.0:1746143747.680041:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:30855:x1830963621530240:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143747.680062:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.680082:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a2e88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840757d expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.680117:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a2c12 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407426 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.680126:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124512000/0x87925e4cb73a2d3f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484074b9 expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.680148:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5ace00/0x87925e4cb73a2ccf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407465 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.680155:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.680157:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.680160:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a2e88 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840757d expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.680208:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5ace00/0x87925e4cb73a2ccf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407465 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.680219:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5ace00/0x87925e4cb73a2ccf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407465 expref: 9 pid: 13430 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746143747.680233:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626376576:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143747.681338:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124512000/0x87925e4cb73a2d3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484074b9 expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.681349:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124512000/0x87925e4cb73a2d3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484074b9 expref: 24 pid: 12327 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746143747.681359:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626376704:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143747.681389:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a2c12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407426 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.681406:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a2c12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407426 expref: 9 pid: 12327 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746143747.681414:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626376832:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143747.681430:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.687420:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626376576:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143747.687432:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626376704:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143747.687440:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626376832:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143747.687477:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a2e88 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840757d expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.687494:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2a00, rc 0) 00000100:00100000:0.0:1746143747.687541:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:30855:x1830963621530240:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7501us (7640us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.687549:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9586 00000100:00100000:0.0:1746143747.687579:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621530752 00000100:00100000:0.0:1746143747.687584:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621530752 00000100:00100000:0.0:1746143747.687613:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621530880 00000100:00100000:0.0:1746143747.687615:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621530880 00000100:00100000:0.0:1746143747.687628:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9587 00000100:00100000:0.0:1746143747.687633:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963621530752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143747.687648:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.687663:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e29a00/0x87925e4cb73a2eb2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840758b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.687714:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626376960:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143747.687772:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.687788:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9588 00000100:00100000:0.0:1746143747.687793:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963621530880:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143747.687799:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.687807:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28e00/0x87925e4cb73a2eb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407592 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.687829:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626377088:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143747.687850:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.690973:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626376960:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143747.691000:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e29a00/0x87925e4cb73a2eb2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840758b expref: 18 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.691010:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e29a00/0x87925e4cb73a2eb2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840758b expref: 18 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.691022:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e29a00, rc 0) 00000100:00100000:0.0:1746143747.691054:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963621530752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3421us (3970us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143747.691062:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9587 00000100:00100000:0.0:1746143747.692965:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.693594:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.694610:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.702674:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.702717:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.702751:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.702851:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.719166:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.722953:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.723436:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.723499:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.723523:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621533184 00000100:00100000:0.0:1746143747.723530:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621533184 00010000:00010000:0.0:1746143747.723567:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a2ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407584 expref: 17 pid: 7243 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746143747.723590:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621533440 00000100:00100000:0.0:1746143747.723592:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621533440 00010000:00010000:0.0:1746143747.723602:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a2e26 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840753e expref: 9 pid: 14991 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746143747.723613:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621533312 00000100:00100000:0.0:1746143747.723614:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621533312 00010000:00010000:0.0:1746143747.723622:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a2e57 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840755a expref: 267 pid: 14991 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746143747.723651:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4238 00000100:00100000:0.0:1746143747.723658:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963621533184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.723672:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.723678:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a2ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407584 expref: 17 pid: 7243 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.723700:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a2ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407584 expref: 17 pid: 7243 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.723724:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a2ea4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407584 expref: 17 pid: 7243 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.723742:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143747.723748:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a2ece lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143747.723756:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a2ece lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143747.723761:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.723798:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963621533184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 140us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.723804:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4238 00000100:00100000:0.0:1746143747.723818:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4239 00000100:00100000:0.0:1746143747.723822:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963621533440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.723828:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.723832:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a2e26 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840753e expref: 9 pid: 14991 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.723839:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a2e26 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840753e expref: 9 pid: 14991 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.723850:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a2e26 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840753e expref: 9 pid: 14991 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.723866:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143747.723868:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a2ece lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143747.723874:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a2ece lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143747.723878:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.723895:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963621533440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.723900:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4239 00000100:00100000:0.0:1746143747.723965:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4240 00000100:00100000:0.0:1746143747.723970:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+267:2011:x1830963621533312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.723977:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.723980:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a2e57 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840755a expref: 267 pid: 14991 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.723988:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a2e57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840755a expref: 267 pid: 14991 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.723998:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a2e57 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840755a expref: 267 pid: 14991 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.724006:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143747.724009:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a2ece lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143747.724015:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a2ece lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143747.724027:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a2ece lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143747.724050:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.724066:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+266:2011:x1830963621533312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 95us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.724073:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4240 00000100:00100000:0.0:1746143747.725458:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.728376:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.735823:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.738541:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.746468:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.746507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.755563:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.755603:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.755632:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.756176:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.756203:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9595 00000100:00100000:0.0:1746143747.756210:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963621534976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143747.756217:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.756225:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a2eff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484075ca expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.756247:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626378496:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143747.756283:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.756365:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4242 00000100:00100000:0.0:1746143747.756369:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963621534720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.756379:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.756389:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a2e88 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840757d expref: 27 pid: 3135 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.756396:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a2e88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840757d expref: 27 pid: 3135 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746143747.756405:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.756407:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.756413:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a2ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1294336->1593343) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484075ae expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.756420:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a2ee3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1294336->1593343) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484075ae expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.756437:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a2ee3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1294336->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484075ae expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.756444:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b20a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626378624:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143747.756465:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.759591:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b20a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626378624:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143747.759608:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.759634:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963621534720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3264us (3457us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.759642:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4242 00000100:00100000:0.0:1746143747.760235:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.763354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.763392:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.763882:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.773095:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626378880:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143747.773124:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a2f0d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484075d8 expref: 25 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.773136:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a2f0d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484075d8 expref: 25 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.773722:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55dc00, rc 0) 00000100:00100000:0.0:1746143747.773776:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963621535488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 10210us (10382us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143747.773783:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9597 00000100:00100000:0.0:1746143747.784784:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.798309:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.906023:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.911808:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.929807:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.937004:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.938867:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.952452:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.954583:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.959253:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.959290:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.968775:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.968811:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.968900:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.977683:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.977702:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.977724:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.977741:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.980037:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.981475:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093071f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626380160:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143747.981488:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.981522:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963621539328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3408us (3779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.981528:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4248 00000100:00100000:0.0:1746143747.984542:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.986014:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.991012:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.993801:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963621540096:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 2403us (2791us total) trans 21474839943 rc 0/0 00000100:00100000:0.0:1746143747.993810:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1073 00002000:00100000:0.0:1746143747.993819:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3203072->3297279) req@ffff8801368ea300 x1830963621540096/t21474839943(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:143/0 lens 488/448 e 0 to 0 dl 1746143758 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143747.993827:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ea300 with x1830963621540096 ext(3203072->3297279) 00010000:00010000:0.0:1746143747.993834:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a2f61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484075f4 expref: 14 pid: 13430 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746143747.993843:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a2f61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3203072->3297279) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484075f4 expref: 14 pid: 13430 timeout: 907 lvb_type: 0 00002000:00010000:0.0:1746143747.993859:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801368ea300 00000100:00100000:0.0:1746143747.997786:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143747.997832:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.003110:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.003135:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621540608 00000100:00100000:0.0:1746143748.003142:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621540608 00002000:00100000:0.0:1746143748.003179:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3321856->3325951) req@ffff8801240bd180 x1830963621540608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:144/0 lens 488/0 e 0 to 0 dl 1746143759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.003188:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801240bd180 with x1830963621540608 ext(3321856->3325951) 00002000:00010000:0.0:1746143748.003202:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801240bd180 00000100:00100000:0.0:1746143748.003223:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2218 00000100:00100000:0.0:1746143748.003231:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801240bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963621540608:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143748.003338:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801240bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963621540608:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 108us (239us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143748.003344:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2218 00002000:00100000:0.0:1746143748.003349:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (3321856->3325951) req@ffff8801240bd180 x1830963621540608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:144/0 lens 488/4536 e 0 to 0 dl 1746143759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.003355:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801240bd180 with x1830963621540608 ext(3321856->3325951) 00002000:00010000:0.0:1746143748.003358:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801240bd180 00000100:00100000:0.0:1746143748.003398:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.003409:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621540864 00000100:00100000:0.0:1746143748.003412:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621540864 00002000:00100000:0.0:1746143748.003422:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff8801240be300 x1830963621540864/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:144/0 lens 488/0 e 0 to 0 dl 1746143759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.003439:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801240be300 with x1830963621540864 ext(1048576->2097151) 00002000:00010000:0.0:1746143748.003442:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801240be300 00000100:00100000:0.0:1746143748.003453:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2219 00000100:00100000:0.0:1746143748.003458:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801240be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963621540864:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143748.008491:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.040745:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.040784:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.051809:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143748.055089:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143748.063049:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801240bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963621541376:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22040us (22302us total) trans 0 rc 1916928/1916928 00000100:00100000:0.0:1746143748.063061:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2220 00002000:00100000:0.0:1746143748.063071:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8801240bfb80 x1830963621541376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:144/0 lens 504/440 e 0 to 0 dl 1746143759 ref 1 fl Complete:/200/0 rc 1916928/1916928 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.063080:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801240bfb80 with x1830963621541376 ext(2097152->4194303) 00002000:00010000:0.0:1746143748.063086:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801240bfb80 00000100:00100000:0.0:1746143748.074307:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.074519:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.074615:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.074744:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.075326:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9604 00000100:00100000:0.0:1746143748.075334:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963621542144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143748.075340:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.075353:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a2fca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407625 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.075386:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626380672:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143748.075431:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.091162:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.107568:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.109998:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621543168 00000100:00100000:0.0:1746143748.110003:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621543168 00000100:00100000:0.0:1746143748.110025:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9607 00000100:00100000:0.0:1746143748.110030:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963621543168:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143748.110038:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.110048:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8bc00/0x87925e4cb73a2fdf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840763a expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.110075:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626381056:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143748.110109:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.117557:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.121571:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626381184:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143748.121596:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a2fe6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407641 expref: 14 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.121608:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7c000, rc 0) 00000100:00100000:0.0:1746143748.121634:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:30884:x1830963621543552:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3851us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.121640:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9608 00000100:00100000:0.0:1746143748.133104:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.138012:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.150480:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.152276:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.157071:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621544704 00000100:00100000:0.0:1746143748.157075:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621544704 00000100:00100000:0.0:1746143748.157096:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9610 00000100:00100000:0.0:1746143748.157100:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:30887:x1830963621544704:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143748.157107:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.157116:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a3017 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407656 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.157129:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143748.157134:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a3010 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840764f expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.157139:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143748.157142:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a3017 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3137536->3145727] (req 3137536->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407656 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.157165:0:9587:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a3010 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840764f expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.157175:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a3017 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3137536->3145727] (req 3137536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407656 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.157182:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ac00, rc 0) 00000100:00100000:0.0:1746143748.157261:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:30887:x1830963621544704:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 110us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.157272:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9610 00000100:00100000:0.0:1746143748.162151:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.172518:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.172565:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.211564:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.216511:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.222081:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.225589:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.231992:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.253161:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.253487:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.253500:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621547264 00000100:00100000:0.0:1746143748.253503:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621547264 00010000:00010000:0.0:1746143748.253515:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a3017 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407656 expref: 34 pid: 9587 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746143748.253529:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4255 00000100:00100000:0.0:1746143748.253533:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963621547264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.253540:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.253550:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a3017 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407656 expref: 34 pid: 9587 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746143748.253557:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a3017 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407656 expref: 34 pid: 9587 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746143748.253569:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a3017 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407656 expref: 34 pid: 9587 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746143748.253602:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.253604:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.253609:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73a301e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840765d expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.253616:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73a301e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840765d expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.253640:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73a301e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840765d expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.253650:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626382208:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143748.253700:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.259043:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.264467:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.264541:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626382208:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143748.264558:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.264592:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963621547264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 11058us (11105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.264602:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4255 00000100:00100000:0.0:1746143748.268493:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.268562:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.269669:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621548288 00000100:00100000:0.0:1746143748.269673:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621548288 00002000:00100000:0.0:1746143748.269692:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff8800939a6300 x1830963621548288/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:144/0 lens 488/0 e 0 to 0 dl 1746143759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.269712:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a6300 with x1830963621548288 ext(3145728->4194303) 00002000:00010000:0.0:1746143748.269716:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a6300 00000100:00100000:0.0:1746143748.280740:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.289667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.292000:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.300335:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621549184 00000100:00100000:0.0:1746143748.300342:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621549184 00000100:00100000:0.0:1746143748.300374:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9614 00000100:00100000:0.0:1746143748.300380:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963621549184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143748.300393:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.300406:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73a3079 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407680 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.300444:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626382464:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143748.300497:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.321124:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.323994:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.328182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.332076:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.338375:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.342870:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626382848:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143748.342889:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.342950:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963621549952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4306us (4584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.342960:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4256 00000100:00100000:0.0:1746143748.344213:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.344253:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.354609:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.359401:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.359824:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143748.359839:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626382976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143748.359880:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746143748.360743:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143748.371363:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.387566:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143748.387686:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143748.391512:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.399388:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.399422:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.399449:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.399461:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.399481:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143748.400140:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143748.404414:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.407620:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.413048:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.419296:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.433012:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.442199:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.443522:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.444780:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.449438:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.461749:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.467349:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.467428:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.473618:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.478549:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.480441:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.504817:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.505093:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.527484:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.535605:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.554047:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.612353:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.620193:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.620230:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.627018:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093073b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626384640:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143748.627033:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a3167 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484076f7 expref: 31 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143748.627041:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a3167 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484076f7 expref: 31 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143748.627053:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635400, rc 0) 00000100:00100000:0.0:1746143748.627230:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963621557248:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6423us (7053us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143748.627235:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9624 00000100:00100000:0.0:1746143748.643597:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.644449:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.644633:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.645548:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.652351:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.653374:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.653428:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9629 00000100:00100000:0.0:1746143748.653439:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963621558400:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143748.653456:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.653471:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73a31ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407721 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.653519:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626385408:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143748.654418:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.664549:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621558528 00000100:00100000:0.0:1746143748.664554:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621558528 00000100:00100000:0.0:1746143748.664585:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9630 00000100:00100000:0.0:1746143748.664590:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:30910:x1830963621558528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143748.664599:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.664611:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73a31c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407728 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.664632:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a30f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484076d4 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.664639:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143748.664642:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143748.664645:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73a31c2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407728 expref: 31 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.664662:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a30f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484076d4 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.664677:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a30f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484076d4 expref: 13 pid: 3135 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746143748.664686:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626385664:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143748.664711:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.670587:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.670683:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.674482:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.674532:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.680812:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.689079:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.689126:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.689163:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621560192 00000100:00100000:0.0:1746143748.689167:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621560192 00010000:00010000:0.0:1746143748.689203:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a30f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484076d4 expref: 16 pid: 3135 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746143748.689220:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4272 00000100:00100000:0.0:1746143748.689224:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963621560192:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.689244:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.689268:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a30f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484076d4 expref: 16 pid: 3135 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746143748.689278:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a30f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484076d4 expref: 16 pid: 3135 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746143748.689311:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a30f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3178495) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484076d4 expref: 16 pid: 3135 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746143748.689328:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.689329:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.689333:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73a31c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407728 expref: 30 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.689354:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73a31c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407728 expref: 30 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.689390:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73a31c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407728 expref: 30 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.689412:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626386304:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143748.689467:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.694257:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626386304:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143748.694277:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.694314:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963621560192:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5089us (5186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.694323:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4272 00000100:00100000:0.0:1746143748.701403:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.716978:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.717013:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.726494:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.731087:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.731163:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.744977:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.745013:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.745034:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621561984 00000100:00100000:0.0:1746143748.745042:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621561984 00010000:00010000:0.0:1746143748.745080:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73a2fc3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840761e expref: 16 pid: 1945 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746143748.745107:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621562112 00000100:00100000:0.0:1746143748.745109:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621562112 00010000:00010000:0.0:1746143748.745120:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a30c6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484076aa expref: 9 pid: 1947 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746143748.745135:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4273 00000100:00100000:0.0:1746143748.745142:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963621561984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.745155:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.745177:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73a2fc3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840761e expref: 16 pid: 1945 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746143748.745200:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73a2fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840761e expref: 16 pid: 1945 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746143748.745227:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.745273:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963621561984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 131us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.745280:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4273 00000100:00100000:0.0:1746143748.745295:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4274 00000100:00100000:0.0:1746143748.745312:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963621562112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.745319:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.745326:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a30c6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484076aa expref: 9 pid: 1947 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746143748.745334:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a30c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484076aa expref: 9 pid: 1947 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746143748.745344:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.745357:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963621562112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.745361:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4274 00000100:00100000:0.0:1746143748.745431:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.745442:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621562240 00000100:00100000:0.0:1746143748.745445:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621562240 00010000:00010000:0.0:1746143748.745457:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a2f8b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407602 expref: 33 pid: 13436 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746143748.745469:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4275 00000100:00100000:0.0:1746143748.745474:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963621562240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.745480:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.745487:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a2f8b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407602 expref: 33 pid: 13436 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746143748.745501:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a2f8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407602 expref: 33 pid: 13436 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746143748.745521:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.745523:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.745530:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a3224 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407767 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.745538:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a3224 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407767 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.745573:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a3224 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407767 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.745586:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626387200:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143748.745646:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.757969:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.761956:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626387328:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143748.761978:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.762038:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2010:x1830963621562624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3971us (4068us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.763007:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4276 00000100:00100000:0.0:1746143748.766479:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.772238:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.778849:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.780520:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.787540:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.794474:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.805312:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.808209:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.809241:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.809278:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.817136:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.821994:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.832770:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.840451:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.855124:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621565952 00000100:00100000:0.0:1746143748.855132:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621565952 00000100:00100000:0.0:1746143748.855197:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9641 00000100:00100000:0.0:1746143748.855205:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963621565952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143748.855221:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.855236:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e513400/0x87925e4cb73a3247 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407791 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.855256:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.855258:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.855834:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e513400/0x87925e4cb73a3247 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407791 expref: 38 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143748.855851:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e513400/0x87925e4cb73a3247 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407791 expref: 38 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143748.855860:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513400, rc 0) 00000100:00100000:0.0:1746143748.855932:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963621565952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 707us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.855938:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9641 00000100:00100000:0.0:1746143748.865457:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621566720 00000100:00100000:0.0:1746143748.865464:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621566720 00002000:00100000:0.0:1746143748.865491:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2220032->2224127) req@ffff8800938dc380 x1830963621566720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:144/0 lens 488/0 e 0 to 0 dl 1746143759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.865500:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc380 with x1830963621566720 ext(2220032->2224127) 00002000:00010000:0.0:1746143748.865504:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938dc380 00000100:00100000:0.0:1746143748.865530:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2249 00000100:00100000:0.0:1746143748.865537:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963621566720:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143748.866382:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963621566720:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 843us (1224us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143748.866389:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2249 00002000:00100000:0.0:1746143748.866396:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2220032->2224127) req@ffff8800938dc380 x1830963621566720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:144/0 lens 488/4536 e 0 to 0 dl 1746143759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.866403:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc380 with x1830963621566720 ext(2220032->2224127) 00002000:00010000:0.0:1746143748.866406:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938dc380 00000100:00100000:0.0:1746143748.868319:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.868362:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.869223:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.873434:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.891761:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.894433:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.894472:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.897531:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.912430:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.929947:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.929972:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.931467:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626389504:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143748.931478:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626389632:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143748.931501:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a32a9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4071424->4194303] (req 4071424->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484077de expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.931514:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55ba00, rc 0) 00000100:00100000:0.0:1746143748.932275:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:30918:x1830963621569152:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 19042us (19848us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.932283:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9652 00000100:00100000:0.0:1746143748.933066:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963621568768:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23289us (23497us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143748.933072:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2251 00002000:00100000:0.0:1746143748.933080:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880090e58a80 x1830963621568768/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:144/0 lens 488/440 e 0 to 0 dl 1746143759 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.933087:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58a80 with x1830963621568768 ext(2097152->4194303) 00010000:00010000:0.0:1746143748.933092:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082048c00/0x87925e4cb73a3271 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484077b4 expref: 18 pid: 12328 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746143748.933102:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082048c00/0x87925e4cb73a3271 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484077b4 expref: 18 pid: 12328 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746143748.933108:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e58a80 00000100:00100000:0.0:1746143748.942207:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.943349:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.948156:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.951993:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.952033:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.955380:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963621570304:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3178us (3344us total) trans 21474839950 rc 0/0 00000100:00100000:0.0:1746143748.955388:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1087 00002000:00100000:0.0:1746143748.955396:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (4071424->4194303) req@ffff880092b62300 x1830963621570304/t21474839950(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:144/0 lens 488/448 e 0 to 0 dl 1746143759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.955404:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62300 with x1830963621570304 ext(4071424->4194303) 00010000:00010000:0.0:1746143748.955411:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a32a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484077de expref: 35 pid: 3135 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746143748.955421:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a32a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484077de expref: 35 pid: 3135 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746143748.955428:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b62300 00000100:00100000:0.0:1746143748.956058:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.958903:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.961199:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963621570432:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4997us (5137us total) trans 17179872646 rc 0/0 00000100:00100000:0.0:1746143748.961210:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1088 00002000:00100000:0.0:1746143748.961219:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2224127) req@ffff880092b61c00 x1830963621570432/t17179872646(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:144/0 lens 488/448 e 0 to 0 dl 1746143759 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.961228:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61c00 with x1830963621570432 ext(2097152->2224127) 00010000:00010000:0.0:1746143748.961236:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a3240 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407783 expref: 18 pid: 12327 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746143748.961258:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a3240 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407783 expref: 18 pid: 12327 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746143748.961264:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b61c00 00000100:00100000:0.0:1746143748.968031:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.993749:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143748.993797:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.002118:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143749.002498:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143749.006254:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.019107:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963621571584:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 16745us (16987us total) trans 17179872647 rc 0/0 00000100:00100000:0.0:1746143749.019116:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1089 00002000:00100000:0.0:1746143749.019126:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3338239) req@ffff880095c3bb80 x1830963621571584/t17179872647(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:145/0 lens 488/448 e 0 to 0 dl 1746143760 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.019134:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3bb80 with x1830963621571584 ext(3145728->3338239) 00010000:00010000:0.0:1746143749.019143:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73a32b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484077ec expref: 40 pid: 12328 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746143749.019156:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73a32b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484077ec expref: 40 pid: 12328 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746143749.019162:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c3bb80 00000100:00100000:0.0:1746143749.025077:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.031173:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.033407:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.033456:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.033480:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621572224 00000100:00100000:0.0:1746143749.033485:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621572224 00000100:00080000:0.0:1746143749.033501:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143749.033524:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621572352 00000100:00100000:0.0:1746143749.033526:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621572352 00000100:00100000:0.0:1746143749.033539:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9656 00000100:00100000:0.0:1746143749.033543:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963621572224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143749.033555:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143749.033567:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e512a00/0x87925e4cb73a32e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407801 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.033581:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.033582:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.033586:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e512a00/0x87925e4cb73a32e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407801 expref: 35 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143749.033596:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e512a00/0x87925e4cb73a32e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407801 expref: 35 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143749.033603:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512a00, rc 0) 00000100:00100000:0.0:1746143749.033626:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963621572224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.033631:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9656 00000100:00100000:0.0:1746143749.033644:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9657 00000100:00100000:0.0:1746143749.033648:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963621572352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143749.033654:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143749.033667:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73a32ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407808 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.033677:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.033678:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.033681:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73a32ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407808 expref: 41 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143749.033689:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73a32ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407808 expref: 41 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143749.033695:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512e00, rc 0) 00000100:00100000:0.0:1746143749.033709:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963621572352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 61us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.033713:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9657 00000100:00100000:0.0:1746143749.037565:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143749.038579:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143749.066573:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.073235:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963621572608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 34372us (35672us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143749.073244:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2255 00002000:00100000:0.0:1746143749.073254:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880095c3aa00 x1830963621572608/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:145/0 lens 488/440 e 0 to 0 dl 1746143760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.073264:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3aa00 with x1830963621572608 ext(3145728->4194303) 00002000:00010000:0.0:1746143749.073269:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3aa00 00000100:00100000:0.0:1746143749.093583:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143749.096203:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143749.120482:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.120582:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.130580:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.183537:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.269124:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.277894:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.277968:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.278003:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621574656 00000100:00100000:0.0:1746143749.278011:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621574656 00010000:00010000:0.0:1746143749.278046:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a32b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484077e5 expref: 20 pid: 3135 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746143749.278069:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621574784 00000100:00100000:0.0:1746143749.278071:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621574784 00010000:00010000:0.0:1746143749.278078:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e512a00/0x87925e4cb73a32e8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407801 expref: 35 pid: 3135 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746143749.278091:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4290 00000100:00100000:0.0:1746143749.278098:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2010:x1830963621574656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143749.278111:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143749.278131:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a32b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484077e5 expref: 20 pid: 3135 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746143749.278141:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a32b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484077e5 expref: 20 pid: 3135 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746143749.278167:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143749.278219:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2010:x1830963621574656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 120us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.278234:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4290 00000100:00100000:0.0:1746143749.278248:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4291 00000100:00100000:0.0:1746143749.278252:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963621574784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143749.278257:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143749.278263:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e512a00/0x87925e4cb73a32e8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407801 expref: 35 pid: 3135 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746143749.278271:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e512a00/0x87925e4cb73a32e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407801 expref: 35 pid: 3135 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746143749.278281:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.278283:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.278289:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a32f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840780f expref: 19 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.278297:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a32f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840780f expref: 19 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.278326:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a32f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840780f expref: 19 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143749.278337:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626390912:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143749.278395:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143749.280758:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.290771:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.290829:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.300015:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.300039:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.300081:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.300422:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4293 00000100:00100000:0.0:1746143749.300428:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963621575424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143749.300434:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143749.300442:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73a32ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407808 expref: 40 pid: 3135 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746143749.300449:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73a32ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407808 expref: 40 pid: 3135 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746143749.300461:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73a32ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407808 expref: 40 pid: 3135 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746143749.300480:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.300483:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.300489:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a3304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840781d expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.300495:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a3304 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840781d expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.300524:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a3304 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840781d expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143749.300534:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626391424:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143749.300604:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00080000:0.0:1746143749.303827:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143749.303946:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621576064 00000100:00100000:0.0:1746143749.303949:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621576064 00002000:00100000:0.0:1746143749.303971:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3223552->3227647) req@ffff880093072a00 x1830963621576064/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:145/0 lens 488/0 e 0 to 0 dl 1746143760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.303978:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093072a00 with x1830963621576064 ext(3223552->3227647) 00002000:00010000:0.0:1746143749.303981:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093072a00 00000100:00100000:0.0:1746143749.305652:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.307341:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.307376:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.307402:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.307429:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.307442:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.307458:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621576448 00000100:00100000:0.0:1746143749.307462:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621576448 00000100:00100000:0.0:1746143749.307482:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621576704 00000100:00100000:0.0:1746143749.307484:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621576704 00000100:00100000:0.0:1746143749.307503:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621576320 00000100:00100000:0.0:1746143749.307505:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621576320 00000100:00100000:0.0:1746143749.307515:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621576576 00000100:00100000:0.0:1746143749.307516:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621576576 00000100:00100000:0.0:1746143749.307528:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9661 00000100:00100000:0.0:1746143749.307533:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963621576448:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143749.307543:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143749.307555:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73a3327 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407832 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.307570:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.307579:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.307585:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73a3327 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407832 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143749.307596:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73a3327 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407832 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143749.307605:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7600, rc 0) 00000100:00100000:0.0:1746143749.307632:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963621576448:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.307638:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9661 00000100:00100000:0.0:1746143749.307651:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9662 00000100:00100000:0.0:1746143749.307655:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963621576704:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143749.307662:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143749.307670:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73a332e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407840 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143749.307755:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626391808:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143749.307790:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00080000:0.0:1746143749.307800:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143749.307839:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626391680:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143749.307852:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143749.307865:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963621576192:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1776us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.307872:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4295 00000100:00100000:0.0:1746143749.307938:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.308007:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621577216 00000100:00100000:0.0:1746143749.308015:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621577216 00002000:00100000:0.0:1746143749.308036:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2809856->2813951) req@ffff880092b70700 x1830963621577216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:145/0 lens 488/0 e 0 to 0 dl 1746143760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.308043:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70700 with x1830963621577216 ext(2809856->2813951) 00002000:00010000:0.0:1746143749.308046:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b70700 00000100:00100000:0.0:1746143749.308072:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2263 00000100:00100000:0.0:1746143749.308078:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963621577216:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143749.308244:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963621577216:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 165us (305us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143749.308250:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2263 00002000:00100000:0.0:1746143749.308255:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2809856->2813951) req@ffff880092b70700 x1830963621577216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:145/0 lens 488/4536 e 0 to 0 dl 1746143760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.308262:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70700 with x1830963621577216 ext(2809856->2813951) 00002000:00010000:0.0:1746143749.308265:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b70700 00000100:00100000:0.0:1746143749.316232:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.318998:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621577856 00000100:00100000:0.0:1746143749.319006:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621577856 00002000:00100000:0.0:1746143749.319038:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3227647) req@ffff880129e78e00 x1830963621577856/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:145/0 lens 488/0 e 0 to 0 dl 1746143760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.319047:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e78e00 with x1830963621577856 ext(3145728->3227647) 00010000:00010000:0.0:1746143749.319054:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a3304 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840781d expref: 18 pid: 1947 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746143749.319066:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a3304 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840781d expref: 18 pid: 1947 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746143749.319082:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129e78e00 00000100:00100000:0.0:1746143749.319098:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1091 00000100:00100000:0.0:1746143749.319104:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963621577856:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143749.324535:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963621577856:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5430us (6715us total) trans 17179872648 rc 0/0 00000100:00100000:0.0:1746143749.324544:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1091 00002000:00100000:0.0:1746143749.324553:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3227647) req@ffff880129e78e00 x1830963621577856/t17179872648(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:145/0 lens 488/448 e 0 to 0 dl 1746143760 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.324562:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e78e00 with x1830963621577856 ext(3145728->3227647) 00010000:00010000:0.0:1746143749.324570:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a3304 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840781d expref: 20 pid: 1947 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746143749.324582:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a3304 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840781d expref: 20 pid: 1947 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746143749.324589:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129e78e00 00000100:00100000:0.0:1746143749.325107:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.331959:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.337964:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.338015:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.348638:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.358117:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.359102:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.368785:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621580160 00000100:00100000:0.0:1746143749.368810:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621580160 00002000:00100000:0.0:1746143749.368980:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800938dfb80 x1830963621580160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:145/0 lens 488/0 e 0 to 0 dl 1746143760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.368991:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dfb80 with x1830963621580160 ext(3145728->4194303) 00002000:00010000:0.0:1746143749.368997:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dfb80 00000100:00100000:0.0:1746143749.370427:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621580416 00000100:00100000:0.0:1746143749.370436:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621580416 00002000:00100000:0.0:1746143749.370471:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff8800938dd180 x1830963621580416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:145/0 lens 488/0 e 0 to 0 dl 1746143760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.370480:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dd180 with x1830963621580416 ext(3145728->4194303) 00002000:00010000:0.0:1746143749.370485:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938dd180 00000100:00100000:0.0:1746143749.371591:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2268 00000100:00100000:0.0:1746143749.371599:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963621580416:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143749.396717:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963621580160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 26104us (30134us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143749.396728:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2267 00002000:00100000:0.0:1746143749.396742:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800938dfb80 x1830963621580160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:145/0 lens 488/440 e 0 to 0 dl 1746143760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.396752:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dfb80 with x1830963621580160 ext(3145728->4194303) 00002000:00010000:0.0:1746143749.396758:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dfb80 00000100:00100000:0.0:1746143749.409601:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.409642:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.416852:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.421106:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.429748:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.434609:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.448688:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.452490:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.461273:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.471034:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.497430:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.511022:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.536192:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.538803:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.542612:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.549487:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.569432:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.569481:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.570028:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2275 00000100:00100000:0.0:1746143749.570035:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963621584384:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143749.585335:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.610404:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.641277:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.645519:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.656394:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.663518:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.664066:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.666425:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.670774:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.670958:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.676567:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.677556:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.684862:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.686090:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.689412:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.696705:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.696743:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.697513:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143749.697528:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143749.697544:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143749.697554:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143749.697757:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1036 00000100:00100000:0.0:1746143749.697765:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2010:x1830963621587456:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143749.697790:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2010:x1830963621587456:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.697795:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1036 00000100:00080000:0.0:1746143749.697808:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143749.697885:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.698901:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.708561:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.715690:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.722993:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.743393:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.748514:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.748550:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.748567:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.748595:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.748611:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621588992 00000100:00100000:0.0:1746143749.748614:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621588992 00000100:00100000:0.0:1746143749.748635:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9682 00000100:00100000:0.0:1746143749.748641:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963621588992:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143749.749336:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143749.749344:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a3454 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484078e8 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.749355:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.749361:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a3454 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484078e8 expref: 42 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143749.749369:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a3454 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484078e8 expref: 42 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143749.749382:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084c00, rc 0) 00000100:00100000:0.0:1746143749.749402:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963621588992:12345-192.168.202.3@tcp:101:cat.0 Request processed in 760us (833us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143749.749408:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9682 00000100:00100000:0.0:1746143749.749444:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.752904:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.752990:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.766503:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.766595:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.774886:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.775334:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.776322:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.782567:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.783940:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.792360:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.811016:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.814631:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.825170:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.835822:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.836415:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2283 00000100:00100000:0.0:1746143749.836423:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963621591680:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143749.856214:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.859834:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.860243:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.874491:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.874540:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.881816:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621593216 00000100:00100000:0.0:1746143749.881824:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621593216 00002000:00100000:0.0:1746143749.881855:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880129e7aa00 x1830963621593216/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:145/0 lens 488/0 e 0 to 0 dl 1746143760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.881864:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e7aa00 with x1830963621593216 ext(0->1048575) 00002000:00010000:0.0:1746143749.881868:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e7aa00 00000100:00100000:0.0:1746143749.881894:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621593472 00000100:00100000:0.0:1746143749.881896:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621593472 00002000:00100000:0.0:1746143749.881906:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880129e79180 x1830963621593472/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:145/0 lens 488/0 e 0 to 0 dl 1746143760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.881931:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e79180 with x1830963621593472 ext(1048576->2097151) 00002000:00010000:0.0:1746143749.881933:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e79180 00000100:00100000:0.0:1746143749.881953:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2286 00000100:00100000:0.0:1746143749.881960:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963621593216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143749.882529:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2287 00000100:00100000:0.0:1746143749.882534:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963621593472:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143749.930898:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.931029:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.931292:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963621593472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 48753us (50270us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143749.931302:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2287 00002000:00100000:0.0:1746143749.931314:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880129e79180 x1830963621593472/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:145/0 lens 488/440 e 0 to 0 dl 1746143760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.931323:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e79180 with x1830963621593472 ext(1048576->2097151) 00002000:00010000:0.0:1746143749.931329:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e79180 00000100:00100000:0.0:1746143749.931350:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621593984 00000100:00100000:0.0:1746143749.931354:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621593984 00002000:00100000:0.0:1746143749.931382:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4607999) req@ffff880095cb4a80 x1830963621593984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:145/0 lens 488/0 e 0 to 0 dl 1746143760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.931389:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4a80 with x1830963621593984 ext(4194304->4607999) 00002000:00010000:0.0:1746143749.931393:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb4a80 00000100:00100000:0.0:1746143749.931422:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2288 00000100:00100000:0.0:1746143749.931430:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963621593984:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143749.944239:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.944355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.947386:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.970832:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.975759:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143749.981458:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963621594880:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5473us (5687us total) trans 17179872651 rc 0/0 00000100:00100000:0.0:1746143749.981484:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1097 00002000:00100000:0.0:1746143749.981496:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2592767) req@ffff880090e26680 x1830963621594880/t17179872651(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:145/0 lens 488/448 e 0 to 0 dl 1746143760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.981505:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e26680 with x1830963621594880 ext(2097152->2592767) 00010000:00010000:0.0:1746143749.981515:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73a3431 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2592767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484078cc expref: 44 pid: 3135 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746143749.981707:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73a3431 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2592767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484078cc expref: 44 pid: 3135 timeout: 909 lvb_type: 0 00002000:00010000:0.0:1746143749.982068:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e26680 00000100:00100000:0.0:1746143749.989220:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.001584:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.004847:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.004901:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.004964:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621595648 00000100:00100000:0.0:1746143750.004972:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621595648 00002000:00100000:0.0:1746143750.005020:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800939a4380 x1830963621595648/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:146/0 lens 488/0 e 0 to 0 dl 1746143761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.005030:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a4380 with x1830963621595648 ext(3145728->4194303) 00002000:00010000:0.0:1746143750.005035:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a4380 00000100:00100000:0.0:1746143750.005060:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2291 00000100:00100000:0.0:1746143750.005069:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963621595648:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143750.024521:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.027564:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.029748:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.044089:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.046024:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.049101:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.052678:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.056649:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.057942:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.058223:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621597568 00000100:00100000:0.0:1746143750.058227:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621597568 00000100:00100000:0.0:1746143750.058251:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9696 00000100:00100000:0.0:1746143750.058255:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963621597568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143750.058263:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.058280:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a34ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407951 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.058307:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a34ee lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407951 expref: 23 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.058317:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a34ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407951 expref: 23 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.058330:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123269200, rc 0) 00000100:00100000:0.0:1746143750.058358:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963621597568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 96us (190us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143750.058363:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9696 00000100:00080000:0.0:1746143750.078690:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143750.111818:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.114963:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.115009:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143750.115439:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143750.116090:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.117804:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.123476:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.128934:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.142665:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.149946:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.157291:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143750.157666:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143750.168020:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.168084:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.170559:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.171893:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.177096:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.177125:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.177152:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.177184:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621600640 00000100:00100000:0.0:1746143750.177191:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621600640 00000100:00100000:0.0:1746143750.178074:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9702 00000100:00100000:0.0:1746143750.178081:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963621600640:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143750.178089:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.178097:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a353b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407982 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.178108:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.178110:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.178119:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a353b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407982 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.178145:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a353b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407982 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.178155:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268a00, rc 0) 00000100:00100000:0.0:1746143750.178192:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963621600640:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 110us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143750.178198:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9702 00000100:00100000:0.0:1746143750.179272:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.185946:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.190244:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.190326:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.190875:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.191876:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.194080:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.198660:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.201749:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9710 00000100:00100000:0.0:1746143750.201758:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963621602688:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143750.201767:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.201778:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73a35b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484079dd expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143750.201807:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626399616:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143750.201829:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.201845:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9711 00000100:00100000:0.0:1746143750.201851:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963621602560:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143750.201865:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.201873:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123268e00/0x87925e4cb73a35b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484079d6 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.201891:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123268e00/0x87925e4cb73a35b9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484079d6 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.201901:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123268e00/0x87925e4cb73a35b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484079d6 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.201928:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268e00, rc 0) 00000100:00100000:0.0:1746143750.201951:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963621602560:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 99us (1680us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143750.201958:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9711 00000100:00100000:0.0:1746143750.202067:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.202077:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621602944 00000100:00100000:0.0:1746143750.202080:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621602944 00000100:00100000:0.0:1746143750.202097:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9712 00000100:00100000:0.0:1746143750.202102:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:30976:x1830963621602944:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143750.202109:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.202117:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73a35c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484079e4 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.202134:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a3469 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407904 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.203078:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73a3542 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407989 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.203090:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73a3493 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407919 expref: 20 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.203097:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.203099:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.203103:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73a35c0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1134592->1368063] (req 1134592->1368063) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484079e4 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.203125:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73a3493 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407919 expref: 20 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.203135:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73a3493 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407919 expref: 20 pid: 3135 timeout: 909 lvb_type: 1 00000100:00100000:0.0:1746143750.203144:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626399744:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143750.203692:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73a3542 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407989 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.203701:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73a3542 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407989 expref: 11 pid: 9839 timeout: 909 lvb_type: 1 00000100:00100000:0.0:1746143750.203710:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626399872:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143750.203739:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a3469 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407904 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.203757:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a3469 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407904 expref: 45 pid: 3135 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746143750.203765:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626400000:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143750.203782:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.210486:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626399616:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143750.210524:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73a35b2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484079dd expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.210540:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73a35b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484079dd expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.210551:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268600, rc 0) 00000100:00100000:0.0:1746143750.210595:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963621602688:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8838us (10365us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143750.210604:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9710 00000100:00100000:0.0:1746143750.210664:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626399744:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143750.210712:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626399872:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143750.210736:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626400000:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143750.210757:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73a35c0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1134592->1368063] (req 1134592->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484079e4 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.210769:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e800, rc 0) 00000100:00100000:0.0:1746143750.210786:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+45:30976:x1830963621602944:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8684us (8719us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143750.210790:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9712 00000100:00100000:0.0:1746143750.212931:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.212953:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.212999:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621603584 00000100:00100000:0.0:1746143750.213004:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621603584 00000100:00100000:0.0:1746143750.213033:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621603840 00000100:00100000:0.0:1746143750.213034:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621603840 00000100:00100000:0.0:1746143750.213052:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621603328 00000100:00100000:0.0:1746143750.213053:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621603328 00010000:00010000:0.0:1746143750.213063:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a3469 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407904 expref: 45 pid: 3135 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746143750.217230:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.217308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.217356:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.217374:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.217392:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.217663:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.217678:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621604224 00000100:00100000:0.0:1746143750.217681:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621604224 00000100:00100000:0.0:1746143750.217703:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9713 00000100:00100000:0.0:1746143750.217709:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963621604224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143750.217723:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.217736:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634600/0x87925e4cb73a35f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484079f9 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143750.217764:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626400512:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143750.217789:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.217824:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.221751:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.221790:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.221838:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.223632:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2300 00000100:00100000:0.0:1746143750.223643:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963621605504:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143750.223757:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963621605504:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 117us (1965us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143750.223764:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2300 00002000:00100000:0.0:1746143750.223769:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (1363968->1368063) req@ffff88012457f100 x1830963621605504/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:146/0 lens 488/4536 e 0 to 0 dl 1746143761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.223777:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f100 with x1830963621605504 ext(1363968->1368063) 00002000:00010000:0.0:1746143750.223781:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457f100 00000100:00100000:0.0:1746143750.230588:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621605888 00000100:00100000:0.0:1746143750.230599:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621605888 00000100:00100000:0.0:1746143750.230653:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9717 00000100:00100000:0.0:1746143750.230662:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:30981:x1830963621605888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143750.230682:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.230700:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a3614 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407a15 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.230731:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73a35c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484079e4 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.230752:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143750.230754:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143750.230758:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a3614 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a15 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.230863:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73a35c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1368063) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484079e4 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.230875:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73a35c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1368063) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484079e4 expref: 43 pid: 3135 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746143750.230887:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626400768:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143750.230948:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.234484:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.243599:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.243688:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.263200:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.271727:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.271786:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.277882:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.295211:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.308018:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.308970:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.311408:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.312310:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.319145:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.326130:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.326184:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.350552:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.376635:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.402482:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.410465:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.415210:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621610240 00000100:00100000:0.0:1746143750.415221:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621610240 00010000:00010000:0.0:1746143750.415257:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368da200/0x87925e4cb73a3629 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a2a expref: 23 pid: 3135 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746143750.415837:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4334 00000100:00100000:0.0:1746143750.415845:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963621610240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143750.415860:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143750.415880:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368da200/0x87925e4cb73a3629 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a2a expref: 23 pid: 3135 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746143750.415893:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368da200/0x87925e4cb73a3629 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a2a expref: 23 pid: 3135 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746143750.415936:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368da200/0x87925e4cb73a3629 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a2a expref: 23 pid: 3135 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746143750.415965:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.415967:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.415975:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73a3661 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4067328->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a46 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.415998:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73a3661 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4067328->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a46 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.416037:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73a3661 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4067328->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a46 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143750.416049:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626401792:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143750.416129:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.420778:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.427134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.434078:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.434236:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.434271:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.434579:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4336 00000100:00100000:0.0:1746143750.434585:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2008:x1830963621610752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143750.434596:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143750.434617:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a3622 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a23 expref: 29 pid: 3135 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746143750.434627:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a3622 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a23 expref: 29 pid: 3135 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746143750.434780:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a3622 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a23 expref: 29 pid: 3135 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746143750.434813:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143750.434847:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963621610752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 262us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143750.434853:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4336 00000100:00100000:0.0:1746143750.437953:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.442389:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.457176:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.463219:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.471970:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.478314:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.493276:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.495733:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.500837:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.504745:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.518452:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.523866:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.542294:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.545550:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.548758:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.552626:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626403200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746143750.554186:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.554223:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.554244:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.554282:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.558298:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9730 00000100:00100000:0.0:1746143750.558307:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963621614208:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143750.558328:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.558337:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73a36c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407a85 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143750.558364:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626403456:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143750.558394:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.563267:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.568396:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.568458:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.568680:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621614976 00000100:00100000:0.0:1746143750.568684:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621614976 00002000:00100000:0.0:1746143750.568712:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88009719d180 x1830963621614976/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:146/0 lens 488/0 e 0 to 0 dl 1746143761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.568721:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719d180 with x1830963621614976 ext(1048576->2097151) 00002000:00010000:0.0:1746143750.568726:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719d180 00000100:00100000:0.0:1746143750.568749:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2312 00000100:00100000:0.0:1746143750.568755:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963621614976:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143750.578639:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.578744:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.578769:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.583252:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b99f1f93-ef24-4932-a1b4-452b64359da1:3771:1830963626403840:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583452:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143750.583479:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626404352:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583501:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143750.583526:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3771:1830963626404864:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583557:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143750.583574:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143750.583579:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626404992:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583665:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143750.583690:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b99f1f93-ef24-4932-a1b4-452b64359da1:3771:1830963626403840:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583701:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626404352:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583722:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626404992:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583738:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626404224:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583757:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143750.583773:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3774:1830963626404736:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583788:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143750.583798:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830963626405248:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583818:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143750.583836:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626404224:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583860:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3774:1830963626404736:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583878:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3771:1830963626404864:0@lo:400:kworker.0 00000100:00100000:0.0:1746143750.583901:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830963626405248:0@lo:400:kworker.0 00000100:00080000:0.0:1746143750.583958:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143750.585299:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621615744 00000100:00100000:0.0:1746143750.585306:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621615744 00000100:00100000:0.0:1746143750.585364:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12385 00000100:00100000:0.0:1746143750.585371:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:30993:x1830963621615744:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143750.585412:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.585417:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143750.585447:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512e00/0x87925e4cb73a36f4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a93 expref: 20 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.585492:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143750.585498:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143750.585513:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a000/0x87925e4cb73a3717 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407aa1 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.585627:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a371e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143750.585643:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a371e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143750.585654:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a371e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143750.585667:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a371e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143750.585674:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a371e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143750.585680:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a371e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143750.585686:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55ba00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143750.585689:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a371e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143750.585708:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a371e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143750.585717:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143750.585719:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143750.585722:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a371e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143750.585727:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a371e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143750.585756:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a000/0x87925e4cb73a3717 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407aa1 expref: 20 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.585764:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a000/0x87925e4cb73a3717 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407aa1 expref: 20 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.585771:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55a000, rc 0) 00000100:00100000:0.0:1746143750.585811:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:30993:x1830963621615744:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 439us (1847us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143750.585817:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12385 00002000:00010000:0.0:1746143750.592848:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143750 -> 1746143751 00000100:00100000:0.0:1746143750.592860:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626405504:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143750.592874:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a372c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407aaf expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.592883:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a372c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407aaf expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.593112:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c000, rc 0) 00000100:00100000:0.0:1746143750.593132:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963621616000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1986us (2571us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143750.593137:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9732 00000100:00100000:0.0:1746143750.604329:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.604378:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.605114:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9734 00000100:00100000:0.0:1746143750.605121:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963621616512:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143750.605128:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.605138:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55be00/0x87925e4cb73a373a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407abd expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143750.605164:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626405760:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143750.605194:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.609190:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.609235:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.610952:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.623217:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.642095:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.643401:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.651043:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.651596:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.668406:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.668453:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.673217:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.676423:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.678325:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.682990:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.687160:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.687247:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.691271:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.691305:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.691346:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.691365:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621619456 00000100:00100000:0.0:1746143750.691370:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621619456 00010000:00010000:0.0:1746143750.691397:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a35ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a00 expref: 28 pid: 12327 timeout: 909 lvb_type: 1 00000100:00100000:0.0:1746143750.698633:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.698659:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.700927:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.711299:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626407040 00000100:00100000:0.0:1746143750.711308:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626407040 00000100:00100000:0.0:1746143750.711353:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1746143750.711361:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626407040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746143750.711387:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 906502208 pending 7143424 free 3914395648 avail 3682873344 00000100:00100000:0.0:1746143750.711434:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626407040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143750.711441:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1746143750.718577:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.724818:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.735202:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.741160:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.762330:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.769239:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.769292:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.773836:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.776464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.779782:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.781993:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.795052:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.798822:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.823083:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.823201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.864316:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.864419:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.873374:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.873450:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.878493:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.879674:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.879725:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.883283:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.883321:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.891086:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.901432:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.906530:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.911268:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.929985:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.957801:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.958834:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.972021:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143750.994852:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.005737:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.005797:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621627904 00000100:00100000:0.0:1746143751.005807:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621627904 00000100:00080000:0.0:1746143751.005832:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1746143751.005865:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4607999) req@ffff880092b61500 x1830963621627904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.005873:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61500 with x1830963621627904 ext(4194304->4607999) 00002000:00010000:0.0:1746143751.005877:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b61500 00000100:00100000:0.0:1746143751.036240:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143751.047631:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143751.059100:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.059523:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143751.060703:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143751.067701:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.070532:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.072548:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.119530:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.125550:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.130764:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.138298:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.145777:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.153398:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963621630720:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5485us (7618us total) trans 17179872657 rc 0/0 00000100:00100000:0.0:1746143751.153411:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1110 00002000:00100000:0.0:1746143751.153425:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (3436544->3473407) req@ffff880092b60380 x1830963621630720/t17179872657(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:147/0 lens 488/448 e 0 to 0 dl 1746143762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.153447:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60380 with x1830963621630720 ext(3436544->3473407) 00010000:00010000:0.0:1746143751.153459:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97a00/0x87925e4cb73a383d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b7a expref: 28 pid: 13436 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.153475:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97a00/0x87925e4cb73a383d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3473407) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b7a expref: 28 pid: 13436 timeout: 910 lvb_type: 0 00002000:00010000:0.0:1746143751.153482:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b60380 00000001:00080000:0.0:1746143751.156352:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872657 is committed 00000001:00080000:0.0:1746143751.156378:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872655 is committed 00000001:00080000:0.0:1746143751.156452:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872636 is committed 00000001:00080000:0.0:1746143751.156464:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872628 is committed 00000100:00100000:0.0:1746143751.158386:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.168012:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.263235:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.281853:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.285869:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.285982:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.286017:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.286046:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.286152:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621632256 00000100:00100000:0.0:1746143751.286170:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621632256 00002000:00100000:0.0:1746143751.286214:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880092b63480 x1830963621632256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:147/0 lens 504/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.286223:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b63480 with x1830963621632256 ext(2097152->4194303) 00002000:00010000:0.0:1746143751.286229:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b63480 00000100:00100000:0.0:1746143751.286784:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621632512 00000100:00100000:0.0:1746143751.286788:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621632512 00002000:00100000:0.0:1746143751.286803:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2461696->4194303) req@ffff880092b60000 x1830963621632512/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.286809:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60000 with x1830963621632512 ext(2461696->4194303) 00002000:00010000:0.0:1746143751.286813:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b60000 00000100:00100000:0.0:1746143751.287372:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2340 00000100:00100000:0.0:1746143751.287378:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963621632512:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143751.294503:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.294539:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.296051:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.301268:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963621632512:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13887us (15218us total) trans 0 rc 1732608/1732608 00000100:00100000:0.0:1746143751.301277:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2340 00002000:00100000:0.0:1746143751.301286:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2461696->4194303) req@ffff880092b60000 x1830963621632512/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:147/0 lens 488/440 e 0 to 0 dl 1746143762 ref 1 fl Complete:/200/0 rc 1732608/1732608 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.301296:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60000 with x1830963621632512 ext(2461696->4194303) 00002000:00010000:0.0:1746143751.301301:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b60000 00000100:00100000:0.0:1746143751.305505:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.321366:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.321408:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.321455:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.323709:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.323802:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.323822:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621633792 00000100:00100000:0.0:1746143751.323828:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621633792 00000100:00100000:0.0:1746143751.323867:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621633920 00000100:00100000:0.0:1746143751.323870:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621633920 00000100:00100000:0.0:1746143751.323886:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9765 00000100:00100000:0.0:1746143751.323892:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2008:x1830963621633792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143751.323901:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.323929:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d2c00/0x87925e4cb73a38d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407bc0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.323970:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626411904:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143751.323996:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.329332:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.329762:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.329792:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.329962:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143751.330425:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143751.331192:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626411904:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143751.331429:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2c00/0x87925e4cb73a38d0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bc0 expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.331438:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2c00/0x87925e4cb73a38d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bc0 expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.331450:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2c00, rc 0) 00000100:00100000:0.0:1746143751.331536:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963621633792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7643us (7829us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143751.331542:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9765 00000100:00100000:0.0:1746143751.332871:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.337322:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.337907:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.338929:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.338959:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.339613:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.339759:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.340821:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143751.341328:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143751.343524:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.346256:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.346495:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.347243:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.351972:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621636736 00000100:00100000:0.0:1746143751.351982:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621636736 00000100:00100000:0.0:1746143751.352126:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12392 00000100:00100000:0.0:1746143751.352135:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+21:31032:x1830963621636736:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143751.352156:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.352189:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2c00/0x87925e4cb73a390f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407bff expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.352568:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a3916 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143751.352583:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a38c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb2 expref: 22 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.352591:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a3916 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143751.352718:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a38c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb2 expref: 22 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.353034:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a38c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb2 expref: 22 pid: 6587 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746143751.353081:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626412928:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143751.353182:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.355838:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626412928:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143751.355868:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a3916 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143751.356465:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a3916 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143751.356472:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a3916 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143751.356492:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143751.356675:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2c00/0x87925e4cb73a390f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bff expref: 23 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.356705:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a3916 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bff expref: 22 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.356711:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143751.356713:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143751.356716:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d3e00, rc 0) 00000100:00100000:0.0:1746143751.356749:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+22:31032:x1830963621636736:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4615us (4946us total) trans 8589942993 rc 0/0 00000100:00100000:0.0:1746143751.356768:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12392 00000100:00100000:0.0:1746143751.358672:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.358716:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.359618:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.363885:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.365483:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.370555:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.370594:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.370626:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.370655:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.370670:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.370698:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.371231:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9780 00000100:00100000:0.0:1746143751.371238:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963621638272:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143751.371256:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73a3963 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.371278:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a3614 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a15 expref: 6 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.371286:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a36ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a70 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.371293:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73a3630 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a31 expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.371307:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.371308:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.371310:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73a3963 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.371333:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73a3630 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a31 expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.371343:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73a3630 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a31 expref: 23 pid: 1945 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746143751.371356:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626413824:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143751.371442:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a36ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a70 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.371980:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a36ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a70 expref: 11 pid: 1945 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746143751.371989:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626413952:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143751.372011:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a3614 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a15 expref: 6 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.372019:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a3614 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a15 expref: 6 pid: 3135 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746143751.372035:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626414592:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143751.372047:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.379756:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.381263:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.381301:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.381313:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.381329:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.381354:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621639424 00000100:00100000:0.0:1746143751.381361:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621639424 00010000:00010000:0.0:1746143751.381397:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a3813 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b6c expref: 22 pid: 13436 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746143751.381420:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621640192 00000100:00100000:0.0:1746143751.381423:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621640192 00010000:00010000:0.0:1746143751.381431:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73a321d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407760 expref: 7 pid: 3135 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746143751.381443:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4367 00000100:00100000:0.0:1746143751.381450:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963621639424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.381462:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.381483:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a3813 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b6c expref: 22 pid: 13436 timeout: 910 lvb_type: 1 00010000:00010000:0.0:1746143751.381492:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a3813 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b6c expref: 22 pid: 13436 timeout: 910 lvb_type: 1 00010000:00010000:0.0:1746143751.381551:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.381732:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963621639424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 283us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.381738:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4367 00000100:00100000:0.0:1746143751.381766:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.381937:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621640448 00000100:00100000:0.0:1746143751.381940:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621640448 00010000:00010000:0.0:1746143751.382029:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a37f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b50 expref: 8 pid: 13436 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746143751.382055:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4370 00000100:00100000:0.0:1746143751.382147:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963621640448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.382153:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.382169:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a37f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b50 expref: 8 pid: 13436 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.382177:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a37f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b50 expref: 8 pid: 13436 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.382186:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a37f7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b50 expref: 8 pid: 13436 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.382197:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.382199:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.382203:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a396a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.382220:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a396a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.382238:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.382250:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963621640448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 191us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.382256:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4370 00000100:00100000:0.0:1746143751.382285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.382299:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.382306:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621639168 00000100:00100000:0.0:1746143751.382308:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621639168 00010000:00010000:0.0:1746143751.382317:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73a3630 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a31 expref: 24 pid: 1945 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746143751.382328:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621639552 00000100:00100000:0.0:1746143751.382330:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621639552 00010000:00010000:0.0:1746143751.382337:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a36ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a70 expref: 11 pid: 1945 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746143751.382346:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4373 00000100:00100000:0.0:1746143751.382350:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963621639552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.382355:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.382359:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a36ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a70 expref: 11 pid: 1945 timeout: 910 lvb_type: 1 00010000:00010000:0.0:1746143751.382378:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a36ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a70 expref: 11 pid: 1945 timeout: 910 lvb_type: 1 00010000:00010000:0.0:1746143751.382397:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a36ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a70 expref: 11 pid: 1945 timeout: 910 lvb_type: 1 00010000:00010000:0.0:1746143751.382404:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.382418:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963621639552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.382423:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4373 00000100:00100000:0.0:1746143751.382449:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.382457:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621639936 00000100:00100000:0.0:1746143751.382460:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621639936 00010000:00010000:0.0:1746143751.382468:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3800/0x87925e4cb73a3932 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c0d expref: 10 pid: 12327 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746143751.382480:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4374 00000100:00100000:0.0:1746143751.382484:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963621639936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.382490:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.382496:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a3800/0x87925e4cb73a3932 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c0d expref: 10 pid: 12327 timeout: 910 lvb_type: 1 00010000:00010000:0.0:1746143751.382503:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a3800/0x87925e4cb73a3932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c0d expref: 10 pid: 12327 timeout: 910 lvb_type: 1 00010000:00010000:0.0:1746143751.382518:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3800/0x87925e4cb73a3932 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c0d expref: 10 pid: 12327 timeout: 910 lvb_type: 1 00010000:00010000:0.0:1746143751.382534:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.382548:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621639936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 64us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.382554:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4374 00000100:00100000:0.0:1746143751.382581:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.382594:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.382606:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.382614:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621639680 00000100:00100000:0.0:1746143751.382616:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621639680 00010000:00010000:0.0:1746143751.382625:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a3614 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a15 expref: 6 pid: 3135 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746143751.382641:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4376 00000100:00100000:0.0:1746143751.382645:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2010:x1830963621639680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.382651:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.382656:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a3614 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a15 expref: 6 pid: 3135 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.382663:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a3614 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a15 expref: 6 pid: 3135 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.382672:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a3614 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407a15 expref: 6 pid: 3135 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.382681:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.382696:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2010:x1830963621639680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 50us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.382701:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4376 00000100:00100000:0.0:1746143751.382745:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.382972:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621640320 00000100:00100000:0.0:1746143751.382975:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621640320 00002000:00100000:0.0:1746143751.382992:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2461695) req@ffff880095e31880 x1830963621640320/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.382999:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31880 with x1830963621640320 ext(2097152->2461695) 00010000:00010000:0.0:1746143751.383004:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73a3852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b8f expref: 24 pid: 1945 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.383012:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73a3852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407b8f expref: 24 pid: 1945 timeout: 910 lvb_type: 0 00002000:00010000:0.0:1746143751.383017:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095e31880 00000100:00100000:0.0:1746143751.383028:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621640576 00000100:00100000:0.0:1746143751.383030:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621640576 00002000:00100000:0.0:1746143751.383039:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (602112->921599) req@ffff880095e31180 x1830963621640576/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.383046:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963621640576 ext(602112->921599) 00010000:00010000:0.0:1746143751.383050:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73a38ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 602112->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb9 expref: 7 pid: 1945 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.383057:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73a38ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 602112->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb9 expref: 7 pid: 1945 timeout: 910 lvb_type: 0 00002000:00010000:0.0:1746143751.383070:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e31180 00000100:00100000:0.0:1746143751.383081:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1113 00000100:00100000:0.0:1746143751.383084:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963621640320:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143751.384138:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621640704 00000100:00100000:0.0:1746143751.384143:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621640704 00000100:00100000:0.0:1746143751.384187:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9784 00000100:00100000:0.0:1746143751.384193:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:31029:x1830963621640704:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143751.384203:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.384215:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73a397f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407c29 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.384231:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143751.384235:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73a3971 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.384240:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143751.384243:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73a397f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c29 expref: 6 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.384255:0:9587:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73a3971 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.384266:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73a397f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c29 expref: 6 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.384290:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ce00, rc 0) 00000100:00100000:0.0:1746143751.384322:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:31029:x1830963621640704:12345-192.168.202.3@tcp:101:cat.0 Request processed in 129us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.384328:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9784 00000100:00100000:0.0:1746143751.387578:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.392673:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963621640576:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9391us (9925us total) trans 21474839963 rc 0/0 00000100:00100000:0.0:1746143751.392680:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1114 00002000:00100000:0.0:1746143751.392686:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (602112->921599) req@ffff880095e31180 x1830963621640576/t21474839963(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:147/0 lens 488/448 e 0 to 0 dl 1746143762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.392693:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963621640576 ext(602112->921599) 00010000:00010000:0.0:1746143751.392699:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73a38ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 602112->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb9 expref: 8 pid: 1945 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.392708:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73a38ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 602112->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb9 expref: 8 pid: 1945 timeout: 910 lvb_type: 0 00002000:00010000:0.0:1746143751.392713:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e31180 00000100:00100000:0.0:1746143751.396400:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.397856:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621641472 00000100:00100000:0.0:1746143751.397860:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621641472 00010000:00010000:0.0:1746143751.397880:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3940 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c22 expref: 23 pid: 6587 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746143751.398271:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4380 00000100:00100000:0.0:1746143751.398287:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+23:2009:x1830963621641472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.398295:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.399312:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3940 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c22 expref: 23 pid: 6587 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.399321:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3940 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c22 expref: 23 pid: 6587 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.399337:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3940 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c22 expref: 23 pid: 6587 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.399351:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143751.399355:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a398d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143751.399363:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a398d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143751.399369:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a398d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143751.399380:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.399398:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+22:2009:x1830963621641472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1112us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.399404:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4380 00000100:00100000:0.0:1746143751.399416:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621641600 00000100:00100000:0.0:1746143751.399419:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621641600 00010000:00010000:0.0:1746143751.399431:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73a38ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 602112->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb9 expref: 8 pid: 1945 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746143751.399468:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4381 00000100:00100000:0.0:1746143751.399473:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963621641600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.399481:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.399495:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73a38ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 602112->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb9 expref: 8 pid: 1945 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.399503:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73a38ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 602112->921599) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb9 expref: 8 pid: 1945 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.399514:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73a38ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 602112->921599) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407bb9 expref: 8 pid: 1945 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746143751.399522:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.399523:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.399526:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b26600/0x87925e4cb73a3978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.399532:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b26600/0x87925e4cb73a3978 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.399541:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.399555:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2011:x1830963621641600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.399559:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4381 00000100:00100000:0.0:1746143751.403363:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.405237:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.412038:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.414877:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.418322:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.429023:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.429079:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.429317:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2347 00000100:00100000:0.0:1746143751.429324:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963621643264:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143751.458151:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.458203:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.458230:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.458244:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.458269:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621643520 00000100:00100000:0.0:1746143751.458278:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621643520 00000100:00100000:0.0:1746143751.458331:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621643776 00000100:00100000:0.0:1746143751.458334:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621643776 00000100:00100000:0.0:1746143751.458348:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621643648 00000100:00100000:0.0:1746143751.458350:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621643648 00000100:00100000:0.0:1746143751.458358:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621643904 00000100:00100000:0.0:1746143751.458361:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621643904 00000100:00100000:0.0:1746143751.458943:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9787 00000100:00100000:0.0:1746143751.458952:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963621643776:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143751.458960:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.458971:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a39a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407c4c expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143751.458986:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a05, atime: 0x68140a04, ctime: 0x68140a05, blocks: 0x800 00010000:00010000:0.0:1746143751.458995:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.458996:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.459013:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a39a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c4c expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.459023:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a39a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c4c expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.459030:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77c00, rc 0) 00000100:00100000:0.0:1746143751.459047:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963621643776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 98us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.459053:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9787 00000100:00100000:0.0:1746143751.459069:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9788 00000100:00100000:0.0:1746143751.459073:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963621643648:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143751.459078:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.459085:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73a39b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407c45 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143751.459094:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a06, atime: 0x68140a03, ctime: 0x68140a06, blocks: 0x808 00010000:00010000:0.0:1746143751.459101:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.459102:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.459105:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73a39b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c45 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.459114:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73a39b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c45 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.459121:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77800, rc 0) 00000100:00100000:0.0:1746143751.459136:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963621643648:12345-192.168.202.3@tcp:101:cat.0 Request processed in 62us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.459146:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9788 00000100:00100000:0.0:1746143751.459155:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9789 00000100:00100000:0.0:1746143751.459170:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963621643904:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143751.459176:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.459184:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73a39b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407c53 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143751.459194:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a07, atime: 0x68140a07, ctime: 0x68140a07, blocks: 0x808 00010000:00010000:0.0:1746143751.459201:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.459203:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.459206:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73a39b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c53 expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.459215:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73a39b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c53 expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.459222:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76000, rc 0) 00000100:00100000:0.0:1746143751.459237:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963621643904:12345-192.168.202.3@tcp:101:cat.0 Request processed in 77us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.459242:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9789 00000100:00100000:0.0:1746143751.459288:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.512487:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.512567:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.512644:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.512851:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.513001:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.527205:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.530630:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.532492:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.532588:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.582470:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.591271:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.593568:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.593598:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.597887:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.604176:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.633223:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.638875:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.641121:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626416000:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143751.641141:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.641172:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963621647360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7118us (7961us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.641179:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4383 00000100:00100000:0.0:1746143751.641691:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621648000 00000100:00100000:0.0:1746143751.641696:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621648000 00002000:00100000:0.0:1746143751.641724:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2736128->2740223) req@ffff880093071500 x1830963621648000/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.641733:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071500 with x1830963621648000 ext(2736128->2740223) 00002000:00010000:0.0:1746143751.641738:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093071500 00000100:00100000:0.0:1746143751.650206:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.650314:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.661328:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621648896 00000100:00100000:0.0:1746143751.661336:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621648896 00002000:00100000:0.0:1746143751.661376:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012457e300 x1830963621648896/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.661386:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457e300 with x1830963621648896 ext(1048576->2097151) 00002000:00010000:0.0:1746143751.661635:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457e300 00000100:00100000:0.0:1746143751.661661:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2357 00000100:00100000:0.0:1746143751.661668:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963621648896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143751.691110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.697288:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.703607:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.705240:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.705952:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.709007:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.713850:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.722523:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.724515:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.734492:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.747493:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.754050:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.760089:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.763501:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.763533:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.763572:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.766566:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.766600:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.766760:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2361 00000100:00100000:0.0:1746143751.766769:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800960fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963621652608:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143751.766896:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800960fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963621652608:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 128us (339us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143751.766901:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2361 00002000:00100000:0.0:1746143751.766906:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1904640->1908735) req@ffff8800960fed80 x1830963621652608/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:147/0 lens 488/4536 e 0 to 0 dl 1746143762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.766941:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800960fed80 with x1830963621652608 ext(1904640->1908735) 00002000:00010000:0.0:1746143751.766944:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800960fed80 00000100:00100000:0.0:1746143751.771040:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.776062:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.777115:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.779657:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626417792:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143751.779875:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.779951:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800960ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963621652992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2734us (2835us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.779962:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4390 00000100:00100000:0.0:1746143751.783425:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.784181:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.790019:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.796649:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.797221:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.829295:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621654400 00000100:00100000:0.0:1746143751.829307:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621654400 00002000:00100000:0.0:1746143751.829353:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4607999) req@ffff88012457c000 x1830963621654400/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.829365:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c000 with x1830963621654400 ext(4194304->4607999) 00002000:00010000:0.0:1746143751.829379:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457c000 00000100:00100000:0.0:1746143751.829404:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2365 00000100:00100000:0.0:1746143751.829411:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963621654400:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143751.836593:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.840273:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.843583:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.843621:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.843696:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.843714:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621655168 00000100:00100000:0.0:1746143751.843718:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621655168 00000100:00100000:0.0:1746143751.843962:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9808 00000100:00100000:0.0:1746143751.843970:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963621655296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143751.843978:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.843986:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a3a9e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407ced expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.843999:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.844001:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.844008:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a3a9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ced expref: 26 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.844023:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a3a9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ced expref: 26 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.844033:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7c600, rc 0) 00000100:00100000:0.0:1746143751.844113:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963621655296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 143us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.844130:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9808 00000100:00100000:0.0:1746143751.846130:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.846459:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.846488:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.846512:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.846525:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.846548:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.855675:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.858795:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.858867:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621656832 00000100:00100000:0.0:1746143751.858871:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621656832 00000100:00100000:0.0:1746143751.858902:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12400 00000100:00100000:0.0:1746143751.858908:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800960ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+23:31052:x1830963621656832:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143751.858949:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.858964:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7cc00/0x87925e4cb73a3aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407d33 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.859050:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a3af2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143751.859062:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a3af2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143751.859069:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a3af2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143751.859412:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143751.859947:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a3af2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143751.859963:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a3af2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143751.859977:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143751.860323:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7cc00/0x87925e4cb73a3aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d33 expref: 25 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.860585:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a3af2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d33 expref: 24 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.860591:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143751.860593:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143751.860595:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7c200, rc 0) 00000100:00100000:0.0:1746143751.860626:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800960ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+24:31052:x1830963621656832:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1718us (1841us total) trans 8589943004 rc 0/0 00000100:00100000:0.0:1746143751.860632:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12400 00000100:00100000:0.0:1746143751.862768:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.862815:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.865399:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.865438:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.867868:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.885589:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621658496 00000100:00100000:0.0:1746143751.885600:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621658496 00000100:00100000:0.0:1746143751.885653:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9819 00000100:00100000:0.0:1746143751.885662:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+24:31056:x1830963621658496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143751.885683:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.885702:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a3b23 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407d56 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.885744:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd87000/0x87925e4cb73a3a6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1826815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407cd1 expref: 9 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.885751:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143751.885753:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143751.885756:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a3b23 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d56 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.885851:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd87000/0x87925e4cb73a3a6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1826815) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407cd1 expref: 9 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.885865:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd87000/0x87925e4cb73a3a6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1826815) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407cd1 expref: 9 pid: 12327 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746143751.885878:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626419456:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143751.885973:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.893705:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626419456:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143751.893741:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a3b23 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d56 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.893757:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31000, rc 0) 00000100:00100000:0.0:1746143751.893793:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:31056:x1830963621658496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8131us (8264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.893801:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9819 00000100:00100000:0.0:1746143751.903866:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.910843:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.916719:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.930736:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.932939:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.965851:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.965909:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.978193:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143751.991771:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.002255:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.072588:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.085072:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.085867:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.085903:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.086011:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4399 00000100:00100000:0.0:1746143752.086018:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963621661440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143752.086025:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143752.086034:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73a39c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c61 expref: 29 pid: 12328 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746143752.086042:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73a39c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c61 expref: 29 pid: 12328 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746143752.086059:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73a39c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407c61 expref: 29 pid: 12328 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746143752.086105:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143752.086216:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963621661440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 198us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.086232:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4399 00000100:00100000:0.0:1746143752.087039:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626420224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746143752.087076:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.087599:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626420224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746143752.107953:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.117601:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.118133:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.124125:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.124170:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.124196:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621662208 00000100:00100000:0.0:1746143752.124202:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621662208 00010000:00010000:0.0:1746143752.124236:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87200/0x87925e4cb73a3b1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d41 expref: 9 pid: 9585 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746143752.125751:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621662464 00000100:00100000:0.0:1746143752.125755:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621662464 00010000:00010000:0.0:1746143752.125773:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a3ad6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d2c expref: 29 pid: 13436 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746143752.126880:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4403 00000100:00100000:0.0:1746143752.126889:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963621662464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143752.126900:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143752.126927:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a3ad6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d2c expref: 29 pid: 13436 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746143752.126936:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a3ad6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d2c expref: 29 pid: 13436 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746143752.126966:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a3ad6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d2c expref: 29 pid: 13436 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746143752.126981:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.126983:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.126989:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b47bc00/0x87925e4cb73a3b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d79 expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.126998:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b47bc00/0x87925e4cb73a3b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d79 expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.127029:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b47bc00/0x87925e4cb73a3b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d79 expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143752.127040:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e24700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626421120:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143752.127086:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebcc0 going to sleep for 11 seconds 00000100:00080000:0.0:1746143752.128480:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143752.134636:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.134692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.138964:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.141684:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.144018:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.152492:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.159800:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.167172:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143752.167388:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143752.205572:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143752.207260:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143752.211615:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.215852:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.215900:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.215960:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.216005:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.227387:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.236729:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.236766:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.237472:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.238336:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143752.241403:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a3bc4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143752.241410:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a3bc4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143752.241431:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143752.241562:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a3bbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407db1 expref: 27 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.242426:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a3bc4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407db1 expref: 26 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.242434:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143752.242437:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143752.242440:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ba00, rc 0) 00000100:00100000:0.0:1746143752.260420:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.263002:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.263045:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.271452:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.271534:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.272118:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.272144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.272171:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.272398:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.272418:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.272435:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621667072 00000100:00100000:0.0:1746143752.272439:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621667072 00000100:00100000:0.0:1746143752.272458:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621667328 00000100:00100000:0.0:1746143752.272460:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621667328 00000100:00100000:0.0:1746143752.272470:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621667584 00000100:00100000:0.0:1746143752.272472:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621667584 00000100:00100000:0.0:1746143752.272480:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621667200 00000100:00100000:0.0:1746143752.272482:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621667200 00000100:00100000:0.0:1746143752.272489:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621667456 00000100:00100000:0.0:1746143752.272491:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621667456 00000100:00100000:0.0:1746143752.273668:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.286466:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.286484:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.286495:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.286508:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.286550:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626424064:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143752.286566:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.286579:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.286603:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626423936:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143752.286625:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621668224 00000100:00100000:0.0:1746143752.287962:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621668224 00002000:00100000:0.0:1746143752.287995:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1736703) req@ffff880092b3b100 x1830963621668224/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:148/0 lens 488/0 e 0 to 0 dl 1746143763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.288003:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3b100 with x1830963621668224 ext(1048576->1736703) 00010000:00010000:0.0:1746143752.288008:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012323a600/0x87925e4cb73a3b7e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d87 expref: 9 pid: 9585 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746143752.288016:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012323a600/0x87925e4cb73a3b7e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d87 expref: 9 pid: 9585 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746143752.288022:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b3b100 00000100:00100000:0.0:1746143752.288039:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1126 00000100:00100000:0.0:1746143752.288044:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963621668224:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143752.289272:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.290147:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.291561:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626424192:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143752.291597:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73a3c2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143752.291630:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.291644:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.291679:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.299542:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621669248 00000100:00100000:0.0:1746143752.299551:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621669248 00010000:00010000:0.0:1746143752.299584:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a3a9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ced expref: 24 pid: 13436 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746143752.299634:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4419 00000100:00100000:0.0:1746143752.299643:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963621669248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143752.299661:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143752.299683:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a3a9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ced expref: 24 pid: 13436 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746143752.299695:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a3a9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ced expref: 24 pid: 13436 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746143752.299720:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a3a9e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ced expref: 24 pid: 13436 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746143752.300414:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.300416:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.300421:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73a3c2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.300430:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73a3c2d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.300456:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143752.300498:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963621669248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 855us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.300505:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4419 00000100:00100000:0.0:1746143752.307637:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963621668224:12345-192.168.202.3@tcp:4:cat.0 Request processed in 19582us (21116us total) trans 17179872663 rc 0/0 00000100:00100000:0.0:1746143752.307656:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1126 00002000:00100000:0.0:1746143752.307668:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1736703) req@ffff880092b3b100 x1830963621668224/t17179872663(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:148/0 lens 488/448 e 0 to 0 dl 1746143763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.307677:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3b100 with x1830963621668224 ext(1048576->1736703) 00010000:00010000:0.0:1746143752.307686:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012323a600/0x87925e4cb73a3b7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d87 expref: 10 pid: 9585 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746143752.307698:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012323a600/0x87925e4cb73a3b7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407d87 expref: 10 pid: 9585 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746143752.307705:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b3b100 00000100:00100000:0.0:1746143752.309615:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.313737:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.316996:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.317060:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.321705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.324094:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.330472:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.340715:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.340959:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.341429:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.341526:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.342400:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.342716:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.342935:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.342987:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.350934:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621672064 00000100:00100000:0.0:1746143752.350944:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621672064 00000100:00100000:0.0:1746143752.350986:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9843 00000100:00100000:0.0:1746143752.350994:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31075:x1830963621672064:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143752.351011:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.351029:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73a3c57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407dfe expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.351057:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.351059:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.351066:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73a3c57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407dfe expref: 10 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.351080:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73a3c57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407dfe expref: 10 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.351090:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74000, rc 0) 00000100:00100000:0.0:1746143752.351136:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31075:x1830963621672064:12345-192.168.202.3@tcp:101:cat.0 Request processed in 142us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.351142:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9843 00000100:00100000:0.0:1746143752.351813:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626426496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.351838:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.352532:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626427008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.352552:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.352563:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143752.352567:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626426880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.352583:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.352605:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626427392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.352621:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.353359:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626426624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.353381:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.355269:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626427136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.355313:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.355332:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143752.355337:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626426752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.355351:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.355360:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626427264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.355373:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746143752.355393:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143752.355398:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143752.355424:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872636 gen 2 00000004:00080000:0.0:1746143752.355429:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d840e00, transno 17179872620 00000004:00080000:0.0:1746143752.355436:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e358a80, transno 17179872621 00000004:00080000:0.0:1746143752.355439:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35b480, transno 17179872622 00000004:00080000:0.0:1746143752.355442:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391ca80, transno 17179872623 00000004:00080000:0.0:1746143752.355444:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e359c00, transno 17179872624 00000004:00080000:0.0:1746143752.355446:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35ad80, transno 17179872625 00000004:00080000:0.0:1746143752.355448:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391f100, transno 17179872626 00000004:00080000:0.0:1746143752.355450:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35b100, transno 17179872627 00000004:00080000:0.0:1746143752.355453:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391e300, transno 17179872629 00000004:00080000:0.0:1746143752.355456:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391dc00, transno 17179872630 00000004:00080000:0.0:1746143752.355458:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391c700, transno 17179872631 00000004:00080000:0.0:1746143752.355461:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391e680, transno 17179872632 00000004:00080000:0.0:1746143752.355463:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391f800, transno 17179872633 00000004:00080000:0.0:1746143752.355476:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391fb80, transno 17179872634 00000004:00080000:0.0:1746143752.355478:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391d880, transno 17179872635 00000004:00080000:0.0:1746143752.355481:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391df80, transno 17179872636 00000100:00100000:0.0:1746143752.355486:0:3774:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8801368eaa00 x1830963626426880/t17179872666(17179872666) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143768 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143752.355495:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368eaa00/2, rc 0, transno 17179872666 00000100:00100000:0.0:1746143752.355499:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626426880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143752.355512:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368eb800/2, rc 0, transno 17179872667 00000100:00100000:0.0:1746143752.355516:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626427392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143752.355524:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368eb100/2, rc 0, transno 17179872664 00000100:00100000:0.0:1746143752.355527:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626426496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143752.355534:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368ebb80/2, rc 0, transno 17179872665 00000100:00100000:0.0:1746143752.355537:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626427008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143752.355664:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 16 done 00000004:00080000:0.0:1746143752.355681:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368e8700/2, rc 0, transno 17179872670 00000100:00100000:0.0:1746143752.355685:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626426752:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143752.355691:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368e9500/2, rc 0, transno 17179872668 00000100:00100000:0.0:1746143752.355694:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626426624:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143752.355700:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368ea300/2, rc 0, transno 17179872669 00000100:00100000:0.0:1746143752.355702:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626427136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143752.355746:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368e9c00/2, rc 0, transno 17179872671 00000100:00100000:0.0:1746143752.355749:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626427264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.358553:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.361464:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.361560:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12411 00000100:00100000:0.0:1746143752.361568:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31069:x1830963621672704:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143752.361582:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.361596:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73a3c65 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407e13 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.361631:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73a3c65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e13 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.361643:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73a3c65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e13 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.361659:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143752.361661:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143752.361664:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75400, rc 0) 00000100:00100000:0.0:1746143752.361684:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31069:x1830963621672704:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 118us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.362284:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12411 00000100:00100000:0.0:1746143752.365026:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.365112:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143752.365514:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73a3c81 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365520:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73a3c81 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143752.365538:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143752.365631:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73a3c81 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365649:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73a3c81 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365653:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73a3c81 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365658:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082086a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143752.365662:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73a3c81 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365668:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73a3c81 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365676:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143752.365678:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143752.365681:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73a3c81 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365686:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73a3c81 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365719:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082086800/0x87925e4cb73a3c73 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365724:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082086800/0x87925e4cb73a3c73 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365729:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082086800/0x87925e4cb73a3c73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365733:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082086800/0x87925e4cb73a3c73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365736:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082086800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143752.365742:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082086800/0x87925e4cb73a3c73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365746:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082086800/0x87925e4cb73a3c73 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365753:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143752.365754:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143752.365757:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082086800/0x87925e4cb73a3c73 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.365762:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082086800/0x87925e4cb73a3c73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.366455:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a3c7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.366463:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a3c7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.366467:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a3c7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.366476:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082087400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143752.366479:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a3c7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.366484:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a3c7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.366492:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e030f00) 00010000:00010000:0.0:1746143752.366494:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143752.366497:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a3c7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.366509:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a3c7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.366555:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a3c6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e0c expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.366563:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a3c6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e0c expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.366571:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2a00, rc 0) 00000100:00100000:0.0:1746143752.366592:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+262:31077:x1830963621672576:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5015us (5087us total) trans 8589943012 rc 301/301 00000100:00100000:0.0:1746143752.366598:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12412 00000100:00100000:0.0:1746143752.369598:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.373935:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621673472 00000100:00100000:0.0:1746143752.373944:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621673472 00000100:00100000:0.0:1746143752.373993:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12413 00000100:00100000:0.0:1746143752.374001:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31069:x1830963621673472:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143752.374023:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.374041:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a3c8f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407e1a expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.374134:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73a3c96 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.374148:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73a3c96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.374168:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73a3c96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143752.374218:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143752.374225:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143752.374243:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73a3c96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.374275:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a3c8f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e1a expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.374302:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73a3c96 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e1a expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.374311:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143752.374314:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143752.374318:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e800, rc 0) 00000100:00100000:0.0:1746143752.374374:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31069:x1830963621673472:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 373us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.374379:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12413 00000100:00100000:0.0:1746143752.381237:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.384372:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621674112 00000100:00100000:0.0:1746143752.384380:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621674112 00000100:00100000:0.0:1746143752.384429:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621673728 00000100:00100000:0.0:1746143752.384432:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621673728 00000100:00100000:0.0:1746143752.384444:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621673984 00000100:00100000:0.0:1746143752.384446:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621673984 00000100:00100000:0.0:1746143752.384459:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9863 00000100:00100000:0.0:1746143752.384465:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963621674112:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143752.384477:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.384493:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a3cab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407e3d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143752.384526:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4606400, mtime: 0x68140a08, atime: 0x68140a08, ctime: 0x68140a08, blocks: 0x1330 00010000:00010000:0.0:1746143752.384541:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.384543:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.384548:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a3cab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e3d expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.384560:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a3cab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e3d expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.384570:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ea00, rc 0) 00000100:00100000:0.0:1746143752.384598:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621674112:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 133us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.384604:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9863 00000100:00100000:0.0:1746143752.384616:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9864 00000100:00100000:0.0:1746143752.384621:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963621673728:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143752.384628:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.384636:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a3cb2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407e28 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.384647:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.384649:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.384653:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a3cb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e28 expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.384661:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a3cb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e28 expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.384679:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fc00, rc 0) 00000100:00100000:0.0:1746143752.384694:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621673728:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 74us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.384699:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9864 00000100:00100000:0.0:1746143752.384709:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9865 00000100:00100000:0.0:1746143752.384713:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963621673984:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143752.384718:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.384725:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73a3cb9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407e36 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143752.384735:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a08, atime: 0x68140a07, ctime: 0x68140a08, blocks: 0x808 00010000:00010000:0.0:1746143752.384742:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.384744:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.384747:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73a3cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e36 expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.384755:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73a3cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e36 expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.384762:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fe00, rc 0) 00000100:00100000:0.0:1746143752.384774:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621673984:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 61us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.384779:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9865 00000100:00100000:0.0:1746143752.384951:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.384964:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621674240 00000100:00100000:0.0:1746143752.384971:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621674240 00000100:00100000:0.0:1746143752.384986:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9866 00000100:00100000:0.0:1746143752.384991:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621674240:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143752.384997:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.385005:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84f200/0x87925e4cb73a3cc0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407e44 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143752.385017:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a08, atime: 0x68140a08, ctime: 0x68140a08, blocks: 0x1008 00010000:00010000:0.0:1746143752.385024:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.385025:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.385029:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84f200/0x87925e4cb73a3cc0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e44 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.385036:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84f200/0x87925e4cb73a3cc0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e44 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.385042:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f200, rc 0) 00000100:00100000:0.0:1746143752.385057:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963621674240:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 66us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.385062:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9866 00000100:00100000:0.0:1746143752.387590:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.392753:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.394480:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.398060:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621675264 00000100:00100000:0.0:1746143752.398071:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621675264 00000100:00100000:0.0:1746143752.398134:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12414 00000100:00100000:0.0:1746143752.398142:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31079:x1830963621675264:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143752.398199:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.398220:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a3cd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407e59 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.398299:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398312:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398322:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398334:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a3ce3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398339:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a3ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398344:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a3ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398449:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a3cea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398458:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a3cea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398463:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a3cea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143752.398472:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143752.398545:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a3cea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398559:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a3cea lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398565:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a3cea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398569:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84e000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143752.398572:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a3cea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398577:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a3cea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398586:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143752.398589:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143752.398592:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a3cea lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398597:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a3cea lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398626:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398630:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398634:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398639:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398642:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ee00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143752.398647:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398652:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398657:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143752.398658:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143752.398660:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398664:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a3cdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398670:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a3ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398674:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a3ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398678:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a3ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398681:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84f400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143752.398682:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a3ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398686:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a3ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398689:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5be3400) 00010000:00010000:0.0:1746143752.398691:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143752.398692:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a3ce3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398702:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a3ce3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143752.398737:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a3cd5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e59 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.398743:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a3cd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e59 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.398749:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f800, rc 0) 00000100:00100000:0.0:1746143752.398793:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31079:x1830963621675264:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 652us (883us total) trans 8589943013 rc 301/301 00000100:00100000:0.0:1746143752.398800:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12414 00000100:00100000:0.0:1746143752.418197:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.418252:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.421081:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.422841:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.422984:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9872 00000100:00100000:0.0:1746143752.422993:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31075:x1830963621675776:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143752.423005:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.423019:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a3d0d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407e75 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.423037:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.423039:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.423045:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a3d0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e75 expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.423074:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a3d0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e75 expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.423083:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2db400, rc 0) 00000100:00100000:0.0:1746143752.423125:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:31075:x1830963621675776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 133us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.423130:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9872 00000100:00100000:0.0:1746143752.428861:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.434374:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.435085:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.441374:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.451437:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.451872:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.451954:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.452633:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.458127:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626429696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.459017:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626428288 00000100:00100000:0.0:1746143752.459025:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626428288 00000100:00100000:0.0:1746143752.459568:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9876 00000100:00100000:0.0:1746143752.459573:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626429056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.459627:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9877 00000100:00100000:0.0:1746143752.459633:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3773:x1830963626428672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143752.459682:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143752.459685:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143752.459695:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:0.0:1746143752.459696:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143752.459699:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143752.459722:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3773:x1830963626428672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (1618us total) trans 17179872674 rc 0/0 00000100:00100000:0.0:1746143752.459727:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9877 00000100:00100000:0.0:1746143752.459738:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9879 00000100:00100000:0.0:1746143752.460290:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3773:x1830963626429568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143752.460339:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4606400 -> 4606400 00002000:00010000:0.0:1746143752.460341:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143752 -> 1746143752 00002000:00010000:0.0:1746143752.460343:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143752 -> 1746143752 00002000:00010000:0.0:1746143752.460345:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143752 -> 1746143752 00002000:00010000:0.0:1746143752.460346:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:0.0:1746143752.460366:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963626429568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 623us (2202us total) trans 21474839978 rc 0/0 00000100:00100000:0.0:1746143752.460371:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9879 00000100:00100000:0.0:1746143752.460382:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9886 00000100:00100000:0.0:1746143752.460386:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3772:x1830963626428928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.460437:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3772:x1830963626428928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (205us total) trans 17179872679 rc 0/0 00000100:00100000:0.0:1746143752.460442:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9886 00000100:00100000:0.0:1746143752.460457:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.460472:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626430208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.460487:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.460499:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626430208 00000100:00100000:0.0:1746143752.460506:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626430208 00000100:00100000:0.0:1746143752.460518:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9890 00000100:00100000:0.0:1746143752.460521:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963626430208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.460566:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963626430208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (78us total) trans 21474839981 rc 0/0 00000100:00100000:0.0:1746143752.460571:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9890 00000004:00080000:0.0:1746143752.460588:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1dbb80/2, rc 0, transno 21474839980 00000100:00100000:0.0:1746143752.460595:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626429696:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143752.460601:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5aa00/2, rc 0, transno 21474839981 00000100:00100000:0.0:1746143752.460604:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626430208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.460674:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963626429056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1101us (2604us total) trans 17179872673 rc 0/0 00000100:00100000:0.0:1746143752.460679:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9876 00000100:00100000:0.0:1746143752.460685:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626430336 00000100:00100000:0.0:1746143752.460687:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626430336 00000100:00100000:0.0:1746143752.460698:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9891 00000100:00100000:0.0:1746143752.460701:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626430336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.460755:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626430336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (77us total) trans 21474839984 rc 0/0 00000100:00100000:0.0:1746143752.460760:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9891 00000100:00100000:0.0:1746143752.463130:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.464584:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.475092:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.479416:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.479473:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.485813:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.485862:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.485885:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621678848 00000100:00100000:0.0:1746143752.485891:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621678848 00010000:00010000:0.0:1746143752.485990:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a3cab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e3d expref: 9 pid: 13436 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746143752.486737:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4434 00000100:00100000:0.0:1746143752.486744:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963621678848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143752.486755:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143752.486770:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a3cab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e3d expref: 9 pid: 13436 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746143752.486780:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a3cab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e3d expref: 9 pid: 13436 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746143752.486804:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a3cab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407e3d expref: 9 pid: 13436 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746143752.486825:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143752.486860:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963621678848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 117us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.486866:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4434 00000100:00100000:0.0:1746143752.495146:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.500479:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.506329:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.506361:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.506419:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.513133:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621679744 00000100:00100000:0.0:1746143752.513143:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621679744 00000100:00100000:0.0:1746143752.513209:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9894 00000100:00100000:0.0:1746143752.513218:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:31072:x1830963621679744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143752.513240:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.513259:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73a3d4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407ead expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.513286:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.513289:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.513297:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73a3d4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ead expref: 26 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.513312:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73a3d4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ead expref: 26 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.513323:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1800, rc 0) 00000100:00100000:0.0:1746143752.513370:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:31072:x1830963621679744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 153us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.513376:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9894 00000100:00100000:0.0:1746143752.517218:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.522956:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.523032:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.528219:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.528244:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621680640 00000100:00100000:0.0:1746143752.528251:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621680640 00000100:00100000:0.0:1746143752.528294:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9896 00000100:00100000:0.0:1746143752.528303:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:31075:x1830963621680640:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143752.528333:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.528352:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73a3d5a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407ebb expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.528379:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.528381:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.528389:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73a3d5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ebb expref: 16 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.528405:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73a3d5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ebb expref: 16 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.528415:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1e00, rc 0) 00000100:00100000:0.0:1746143752.528433:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:31075:x1830963621680640:12345-192.168.202.3@tcp:101:cat.0 Request processed in 131us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.528439:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9896 00000100:00100000:0.0:1746143752.528496:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.532872:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.533608:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621681280 00000100:00100000:0.0:1746143752.533612:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621681280 00002000:00100000:0.0:1746143752.533641:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092ef2a00 x1830963621681280/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:148/0 lens 488/0 e 0 to 0 dl 1746143763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.533650:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2a00 with x1830963621681280 ext(3145728->4194303) 00002000:00010000:0.0:1746143752.533655:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef2a00 00000100:00100000:0.0:1746143752.533668:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2391 00000100:00100000:0.0:1746143752.533674:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963621681280:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143752.538901:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143752.544613:0:12328:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime: 1746143751 -> 1746143752 00000100:00100000:0.0:1746143752.544650:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626431616:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143752.544687:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e512a00/0x87925e4cb73a3d61 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ec2 expref: 26 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.544702:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e512a00/0x87925e4cb73a3d61 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ec2 expref: 26 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.544715:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512a00, rc 0) 00000100:00100000:0.0:1746143752.544780:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963621681152:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11773us (11920us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143752.544787:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9897 00000100:00100000:0.0:1746143752.545211:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.545708:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.546273:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.551877:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.552448:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.553638:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621682816 00000100:00100000:0.0:1746143752.553642:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621682816 00002000:00100000:0.0:1746143752.553675:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4607999) req@ffff88009391d500 x1830963621682816/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:148/0 lens 488/0 e 0 to 0 dl 1746143763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.553685:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d500 with x1830963621682816 ext(4194304->4607999) 00002000:00010000:0.0:1746143752.553690:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391d500 00000100:00100000:0.0:1746143752.553704:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621683072 00000100:00100000:0.0:1746143752.553707:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621683072 00002000:00100000:0.0:1746143752.553728:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2715648->2719743) req@ffff880093071f80 x1830963621683072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:148/0 lens 488/0 e 0 to 0 dl 1746143763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.553734:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071f80 with x1830963621683072 ext(2715648->2719743) 00010000:00010000:0.0:1746143752.553740:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73a3d6f lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ed0 expref: 32 pid: 9587 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746143752.553750:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73a3d6f lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ed0 expref: 32 pid: 9587 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746143752.553754:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093071f80 00000100:00100000:0.0:1746143752.553774:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1130 00000100:00100000:0.0:1746143752.553780:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963621683072:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143752.554019:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963621683072:12345-192.168.202.3@tcp:3:cat.0 Request processed in 237us (421us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143752.554025:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1130 00002000:00100000:0.0:1746143752.554031:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2715648->2719743) req@ffff880093071f80 x1830963621683072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:148/0 lens 488/4536 e 0 to 0 dl 1746143763 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.554037:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071f80 with x1830963621683072 ext(2715648->2719743) 00010000:00010000:0.0:1746143752.554042:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73a3d6f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ed0 expref: 32 pid: 9587 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746143752.554050:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73a3d6f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ed0 expref: 32 pid: 9587 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746143752.554056:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093071f80 00000100:00100000:0.0:1746143752.558999:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.560547:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.560628:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.576875:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.578408:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.578505:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.578531:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.590609:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.602355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.607871:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.615666:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.621659:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.627536:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.676625:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.688209:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.699115:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.718990:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.721041:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621687168 00000100:00100000:0.0:1746143752.721046:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621687168 00010000:00010000:0.0:1746143752.721071:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a3d45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ea6 expref: 17 pid: 9587 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746143752.721107:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4444 00000100:00100000:0.0:1746143752.721113:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963621687168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143752.721124:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143752.721143:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a3d45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ea6 expref: 17 pid: 9587 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746143752.721180:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a3d45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ea6 expref: 17 pid: 9587 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746143752.721197:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a3d45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ea6 expref: 17 pid: 9587 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746143752.721221:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.721223:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.721230:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7cc00/0x87925e4cb73a3e02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1384447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f2b expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.721237:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7cc00/0x87925e4cb73a3e02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1384447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f2b expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.721266:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7cc00/0x87925e4cb73a3e02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f2b expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143752.721277:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c3a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626433024:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143752.721352:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143752.722705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.724432:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.728601:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.737163:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.744437:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.744869:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.744948:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.767069:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.775303:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.778600:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.782667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.782719:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.783507:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9913 00000100:00100000:0.0:1746143752.783514:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963621690112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143752.783583:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.783593:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123263600/0x87925e4cb73a3e79 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407f5c expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.783612:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123263600/0x87925e4cb73a3e79 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f5c expref: 19 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.783622:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123263600/0x87925e4cb73a3e79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f5c expref: 19 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.783633:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123263600, rc 0) 00000100:00100000:0.0:1746143752.783656:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963621690112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 144us (938us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143752.783662:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9913 00000100:00100000:0.0:1746143752.783703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.788339:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.788381:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.788549:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1133 00000100:00100000:0.0:1746143752.788557:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963621690368:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143752.796430:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.796475:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.796505:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.796521:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.796560:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.825137:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.825205:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.831223:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.838210:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.840799:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.842606:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963621692416:12345-192.168.202.3@tcp:4:cat.0 Request processed in 3598us (4404us total) trans 21474839988 rc 0/0 00000100:00100000:0.0:1746143752.842616:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1136 00002000:00100000:0.0:1746143752.842623:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1204224->1384447) req@ffff8800938de300 x1830963621692416/t21474839988(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:148/0 lens 488/448 e 0 to 0 dl 1746143763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.842632:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de300 with x1830963621692416 ext(1204224->1384447) 00010000:00010000:0.0:1746143752.842640:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7cc00/0x87925e4cb73a3e02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f2b expref: 30 pid: 1947 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143752.842653:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7cc00/0x87925e4cb73a3e02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f2b expref: 30 pid: 1947 timeout: 912 lvb_type: 0 00002000:00010000:0.0:1746143752.842660:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938de300 00000100:00100000:0.0:1746143752.843815:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.852696:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.852740:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.852786:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.852812:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621693056 00000100:00100000:0.0:1746143752.852821:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621693056 00000100:00100000:0.0:1746143752.852876:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621693184 00000100:00100000:0.0:1746143752.852879:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621693184 00000100:00100000:0.0:1746143752.852901:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9917 00000100:00100000:0.0:1746143752.852910:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31086:x1830963621693056:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143752.852959:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.852976:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092458e00/0x87925e4cb73a3e95 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248407f78 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.853002:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a3d76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ed7 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.853010:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a3da0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f01 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.853017:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.853019:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.853023:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092458e00/0x87925e4cb73a3e95 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->2801663] (req 2097152->2801663) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f78 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.853045:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a3da0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f01 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.853055:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a3da0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f01 expref: 33 pid: 13430 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746143752.853064:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626434176:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143752.853476:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a3d76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ed7 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.853484:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a3d76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ed7 expref: 13 pid: 9587 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746143752.853493:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626434432:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143752.853512:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143752.853558:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.864406:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.865696:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.865719:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.865777:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.874259:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.877881:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963621694080:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 13350us (13474us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143752.877890:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2408 00002000:00100000:0.0:1746143752.877899:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff8800938df100 x1830963621694080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:148/0 lens 488/440 e 0 to 0 dl 1746143763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.877907:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938df100 with x1830963621694080 ext(1048576->2097151) 00002000:00010000:0.0:1746143752.877929:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938df100 00000100:00100000:0.0:1746143752.885285:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.885447:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.885835:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.885864:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.894337:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.894377:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621695488 00000100:00100000:0.0:1746143752.894384:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621695488 00002000:00100000:0.0:1746143752.894428:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (3047424->3145727) req@ffff880092b73480 x1830963621695488/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:148/0 lens 488/0 e 0 to 0 dl 1746143763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.894438:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73480 with x1830963621695488 ext(3047424->3145727) 00010000:00010000:0.0:1746143752.894445:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e522a00/0x87925e4cb73a3e87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3047424->3145727] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f6a expref: 21 pid: 9587 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143752.894458:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e522a00/0x87925e4cb73a3e87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3047424->3145727] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407f6a expref: 21 pid: 9587 timeout: 912 lvb_type: 0 00002000:00010000:0.0:1746143752.894464:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b73480 00000100:00100000:0.0:1746143752.894488:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1137 00000100:00100000:0.0:1746143752.894494:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963621695488:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143752.906121:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.909626:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626435072:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143752.909653:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143752.909711:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2010:x1830963621695872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3434us (3598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.909722:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4451 00000100:00100000:0.0:1746143752.913754:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.914103:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.914187:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.914203:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621696256 00000100:00100000:0.0:1746143752.914206:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621696256 00002000:00100000:0.0:1746143752.914241:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880092b70700 x1830963621696256/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:148/0 lens 488/0 e 0 to 0 dl 1746143763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.914267:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70700 with x1830963621696256 ext(2097152->3145727) 00002000:00010000:0.0:1746143752.914272:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b70700 00000100:00100000:0.0:1746143752.914302:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621696512 00000100:00100000:0.0:1746143752.914305:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621696512 00002000:00100000:0.0:1746143752.914320:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2801664->4194303) req@ffff880092b71500 x1830963621696512/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:148/0 lens 488/0 e 0 to 0 dl 1746143763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.914326:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71500 with x1830963621696512 ext(2801664->4194303) 00002000:00010000:0.0:1746143752.914330:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b71500 00000100:00100000:0.0:1746143752.914350:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2410 00000100:00100000:0.0:1746143752.914358:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963621696256:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143752.917034:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626435200:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143752.917044:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626435328:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143752.917050:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626435456:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143752.917075:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800973b9200/0x87925e4cb73a3ef7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4042752->4194303] (req 4042752->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248407fbe expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143752.917089:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9200, rc 0) 00000100:00100000:0.0:1746143752.917118:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:31097:x1830963621696000:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2135us (3374us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.917125:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9926 00000100:00100000:0.0:1746143752.919850:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.919905:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.919948:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621696640 00000100:00100000:0.0:1746143752.919963:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621696640 00010000:00010000:0.0:1746143752.919998:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73a3d4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ead expref: 30 pid: 9587 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746143752.920039:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621696768 00000100:00100000:0.0:1746143752.920042:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621696768 00010000:00010000:0.0:1746143752.920054:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73a3d5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ebb expref: 23 pid: 9587 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746143752.920079:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4452 00000100:00100000:0.0:1746143752.920087:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963621696640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143752.920103:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143752.920122:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73a3d4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ead expref: 30 pid: 9587 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143752.920132:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73a3d4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ead expref: 30 pid: 9587 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143752.920169:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73a3d4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ead expref: 30 pid: 9587 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143752.920189:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143752.920229:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963621696640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 142us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.920235:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4452 00000100:00100000:0.0:1746143752.920252:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4453 00000100:00100000:0.0:1746143752.920256:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963621696768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143752.920268:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143752.920275:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73a3d5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ebb expref: 23 pid: 9587 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143752.920283:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73a3d5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ebb expref: 23 pid: 9587 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143752.920294:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73a3d5a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407ebb expref: 23 pid: 9587 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143752.920303:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143752.920316:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963621696768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.920322:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4453 00000100:00100000:0.0:1746143752.925256:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963621696256:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10887us (11140us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143752.925269:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2410 00002000:00100000:0.0:1746143752.925282:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880092b70700 x1830963621696256/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:148/0 lens 488/440 e 0 to 0 dl 1746143763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.925292:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70700 with x1830963621696256 ext(2097152->3145727) 00010000:00010000:0.0:1746143752.925302:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0400/0x87925e4cb73a3ef0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407fb7 expref: 20 pid: 9587 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143752.925319:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800969c0400/0x87925e4cb73a3ef0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407fb7 expref: 20 pid: 9587 timeout: 912 lvb_type: 0 00002000:00010000:0.0:1746143752.925340:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b70700 00000100:00100000:0.0:1746143752.936746:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.936804:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.939159:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.942026:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.943316:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.947588:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.949510:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.958306:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.958346:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.965750:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621698560 00000100:00100000:0.0:1746143752.965759:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621698560 00002000:00100000:0.0:1746143752.965800:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3432448->3436543) req@ffff8801373b8000 x1830963621698560/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:148/0 lens 488/0 e 0 to 0 dl 1746143763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.965808:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8000 with x1830963621698560 ext(3432448->3436543) 00002000:00010000:0.0:1746143752.965811:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b8000 00000100:00100000:0.0:1746143752.965838:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2413 00000100:00100000:0.0:1746143752.965846:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963621698560:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143752.966170:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963621698560:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 324us (592us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143752.966178:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2413 00002000:00100000:0.0:1746143752.966218:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3432448->3436543) req@ffff8801373b8000 x1830963621698560/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:148/0 lens 488/4536 e 0 to 0 dl 1746143763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143752.966225:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8000 with x1830963621698560 ext(3432448->3436543) 00002000:00010000:0.0:1746143752.966238:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b8000 00000100:00100000:0.0:1746143752.970039:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.970174:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.977363:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.990415:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143752.996021:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.020342:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.039866:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.118181:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.132206:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.155244:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.156992:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143753.162320:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143753.162330:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143753.169797:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.211050:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.211843:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.247430:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.247490:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.247571:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.257440:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.257468:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621702528 00000100:00100000:0.0:1746143753.257474:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621702528 00002000:00100000:0.0:1746143753.257513:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1355776->1359871) req@ffff880092b39500 x1830963621702528/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.257523:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b39500 with x1830963621702528 ext(1355776->1359871) 00002000:00010000:0.0:1746143753.257528:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b39500 00000100:00100000:0.0:1746143753.257564:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2419 00000100:00100000:0.0:1746143753.257579:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963621702528:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143753.257700:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963621702528:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 121us (261us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143753.257706:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2419 00002000:00100000:0.0:1746143753.257711:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1355776->1359871) req@ffff880092b39500 x1830963621702528/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:149/0 lens 488/4536 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.257717:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b39500 with x1830963621702528 ext(1355776->1359871) 00002000:00010000:0.0:1746143753.257720:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b39500 00000100:00100000:0.0:1746143753.266022:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.268721:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.271046:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.273642:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.275651:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621703552 00000100:00100000:0.0:1746143753.275655:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621703552 00002000:00100000:0.0:1746143753.275683:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4607999) req@ffff8801373b9c00 x1830963621703552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.275692:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9c00 with x1830963621703552 ext(4194304->4607999) 00002000:00010000:0.0:1746143753.275696:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373b9c00 00000100:00100000:0.0:1746143753.275721:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2421 00000100:00100000:0.0:1746143753.275727:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963621703552:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143753.280973:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.281011:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.281029:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.281073:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.289014:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.291651:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.292989:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.303089:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.305585:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.312373:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.312415:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.312452:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.313388:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621705728 00000100:00100000:0.0:1746143753.313392:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621705728 00010000:00010000:0.0:1746143753.313405:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73a3c57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407dfe expref: 15 pid: 12327 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746143753.313427:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4466 00000100:00100000:0.0:1746143753.313432:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963621705728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.313438:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.313446:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73a3c57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407dfe expref: 15 pid: 12327 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143753.313454:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73a3c57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407dfe expref: 15 pid: 12327 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143753.313465:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73a3c57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407dfe expref: 15 pid: 12327 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143753.313508:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.313510:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.313515:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a3fd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2064383) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840802e expref: 14 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.313534:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a3fd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2064383) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840802e expref: 14 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.313552:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a3fd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2064383) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840802e expref: 14 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.313562:0:7229:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a3fd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2064383) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840802e expref: 14 pid: 13430 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746143753.313572:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a50e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626438400:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143753.314194:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.314237:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.324051:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.331044:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.331185:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.349431:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.356850:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.368749:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626438656 00000100:00100000:0.0:1746143753.368758:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626438656 00000100:00100000:0.0:1746143753.369088:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1746143753.369096:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626438656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746143753.369125:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 937254080 pending 3309568 free 3913179136 avail 3681656832 00000100:00100000:0.0:1746143753.369193:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626438656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.369199:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1746143753.376672:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.380571:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.390292:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.392766:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.392813:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.416887:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.416986:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.439252:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.456014:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.459050:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.506774:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.512205:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.537673:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.550538:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.557806:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621710464 00000100:00100000:0.0:1746143753.557815:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621710464 00000100:00100000:0.0:1746143753.560230:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.562709:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.563767:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.571566:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.572311:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621711232 00000100:00100000:0.0:1746143753.572315:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621711232 00000100:00100000:0.0:1746143753.572349:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9946 00000100:00100000:0.0:1746143753.572354:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:31124:x1830963621711232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143753.572370:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.572383:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a406a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840807b expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.572649:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73a3f91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408004 expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.572667:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143753.572669:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143753.572672:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a406a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840807b expref: 31 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.572699:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73a3f91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408004 expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.572710:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73a3f91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408004 expref: 19 pid: 1945 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746143753.572721:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626439808:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143753.572793:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.575110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.599613:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.599694:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.599726:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.599738:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.599760:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621712640 00000100:00100000:0.0:1746143753.599768:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621712640 00010000:00010000:0.0:1746143753.600069:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a3f7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248407fef expref: 33 pid: 1945 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746143753.600188:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4473 00000100:00100000:0.0:1746143753.600196:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963621712384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.600220:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.600262:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73a3f91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408004 expref: 25 pid: 1945 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143753.600273:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73a3f91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408004 expref: 25 pid: 1945 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143753.600297:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73a3f91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408004 expref: 25 pid: 1945 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746143753.600316:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.600318:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.600325:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a406a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840807b expref: 33 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.600339:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a406a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840807b expref: 33 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.600370:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a406a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840807b expref: 33 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.600382:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626440576:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143753.600431:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.602834:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.609903:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.613262:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.618113:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.618163:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.618264:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.619571:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.619591:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621714432 00000100:00100000:0.0:1746143753.619594:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621714432 00002000:00100000:0.0:1746143753.619613:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1654783) req@ffff880095c69500 x1830963621714432/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.619621:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69500 with x1830963621714432 ext(1048576->1654783) 00002000:00010000:0.0:1746143753.619624:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c69500 00000100:00100000:0.0:1746143753.619634:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2433 00000100:00100000:0.0:1746143753.619638:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963621714432:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143753.653526:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.653581:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.660011:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.663826:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143753.673288:0:12327:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime: 1746143753 -> 1746143754 00002000:00010000:0.0:1746143753.673295:0:12327:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143753 -> 1746143754 00002000:00010000:0.0:1746143753.673297:0:12327:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime: 1746143753 -> 1746143754 00000100:00100000:0.0:1746143753.673314:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626441344:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143753.673340:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a40b0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484080b3 expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.673352:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a40b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484080b3 expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.673367:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084200, rc 0) 00000100:00100000:0.0:1746143753.673835:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963621715712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3358us (3678us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143753.673858:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9953 00000100:00100000:0.0:1746143753.679048:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.681418:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.688162:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.704378:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.713355:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.726348:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.726384:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.751351:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.753174:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.766046:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.776172:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.776267:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.778405:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2439 00000100:00100000:0.0:1746143753.778417:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963621718144:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143753.796898:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.802307:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.806958:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.815791:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.815842:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.819608:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621719040 00000100:00100000:0.0:1746143753.819612:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621719040 00000100:00100000:0.0:1746143753.819656:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12434 00000100:00100000:0.0:1746143753.819662:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31133:x1830963621719040:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143753.819683:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.819699:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a40f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484080eb expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.819765:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.819777:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.819786:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.819798:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a4104 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.819803:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a4104 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.819808:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a4104 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.819875:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a410b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.819883:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a40da lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484080d6 expref: 23 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.819888:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a410b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.819909:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a40da lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484080d6 expref: 23 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.819945:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a40da lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484080d6 expref: 23 pid: 14991 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746143753.819966:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626443136:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143753.820017:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.821308:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621719936 00000100:00100000:0.0:1746143753.821312:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621719936 00000100:00100000:0.0:1746143753.823052:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621719808 00000100:00100000:0.0:1746143753.823056:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621719808 00000100:00100000:0.0:1746143753.823087:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9961 00000100:00100000:0.0:1746143753.823093:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963621719936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143753.823106:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.823115:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a4119 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408100 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.823128:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.823129:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.823134:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a4119 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408100 expref: 33 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.823155:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a4119 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408100 expref: 33 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.823163:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086e00, rc 0) 00000100:00100000:0.0:1746143753.823187:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963621719936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 94us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.823192:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9961 00000100:00100000:0.0:1746143753.823206:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9962 00000100:00100000:0.0:1746143753.823210:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963621719808:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143753.823226:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.823235:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a4120 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484080f9 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.823244:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.823245:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.823249:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a4120 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484080f9 expref: 40 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.823260:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a4120 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484080f9 expref: 40 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.823266:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086200, rc 0) 00000100:00100000:0.0:1746143753.823278:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963621719808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 68us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.823283:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9962 00000100:00100000:0.0:1746143753.823311:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626443136:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143753.823329:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a410b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.823862:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a410b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.823869:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a410b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143753.823941:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143753.823945:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143753.823963:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a410b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.823979:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a410b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.823989:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.823995:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.824001:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.824006:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.824012:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84fa00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143753.824015:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.824021:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.824028:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143753.824030:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143753.824034:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.824038:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a40fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.826086:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a4104 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.826100:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a4104 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.826115:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a4104 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.826121:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84e000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143753.826124:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a4104 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.826130:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a4104 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.826168:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008219ec00) 00010000:00010000:0.0:1746143753.826170:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143753.826295:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a4104 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.826301:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73a4104 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143753.826349:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a40f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484080eb expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.826362:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a410b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484080eb expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.826369:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143753.826371:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143753.826373:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ee00, rc 0) 00000100:00100000:0.0:1746143753.827897:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621720320 00000100:00100000:0.0:1746143753.827905:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621720320 00002000:00100000:0.0:1746143753.827958:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092b3b480 x1830963621720320/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.828177:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3b480 with x1830963621720320 ext(1048576->2097151) 00002000:00010000:0.0:1746143753.828180:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b3b480 00000100:00100000:0.0:1746143753.828193:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2441 00000100:00100000:0.0:1746143753.828199:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963621720320:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143753.835147:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.835317:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.838315:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.838576:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.838626:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.838641:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.838656:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621721472 00000100:00100000:0.0:1746143753.838659:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621721472 00000100:00100000:0.0:1746143753.838675:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621721600 00000100:00100000:0.0:1746143753.838677:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621721600 00000100:00100000:0.0:1746143753.838687:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621721728 00000100:00100000:0.0:1746143753.838688:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621721728 00000100:00100000:0.0:1746143753.838945:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9965 00000100:00100000:0.0:1746143753.838952:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963621721472:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143753.838959:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.839074:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73a4143 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408115 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.839085:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.839086:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.839091:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73a4143 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408115 expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.839114:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73a4143 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408115 expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.839121:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee76600, rc 0) 00000100:00100000:0.0:1746143753.839135:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963621721472:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 184us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.841169:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9965 00000100:00100000:0.0:1746143753.842273:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.842560:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.845325:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.848437:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.850028:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626443648:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143753.850043:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626443776:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143753.850069:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73a4182 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143753.855723:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.857090:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.859961:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.859998:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.862115:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.896801:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.939180:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.949077:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.959133:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.964682:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.972431:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.972468:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.972503:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.980588:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143753.984554:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.003849:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.009111:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.012368:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.018271:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.027604:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.038675:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.051860:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.051898:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.052022:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.085793:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621728512 00000100:00100000:0.0:1746143754.085802:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621728512 00000100:00100000:0.0:1746143754.085865:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12439 00000100:00100000:0.0:1746143754.085872:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:31146:x1830963621728512:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143754.085894:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.085929:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a41f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408185 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.085986:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.085997:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086006:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086022:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a4200 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086027:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a4200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086032:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a4200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086095:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a4207 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086101:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a4207 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086106:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a4207 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143754.086112:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143754.086174:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086179:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086184:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086189:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086194:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7cc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143754.086198:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086207:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086216:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143754.086219:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143754.086222:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086226:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a41f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086250:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a4200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086255:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a4200 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086259:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a4200 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086263:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7d200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143754.086265:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a4200 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086269:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a4200 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086274:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e015500) 00010000:00010000:0.0:1746143754.086276:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143754.086278:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a4200 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086281:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a4200 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.086733:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a41f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408185 expref: 27 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.086743:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a4207 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408185 expref: 26 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.086749:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143754.086751:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143754.086753:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d400, rc 0) 00000100:00100000:0.0:1746143754.087471:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:31146:x1830963621728512:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 928us (1295us total) trans 8589943053 rc 0/0 00000100:00100000:0.0:1746143754.087481:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12439 00000100:00100000:0.0:1746143754.091554:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.099066:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.099622:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.099659:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.100036:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626445440:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143754.100064:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e28e00/0x87925e4cb73a4215 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [4083712->4161535] (req 4083712->4161535) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840818c expref: 18 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.100083:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28e00, rc 0) 00000100:00100000:0.0:1746143754.100128:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:31146:x1830963621728640:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8428us (8585us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.100146:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9977 00000100:00100000:0.0:1746143754.100168:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621729024 00000100:00100000:0.0:1746143754.100171:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621729024 00002000:00010000:0.0:1746143754.102390:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143753 -> 1746143754 00000100:00100000:0.0:1746143754.102412:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626445568:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143754.102437:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec91400/0x87925e4cb73a4223 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840819a expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.102447:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec91400/0x87925e4cb73a4223 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840819a expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.102472:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec91400, rc 0) 00000100:00100000:0.0:1746143754.102505:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2010:x1830963621728896:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2104us (2883us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143754.102511:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9979 00000100:00100000:0.0:1746143754.106225:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.106833:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.114615:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.128355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.132662:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.138776:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.143086:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.149652:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.149749:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.162432:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.169147:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.169197:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.182453:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.182909:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.183034:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.195501:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.195561:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.196934:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.196951:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621732480 00000100:00100000:0.0:1746143754.196954:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621732480 00000100:00100000:0.0:1746143754.196990:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9984 00000100:00100000:0.0:1746143754.196996:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621732480:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143754.197004:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.197021:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73a425b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484081cb expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.197042:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.197044:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.197052:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73a425b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484081cb expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.197069:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73a425b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484081cb expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.197079:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ca00, rc 0) 00000100:00100000:0.0:1746143754.197121:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963621732480:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 125us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.197126:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9984 00000100:00100000:0.0:1746143754.197165:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.205396:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.217326:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.217367:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.217409:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.217441:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621733120 00000100:00100000:0.0:1746143754.217444:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621733120 00010000:00010000:0.0:1746143754.217472:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a4207 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408185 expref: 27 pid: 14991 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746143754.217498:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4499 00000100:00100000:0.0:1746143754.217505:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2010:x1830963621733120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.217519:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.217524:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a4207 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408185 expref: 27 pid: 14991 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746143754.217534:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a4207 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408185 expref: 27 pid: 14991 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746143754.217572:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143754.217577:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a4277 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.217584:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a4277 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.217589:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.217629:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2010:x1830963621733120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 125us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.217634:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4499 00000100:00100000:0.0:1746143754.217669:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.217682:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621733248 00000100:00100000:0.0:1746143754.217685:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621733248 00010000:00010000:0.0:1746143754.217696:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a41d6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408170 expref: 283 pid: 14991 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746143754.217722:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4501 00000100:00100000:0.0:1746143754.217727:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+283:2010:x1830963621733248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.217733:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.217736:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a41d6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408170 expref: 283 pid: 14991 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746143754.217744:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a41d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408170 expref: 283 pid: 14991 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746143754.217754:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143754.217757:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a4277 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.217764:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a4277 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.217770:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a4277 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.217790:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.217804:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+283:2010:x1830963621733248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 77us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.217810:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4501 00000100:00100000:0.0:1746143754.218528:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.221430:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.228162:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.234032:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626446848:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143754.234070:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a42b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.241970:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a42b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.241985:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a42b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143754.242044:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143754.242049:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143754.242068:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a42b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.242107:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a4293 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484081ee expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.242149:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a42b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484081ee expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.242158:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143754.242161:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143754.242166:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6200, rc 0) 00000100:00100000:0.0:1746143754.242205:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31150:x1830963621733760:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 20847us (20934us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.242218:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12442 00000100:00100000:0.0:1746143754.275883:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.284683:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.287625:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.287866:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.298820:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e7aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626447360:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143754.298842:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.298885:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963621736064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7587us (11019us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.298896:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4504 00000100:00100000:0.0:1746143754.307878:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.307962:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.314439:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.317159:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.372483:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.431633:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.436995:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.437040:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.437976:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.437991:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621738240 00000100:00100000:0.0:1746143754.437994:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621738240 00010000:00010000:0.0:1746143754.438009:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a4119 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408100 expref: 35 pid: 1947 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746143754.438036:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4508 00000100:00100000:0.0:1746143754.438042:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963621738240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.438049:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.438057:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a4119 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408100 expref: 35 pid: 1947 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746143754.438066:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a4119 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408100 expref: 35 pid: 1947 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746143754.438092:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a4119 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408100 expref: 35 pid: 1947 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746143754.438105:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.438107:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.438113:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092459600/0x87925e4cb73a4311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840821f expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.438120:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092459600/0x87925e4cb73a4311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840821f expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.438160:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092459600/0x87925e4cb73a4311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840821f expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.438172:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626448128:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143754.438221:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009afa9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.439948:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.446755:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.450682:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.454173:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.456836:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.466208:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.474686:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.503523:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.510681:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.510986:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.514091:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621740160 00000100:00100000:0.0:1746143754.514100:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621740160 00000100:00100000:0.0:1746143754.514147:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621740288 00000100:00100000:0.0:1746143754.514149:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621740288 00000100:00100000:0.0:1746143754.514164:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9995 00000100:00100000:0.0:1746143754.514171:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963621740160:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143754.514190:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.514208:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136c00/0x87925e4cb73a4342 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840823b expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.514259:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093726680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626448896:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143754.515397:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009afa9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.524021:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093726680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626448896:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143754.524055:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092136c00/0x87925e4cb73a4342 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840823b expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.524070:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092136c00/0x87925e4cb73a4342 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840823b expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.524085:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136c00, rc 0) 00000100:00100000:0.0:1746143754.524129:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621740160:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 9958us (10183us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143754.524146:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9995 00000100:00100000:0.0:1746143754.531062:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.532781:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.540073:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626449152:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143754.541497:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621741184 00000100:00100000:0.0:1746143754.541502:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621741184 00000100:00100000:0.0:1746143754.541535:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621741312 00000100:00100000:0.0:1746143754.541537:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621741312 00000100:00100000:0.0:1746143754.541551:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9997 00000100:00100000:0.0:1746143754.541556:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963621741184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143754.541573:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.541588:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a4381 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408257 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.541639:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626449536:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143754.541697:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009afa9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.542519:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.542564:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.551495:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.552040:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.554272:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.554308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.554819:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143754.555310:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a43b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.555317:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a43b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143754.555346:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143754.555350:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143754.555366:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a43b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.555403:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73a43ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840826c expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.555421:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a43b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840826c expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.555428:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143754.555430:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143754.555432:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32c00, rc 0) 00000100:00100000:0.0:1746143754.555459:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:31161:x1830963621742080:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3292us (3980us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.555465:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12450 00000100:00100000:0.0:1746143754.558161:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621742976 00000100:00100000:0.0:1746143754.558171:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621742976 00000100:00100000:0.0:1746143754.558224:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9999 00000100:00100000:0.0:1746143754.558232:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963621742976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143754.558249:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.558266:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73a43dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840827a expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.558320:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626450048:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143754.558413:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009afa9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.562005:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.562220:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.562243:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.563444:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.565568:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626450048:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143754.565606:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73a43dc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840827a expref: 20 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.565616:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73a43dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840827a expref: 20 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.565633:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136400, rc 0) 00000100:00100000:0.0:1746143754.565661:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963621742976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7428us (7869us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143754.565666:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9999 00000100:00100000:0.0:1746143754.565688:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10002 00000100:00100000:0.0:1746143754.565698:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963621743488:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143754.565705:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.565712:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a43f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408296 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.565737:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626450688:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143754.566611:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009afa9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.568566:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.570637:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.570656:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.570682:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.571253:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4518 00000100:00100000:0.0:1746143754.571261:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963621744128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.571281:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.571291:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124adf800/0x87925e4cb73a4262 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484081bd expref: 11 pid: 9587 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746143754.571300:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124adf800/0x87925e4cb73a4262 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484081bd expref: 11 pid: 9587 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746143754.571311:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124adf800/0x87925e4cb73a4262 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484081bd expref: 11 pid: 9587 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746143754.571320:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.571335:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963621744128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.571341:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4518 00002000:00010000:0.0:1746143754.576484:0:12328:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143754 -> 1746143755 00000100:00100000:0.0:1746143754.577635:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626450688:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143754.577653:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a43f1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408296 expref: 7 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.577662:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a43f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408296 expref: 7 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.577668:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137a00, rc 0) 00000100:00100000:0.0:1746143754.577685:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2009:x1830963621743488:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 11992us (14245us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143754.577690:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10002 00000100:00100000:0.0:1746143754.583315:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621744512 00000100:00100000:0.0:1746143754.583319:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621744512 00000100:00100000:0.0:1746143754.583347:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12452 00000100:00100000:0.0:1746143754.583353:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:31161:x1830963621744512:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143754.583364:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.583376:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092458400/0x87925e4cb73a440d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484082a4 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.583474:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4414 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.583487:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4414 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.583497:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4414 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.583509:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4414 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.583515:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4414 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.583521:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4414 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.583526:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092458000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143754.583530:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4414 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.583537:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4414 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.583560:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143754.583563:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143754.583566:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4414 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.583571:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4414 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143754.583595:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092458400/0x87925e4cb73a440d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484082a4 expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.583602:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092458400/0x87925e4cb73a440d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484082a4 expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.583608:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092458400, rc 0) 00000100:00100000:0.0:1746143754.583631:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:31161:x1830963621744512:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 277us (429us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143754.583636:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12452 00000100:00100000:0.0:1746143754.587448:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.588569:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.588602:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.589343:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1157 00000100:00100000:0.0:1746143754.589349:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2011:x1830963621745024:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143754.597671:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.602528:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.602569:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.602611:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.622298:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.622505:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.649022:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.655344:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.663505:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963621747072:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7636us (8148us total) trans 21474839999 rc 0/0 00000100:00100000:0.0:1746143754.663523:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1160 00002000:00100000:0.0:1746143754.663538:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->2326527) req@ffff880091bddf80 x1830963621747072/t21474839999(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:150/0 lens 488/448 e 0 to 0 dl 1746143765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.663552:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddf80 with x1830963621747072 ext(2097152->2326527) 00010000:00010000:0.0:1746143754.663563:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a4318 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408226 expref: 30 pid: 3135 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746143754.663581:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a4318 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408226 expref: 30 pid: 3135 timeout: 913 lvb_type: 0 00002000:00010000:0.0:1746143754.663588:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bddf80 00000100:00100000:0.0:1746143754.675026:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.677527:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.677620:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.688115:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963621747456:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10131us (10481us total) trans 17179872689 rc 0/0 00000100:00100000:0.0:1746143754.688128:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1161 00002000:00100000:0.0:1746143754.688152:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1216512->1699839) req@ffff880093724380 x1830963621747456/t17179872689(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:150/0 lens 488/448 e 0 to 0 dl 1746143765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.688162:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724380 with x1830963621747456 ext(1216512->1699839) 00010000:00010000:0.0:1746143754.688178:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7dc00/0x87925e4cb73a42d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484081fc expref: 44 pid: 12328 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746143754.688192:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7dc00/0x87925e4cb73a42d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484081fc expref: 44 pid: 12328 timeout: 913 lvb_type: 0 00002000:00010000:0.0:1746143754.688199:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093724380 00000100:00100000:0.0:1746143754.688675:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621747712 00000100:00100000:0.0:1746143754.688683:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621747712 00002000:00100000:0.0:1746143754.688717:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880095c38e00 x1830963621747712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.688724:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38e00 with x1830963621747712 ext(2097152->4194303) 00002000:00010000:0.0:1746143754.688728:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c38e00 00000100:00100000:0.0:1746143754.705086:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143754.706716:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143754.707979:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.713257:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.726573:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.741435:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.755330:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.766427:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.796210:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.833555:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.838440:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.839764:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.844696:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626452352:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143754.844706:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626452480:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143754.844747:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a4476 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2494464->3145727] (req 2494464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484082ea expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.844764:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467400, rc 0) 00000100:00100000:0.0:1746143754.844867:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:31174:x1830963621750784:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5646us (6434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.844874:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10012 00000100:00100000:0.0:1746143754.846019:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.846058:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.858593:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.874268:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.874295:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.874333:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.875773:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.879116:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.887881:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.890266:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621752832 00000100:00100000:0.0:1746143754.890269:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621752832 00000100:00100000:0.0:1746143754.890291:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10016 00000100:00100000:0.0:1746143754.890296:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963621752832:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143754.890305:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.890315:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ba00/0x87925e4cb73a4499 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408306 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.890342:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626453504:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143754.890369:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009afa99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.891503:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.895528:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.900699:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621753472 00000100:00100000:0.0:1746143754.900709:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621753472 00002000:00100000:0.0:1746143754.900755:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880095c3ad80 x1830963621753472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.900765:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3ad80 with x1830963621753472 ext(0->1048575) 00002000:00010000:0.0:1746143754.900771:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3ad80 00000100:00100000:0.0:1746143754.902030:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.908554:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.915399:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.921560:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.921609:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.929019:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.929086:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.929134:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.929152:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.929164:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.929183:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.935016:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.935627:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.935673:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.942886:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.951442:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.956720:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.957427:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.962528:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.963188:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.963413:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10025 00000100:00100000:0.0:1746143754.963419:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621757696:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143754.963436:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a4525 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.963446:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d428400/0x87925e4cb73a448b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484082f8 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.963452:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143754.963453:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143754.963455:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a4525 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.963468:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d428400/0x87925e4cb73a448b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082f8 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.963474:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d428400/0x87925e4cb73a448b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082f8 expref: 36 pid: 3135 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746143754.963481:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626454784:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143754.964001:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73a44c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408322 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.964010:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73a44c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408322 expref: 10 pid: 12327 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746143754.964018:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e27800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626455680:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143754.964710:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a4422 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082b9 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.964721:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a4422 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082b9 expref: 20 pid: 9586 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746143754.964730:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626455936:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143754.964751:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135518b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.964769:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009afa9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.968782:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.969705:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626454656:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143754.969733:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626454784:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143754.969754:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a4525 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.969776:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.969995:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621758080 00000100:00100000:0.0:1746143754.970000:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621758080 00002000:00100000:0.0:1746143754.970032:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (4120576->4194303) req@ffff880095e32a00 x1830963621758080/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.970041:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32a00 with x1830963621758080 ext(4120576->4194303) 00010000:00010000:0.0:1746143754.970047:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d428400/0x87925e4cb73a448b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082f8 expref: 36 pid: 3135 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143754.970056:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d428400/0x87925e4cb73a448b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082f8 expref: 36 pid: 3135 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746143754.970070:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e32a00 00000100:00100000:0.0:1746143754.970083:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1164 00000100:00100000:0.0:1746143754.970088:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963621758080:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143754.971316:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.972846:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.972869:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621758336 00000100:00100000:0.0:1746143754.972872:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621758336 00010000:00010000:0.0:1746143754.972888:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a445a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082d5 expref: 44 pid: 9586 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746143754.972908:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4537 00000100:00100000:0.0:1746143754.972928:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963621758336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.972935:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.972944:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a445a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082d5 expref: 44 pid: 9586 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.972951:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a445a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082d5 expref: 44 pid: 9586 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.972962:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a445a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082d5 expref: 44 pid: 9586 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.972973:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.973001:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963621758336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 73us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.973019:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4537 00000100:00100000:0.0:1746143754.973196:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.973205:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621758464 00000100:00100000:0.0:1746143754.973208:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621758464 00010000:00010000:0.0:1746143754.973220:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a44d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840831b expref: 11 pid: 1947 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746143754.973232:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4538 00000100:00100000:0.0:1746143754.973236:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963621758464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.973243:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.973253:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a44d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840831b expref: 11 pid: 1947 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.973261:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a44d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840831b expref: 11 pid: 1947 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.973271:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a44d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840831b expref: 11 pid: 1947 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.973279:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.973290:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963621758464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 54us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.973294:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4538 00000100:00100000:0.0:1746143754.973352:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.973360:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621758720 00000100:00100000:0.0:1746143754.973362:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621758720 00010000:00010000:0.0:1746143754.973387:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634600/0x87925e4cb73a3fde lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408035 expref: 21 pid: 9587 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746143754.973399:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4539 00000100:00100000:0.0:1746143754.973403:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963621758720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.973409:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.973416:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f634600/0x87925e4cb73a3fde lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408035 expref: 21 pid: 9587 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143754.973423:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f634600/0x87925e4cb73a3fde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408035 expref: 21 pid: 9587 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143754.973433:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.973444:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963621758720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 41us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.973448:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4539 00000100:00100000:0.0:1746143754.973472:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.973480:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621758848 00000100:00100000:0.0:1746143754.973482:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621758848 00010000:00010000:0.0:1746143754.973491:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73a43ff lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840829d expref: 32 pid: 13430 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746143754.973502:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4540 00000100:00100000:0.0:1746143754.973506:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963621758848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.973511:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.973517:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73a43ff lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840829d expref: 32 pid: 13430 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143754.973532:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73a43ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840829d expref: 32 pid: 13430 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143754.973542:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.973544:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.973548:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368da200/0x87925e4cb73a4517 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.974741:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368da200/0x87925e4cb73a4517 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.974835:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.974855:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963621758848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1347us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.974861:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4540 00000100:00100000:0.0:1746143754.974890:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e27800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626455680:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143754.974898:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626455936:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143754.974932:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a451e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.978177:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621759872 00000100:00100000:0.0:1746143754.978180:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621759872 00010000:00010000:0.0:1746143754.978191:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec91400/0x87925e4cb73a4406 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082ab expref: 41 pid: 9586 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746143754.978207:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4542 00000100:00100000:0.0:1746143754.978222:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621759104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.978230:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.978240:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b26400/0x87925e4cb73a44d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408329 expref: 9 pid: 1947 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.978249:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b26400/0x87925e4cb73a44d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408329 expref: 9 pid: 1947 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.978261:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b26400/0x87925e4cb73a44d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408329 expref: 9 pid: 1947 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.978274:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.978298:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963621759104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.978303:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4542 00000100:00100000:0.0:1746143754.978314:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4543 00000100:00100000:0.0:1746143754.978318:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963621759872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.978323:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.978329:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec91400/0x87925e4cb73a4406 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082ab expref: 43 pid: 9586 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143754.978336:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec91400/0x87925e4cb73a4406 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082ab expref: 44 pid: 9586 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143754.978362:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec91400/0x87925e4cb73a4406 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082ab expref: 44 pid: 9586 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143754.978414:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.978428:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963621759872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.978433:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4543 00000100:00100000:0.0:1746143754.978443:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4544 00000100:00100000:0.0:1746143754.978447:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963621758976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.978453:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.978460:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73a44c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408322 expref: 10 pid: 12327 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.978468:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73a44c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408322 expref: 10 pid: 12327 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.978478:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73a44c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408322 expref: 10 pid: 12327 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143754.978486:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.978500:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621758976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 53us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.978505:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4544 00010000:00010000:0.0:1746143754.979044:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a451e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979051:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a451e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979074:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a451e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979082:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a451e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979088:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a451e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979094:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143754.979098:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a451e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979104:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a451e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979113:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a451e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979119:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a451e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.979165:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963621757440:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 15826us (15977us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.979171:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10024 00010000:00010000:0.0:1746143754.979604:0:12328:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a4533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979616:0:12328:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a4533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979629:0:12328:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a4533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979635:0:12328:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a4533 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979640:0:12328:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a4533 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979645:0:12328:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082084c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143754.979648:0:12328:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a4533 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979654:0:12328:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a4533 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979663:0:12328:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a4533 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.979668:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a4533 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.979701:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963621757568:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 16015us (16055us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.979711:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10027 00000100:00100000:0.0:1746143754.979763:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963621758080:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9674us (9985us total) trans 21474840001 rc 0/0 00000100:00100000:0.0:1746143754.979768:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1164 00002000:00100000:0.0:1746143754.979773:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (4120576->4194303) req@ffff880095e32a00 x1830963621758080/t21474840001(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:150/0 lens 488/448 e 0 to 0 dl 1746143765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.979781:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32a00 with x1830963621758080 ext(4120576->4194303) 00010000:00010000:0.0:1746143754.979786:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d428400/0x87925e4cb73a448b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082f8 expref: 40 pid: 3135 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143754.979793:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d428400/0x87925e4cb73a448b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484082f8 expref: 40 pid: 3135 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746143754.979799:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e32a00 00000100:00100000:0.0:1746143754.983389:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.984985:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143754.985477:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a4525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.985486:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a4525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.985503:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a4525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.985509:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a4525 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.985523:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a4525 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.985528:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8a200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143754.985531:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a4525 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.985538:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a4525 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.985547:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.985548:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.985553:0:13430:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73a4564 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408376 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.985559:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73a4564 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408376 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.985584:0:13430:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73a4564 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408376 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.985595:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626456448:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143754.985669:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009afa9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.986333:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963621760128:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6822us (7248us total) trans 17179872691 rc 0/0 00000100:00100000:0.0:1746143754.986342:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1165 00002000:00100000:0.0:1746143754.986354:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3502079) req@ffff880092b71880 x1830963621760128/t17179872691(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:150/0 lens 488/448 e 0 to 0 dl 1746143765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.986363:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71880 with x1830963621760128 ext(3145728->3502079) 00010000:00010000:0.0:1746143754.986370:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73a44a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840830d expref: 45 pid: 12328 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143754.986383:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73a44a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840830d expref: 45 pid: 12328 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746143754.986389:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b71880 00000100:00100000:0.0:1746143754.992401:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.992493:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143754.995959:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143755.001561:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143755.003049:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621761920 00000100:00100000:0.0:1746143755.003053:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621761920 00010000:00010000:0.0:1746143755.003071:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a43ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408273 expref: 33 pid: 6587 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746143755.003388:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621762688 00000100:00100000:0.0:1746143755.003391:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621762688 00010000:00010000:0.0:1746143755.003402:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a409b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484080a5 expref: 34 pid: 14991 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746143755.003844:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4554 00000100:00100000:0.0:1746143755.003851:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2008:x1830963621761920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143755.003862:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143755.003868:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a43ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408273 expref: 34 pid: 6587 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143755.003886:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a43ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408273 expref: 34 pid: 6587 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143755.003901:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a43ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408273 expref: 34 pid: 6587 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143755.003947:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143755.003952:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143755.003958:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143755.003982:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2008:x1830963621761920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 131us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.003988:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4554 00000100:00100000:0.0:1746143755.004001:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4555 00000100:00100000:0.0:1746143755.004006:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2008:x1830963621762688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143755.004012:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143755.004016:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a409b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484080a5 expref: 32 pid: 14991 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143755.004024:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a409b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484080a5 expref: 32 pid: 14991 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143755.004034:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a409b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484080a5 expref: 32 pid: 14991 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143755.004042:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143755.004049:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143755.004056:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143755.004061:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143755.004081:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143755.004096:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2008:x1830963621762688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 90us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.004102:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4555 00000100:00100000:0.0:1746143755.008026:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.012750:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626457728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143755.015242:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.015278:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626458368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.015300:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.015311:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626458880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.015323:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.015332:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626459392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.015344:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.015430:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10052 00000100:00100000:0.0:1746143755.015437:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963626458368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.015512:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963626458368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (210us total) trans 21474840008 rc 0/0 00000100:00100000:0.0:1746143755.015517:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10052 00000100:00100000:0.0:1746143755.015544:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10053 00000100:00100000:0.0:1746143755.015548:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963626458880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.015598:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963626458880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (274us total) trans 21474840009 rc 0/0 00000100:00100000:0.0:1746143755.015605:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10053 00000100:00100000:0.0:1746143755.015614:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10054 00000100:00100000:0.0:1746143755.015625:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963626459392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.015673:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963626459392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (327us total) trans 21474840010 rc 0/0 00000100:00100000:0.0:1746143755.015678:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10054 00000004:00080000:0.0:1746143755.015702:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e31c00/2, rc 0, transno 17179872699 00000100:00100000:0.0:1746143755.015706:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626457728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143755.015713:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092a51f80/2, rc 0, transno 21474840008 00000100:00100000:0.0:1746143755.015716:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626458368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143755.015721:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373bad80/2, rc 0, transno 21474840009 00000100:00100000:0.0:1746143755.015724:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626458880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143755.015729:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373ba300/2, rc 0, transno 21474840010 00000100:00100000:0.0:1746143755.015731:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626459392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143755.016174:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33100/2, rc 0, transno 17179872692 00000100:00100000:0.0:1746143755.016178:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626457472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143755.019528:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143755.019927:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143755.019937:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143755.019953:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143755.019959:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082085e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143755.019963:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143755.019975:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143755.019990:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143755.019993:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143755.019997:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143755.020002:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a456b lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143755.027602:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.028414:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.037410:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.037446:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.037486:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.044899:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.045840:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.045998:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10055 00000100:00100000:0.0:1746143755.046006:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2009:x1830963621764096:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143755.046023:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.046039:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a45c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484083ae expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.046079:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.046080:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.046089:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a45c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484083ae expref: 7 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.046106:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a45c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484083ae expref: 7 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.046116:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086200, rc 0) 00000100:00100000:0.0:1746143755.046172:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963621764096:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 167us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.046178:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10055 00000100:00100000:0.0:1746143755.050080:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.050119:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.050156:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.050168:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.050198:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.050391:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621764736 00000100:00100000:0.0:1746143755.050394:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621764736 00000100:00100000:0.0:1746143755.050418:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10058 00000100:00100000:0.0:1746143755.050423:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963621764608:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143755.050432:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.050447:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082087800/0x87925e4cb73a45d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484083ca expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.050469:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.050479:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.050483:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087800/0x87925e4cb73a45d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484083ca expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.050496:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082087800/0x87925e4cb73a45d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484083ca expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.050504:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087800, rc 0) 00000100:00100000:0.0:1746143755.050546:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963621764608:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 122us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.050551:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10058 00000100:00100000:0.0:1746143755.050566:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10059 00000100:00100000:0.0:1746143755.050570:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963621764480:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143755.050575:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.050582:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a45e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484083c3 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.050591:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.050592:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.050596:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a45e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484083c3 expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.050604:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a45e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484083c3 expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.050610:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087200, rc 0) 00000100:00100000:0.0:1746143755.051896:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621764480:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 1322us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.051930:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10059 00000100:00100000:0.0:1746143755.056346:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.056901:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.059183:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.060157:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.060172:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.060198:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.061471:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10066 00000100:00100000:0.0:1746143755.061479:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963621765632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143755.061485:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.061493:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a4621 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408402 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.061503:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.061505:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.061510:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a4621 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408402 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.061519:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a4621 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408402 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.061526:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087000, rc 0) 00000100:00100000:0.0:1746143755.061542:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963621765632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 66us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.061548:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10066 00000100:00100000:0.0:1746143755.075479:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.075960:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.079024:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621766656 00000100:00100000:0.0:1746143755.079030:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621766656 00002000:00100000:0.0:1746143755.079063:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880090e5a300 x1830963621766656/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.079072:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5a300 with x1830963621766656 ext(1048576->2097151) 00002000:00010000:0.0:1746143755.079077:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5a300 00000100:00100000:0.0:1746143755.079097:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621766912 00000100:00100000:0.0:1746143755.079099:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621766912 00002000:00100000:0.0:1746143755.079110:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88012b7aa680 x1830963621766912/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.079117:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7aa680 with x1830963621766912 ext(1048576->2097151) 00002000:00010000:0.0:1746143755.079120:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7aa680 00000100:00100000:0.0:1746143755.079141:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2486 00000100:00100000:0.0:1746143755.079147:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963621766656:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143755.084444:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.117829:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.131519:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.131550:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.131572:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.131667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143755.132735:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a4652 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143755.132742:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a4652 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00000040:00080000:0.0:1746143755.133014:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2462, 88 off204352 00000004:00080000:0.0:1746143755.133030:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814357117426ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143755.133058:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2447, 88 off203384 00000004:00080000:0.0:1746143755.133061:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814357148860ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143755.133105:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2448, 88 off203472 00000004:00080000:0.0:1746143755.133108:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814357195475ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143755.133120:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2463, 88 off204440 00000004:00080000:0.0:1746143755.133123:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814357210910ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143755.133142:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2464, 88 off204528 00000004:00080000:0.0:1746143755.133145:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814357232735ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143755.133152:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2449, 88 off203560 00000004:00080000:0.0:1746143755.133155:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814357242735ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143755.133168:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2450, 88 off203648 00000004:00080000:0.0:1746143755.133170:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814357258288ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143755.133182:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2451, 88 off203736 00000004:00080000:0.0:1746143755.133185:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814357272446ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143755.133196:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2465, 88 off204616 00000004:00080000:0.0:1746143755.133199:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814357286742ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143755.133206:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2452, 88 off203824 00000004:00080000:0.0:1746143755.133208:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814357296398ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143755.133220:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2466, 88 off204704 00000004:00080000:0.0:1746143755.133222:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814357310067ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143755.133229:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2453, 88 off203912 00000004:00080000:0.0:1746143755.133231:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814357319322ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143755.133378:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2468, 88 off204888 00000004:00080000:0.0:1746143755.133382:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814357470176ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143755.133393:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2469, 88 off204976 00000004:00080000:0.0:1746143755.133396:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814357483947ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143755.133412:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2470, 88 off205064 00000004:00080000:0.0:1746143755.133414:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814357501900ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143755.133421:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2471, 88 off205152 00000004:00080000:0.0:1746143755.133424:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814357511935ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143755.133432:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2454, 88 off204000 00000004:00080000:0.0:1746143755.133434:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814357522215ns, next at 770855090093ns, rc = 0 00000100:00100000:0.0:1746143755.137453:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143755.138683:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943080 is committed 00000004:00080000:0.0:1746143755.138689:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1686 committed 00000004:00080000:0.0:1746143755.138708:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1700 committed 00000004:00080000:0.0:1746143755.138713:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1699 committed 00000004:00080000:0.0:1746143755.138715:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1698 committed 00000004:00080000:0.0:1746143755.138717:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1697 committed 00000004:00080000:0.0:1746143755.138718:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1685 committed 00000004:00080000:0.0:1746143755.138719:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1696 committed 00000004:00080000:0.0:1746143755.138721:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1684 committed 00000004:00080000:0.0:1746143755.138722:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1695 committed 00000004:00080000:0.0:1746143755.138724:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1683 committed 00000004:00080000:0.0:1746143755.138725:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1682 committed 00000004:00080000:0.0:1746143755.138727:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1681 committed 00000004:00080000:0.0:1746143755.138728:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1694 committed 00000004:00080000:0.0:1746143755.138730:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1693 committed 00000004:00080000:0.0:1746143755.138731:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1680 committed 00000004:00080000:0.0:1746143755.138736:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1679 committed 00000004:00080000:0.0:1746143755.138738:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1692 committed 00000001:00080000:0.0:1746143755.138747:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943077 is committed 00010000:00010000:0.0:1746143755.138782:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a4652 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408410 expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.138790:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143755.138798:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143755.138801:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a4659 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408417 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.138808:0:6587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a4659 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408417 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.138813:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a4659 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408417 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.138831:0:6587:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a4659 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408417 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143755.138842:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626460416:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143755.138856:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626460544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.138901:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626460672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.138960:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.138977:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626461056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.138993:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.139015:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626461568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143755.139029:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.139288:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626462080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143755.139620:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10069 00000100:00100000:0.0:1746143755.139627:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3773:x1830963626460544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143755.139676:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143755.139683:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143754 -> 1746143754 00002000:00010000:0.0:1746143755.139685:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143754 -> 1746143754 00002000:00010000:0.0:1746143755.139687:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143754 -> 1746143754 00002000:00010000:0.0:1746143755.139688:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143755.139708:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3773:x1830963626460544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (747us total) trans 21474840013 rc 0/0 00000100:00100000:0.0:1746143755.139713:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10069 00000100:00100000:0.0:1746143755.139723:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10073 00000100:00100000:0.0:1746143755.139727:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3772:x1830963626461440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143755.139765:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143755.139767:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143753 -> 1746143753 00002000:00010000:0.0:1746143755.139769:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143747 -> 1746143747 00002000:00010000:0.0:1746143755.139770:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143753 -> 1746143753 00002000:00010000:0.0:1746143755.139772:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143755.139788:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3772:x1830963626461440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (730us total) trans 17179872701 rc 0/0 00000100:00100000:0.0:1746143755.139793:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10073 00000100:00100000:0.0:1746143755.139803:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10076 00000100:00100000:0.0:1746143755.139807:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3772:x1830963626462336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143755.139852:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3772:x1830963626462336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (201us total) trans 17179872704 rc 0/0 00000100:00100000:0.0:1746143755.139856:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10076 00000100:00100000:0.0:1746143755.139871:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.139883:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626461184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.139896:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.141158:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626461696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143755.141185:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.141195:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626462208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143755.141208:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.141225:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626462208 00000100:00100000:0.0:1746143755.141228:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626462208 00000100:00100000:0.0:1746143755.141244:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10080 00000100:00100000:0.0:1746143755.141247:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3774:x1830963626461696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143755.141281:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143755.141283:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143755 -> 1746143755 00002000:00010000:0.0:1746143755.141285:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143755 -> 1746143755 00002000:00010000:0.0:1746143755.141286:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143755 -> 1746143755 00002000:00010000:0.0:1746143755.141288:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143755.141301:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3774:x1830963626461696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (116us total) trans 17179872705 rc 0/0 00000100:00100000:0.0:1746143755.141314:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10080 00000004:00080000:0.0:1746143755.141333:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1db800/2, rc 0, transno 17179872705 00000100:00100000:0.0:1746143755.141337:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626461696:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143755.141345:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b46a00/2, rc 0, transno 17179872706 00000100:00100000:0.0:1746143755.141348:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626462208:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143755.141355:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7a9f80/2, rc 0, transno 21474840016 00000100:00100000:0.0:1746143755.141357:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626460672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143755.141371:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143755.141386:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1daa00/2, rc 0, transno 17179872700 00000100:00100000:0.0:1746143755.141388:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626461568:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143755.141404:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b4b100/2, rc 0, transno 21474840014 00000100:00100000:0.0:1746143755.141407:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626461056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143755.141413:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7a8380/2, rc 0, transno 21474840013 00000100:00100000:0.0:1746143755.141415:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626460544:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143755.141431:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b49880/2, rc 0, transno 21474840017 00000100:00100000:0.0:1746143755.141433:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626461184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143755.141468:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b46680/2, rc 0, transno 17179872707 00000100:00100000:0.0:1746143755.141472:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626462080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143755.141516:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a330780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.144861:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.157657:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.161389:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.161414:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.162122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.162797:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.163693:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.167875:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.168117:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.170258:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.180285:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.183647:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.192676:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.194511:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.194540:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.194559:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621770368 00000100:00100000:0.0:1746143755.194566:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621770368 00000100:00100000:0.0:1746143755.194615:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621770496 00000100:00100000:0.0:1746143755.194617:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621770496 00000100:00100000:0.0:1746143755.194627:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621770624 00000100:00100000:0.0:1746143755.194629:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621770624 00000100:00100000:0.0:1746143755.194642:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10086 00000100:00100000:0.0:1746143755.194649:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:31187:x1830963621770368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143755.194662:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.194676:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73a46c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408441 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.194696:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.194697:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.194704:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73a46c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408441 expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.194717:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73a46c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408441 expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.194726:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268600, rc 0) 00000100:00100000:0.0:1746143755.194755:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:31187:x1830963621770368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 106us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.194760:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10086 00000100:00100000:0.0:1746143755.194772:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10088 00000100:00100000:0.0:1746143755.194777:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963621770624:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143755.194784:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.194789:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a46d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840844f expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.194807:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.195290:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a46d0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840844f expref: 47 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.195301:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a46d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840844f expref: 47 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.196116:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123269200, rc 0) 00000100:00100000:0.0:1746143755.196214:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963621770624:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1434us (1670us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143755.196219:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10088 00000100:00100000:0.0:1746143755.205825:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.205985:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.208669:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621771392 00000100:00100000:0.0:1746143755.208674:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621771392 00000100:00100000:0.0:1746143755.208703:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621771520 00000100:00100000:0.0:1746143755.208704:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621771520 00000100:00100000:0.0:1746143755.208716:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10090 00000100:00100000:0.0:1746143755.208721:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963621771392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143755.208732:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.208743:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a46de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840845d expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143755.208769:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626464256:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143755.208794:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a330780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.210430:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621771904 00000100:00100000:0.0:1746143755.210442:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621771904 00002000:00100000:0.0:1746143755.210467:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff8800938dce00 x1830963621771904/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.210476:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dce00 with x1830963621771904 ext(2097152->3145727) 00002000:00010000:0.0:1746143755.210479:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938dce00 00000100:00100000:0.0:1746143755.210505:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2491 00000100:00100000:0.0:1746143755.210511:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963621771904:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143755.221294:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.229813:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.230140:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.243693:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.248575:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.248595:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.248636:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.255405:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.265868:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.282895:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963621774464:12345-192.168.202.3@tcp:4:cat.0 Request processed in 12778us (17025us total) trans 17179872708 rc 0/0 00000100:00100000:0.0:1746143755.282906:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1167 00002000:00100000:0.0:1746143755.282931:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3567616->3956735) req@ffff880092b23100 x1830963621774464/t17179872708(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:151/0 lens 488/448 e 0 to 0 dl 1746143766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.282941:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b23100 with x1830963621774464 ext(3567616->3956735) 00010000:00010000:0.0:1746143755.282950:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73a468a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3567616->18446744073709551615] (req 3567616->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840842c expref: 48 pid: 9839 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143755.282964:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73a468a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3567616->18446744073709551615] (req 3567616->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840842c expref: 48 pid: 9839 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746143755.282980:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b23100 00000100:00100000:0.0:1746143755.296107:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626464768:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143755.296122:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143755.296157:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b41f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+47:2008:x1830963621774592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6753us (6978us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.296165:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4569 00000100:00100000:0.0:1746143755.299598:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621774976 00000100:00100000:0.0:1746143755.299607:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621774976 00002000:00100000:0.0:1746143755.299809:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff88012d843480 x1830963621774976/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.299816:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843480 with x1830963621774976 ext(3145728->4194303) 00002000:00010000:0.0:1746143755.299819:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d843480 00000100:00100000:0.0:1746143755.300022:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2499 00000100:00100000:0.0:1746143755.300031:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963621774976:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143755.312358:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.315663:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.316825:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.323721:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.338194:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.341198:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.341236:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.360604:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.370348:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.371810:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.403677:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.420645:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.420719:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.478539:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.484275:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963621777792:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4243us (5741us total) trans 0 rc 483328/483328 00000100:00100000:0.0:1746143755.484284:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2504 00002000:00100000:0.0:1746143755.484291:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4677631) req@ffff880093ed8a80 x1830963621777792/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:151/0 lens 488/440 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 483328/483328 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.484299:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ed8a80 with x1830963621777792 ext(4194304->4677631) 00002000:00010000:0.0:1746143755.484304:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ed8a80 00000100:00100000:0.0:1746143755.489724:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621778176 00000100:00100000:0.0:1746143755.489732:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621778176 00000100:00100000:0.0:1746143755.489778:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621778304 00000100:00100000:0.0:1746143755.489780:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621778304 00000100:00100000:0.0:1746143755.489800:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10099 00000100:00100000:0.0:1746143755.489806:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:31200:x1830963621778176:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143755.489821:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143755.496278:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4575 00000100:00100000:0.0:1746143755.496284:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2010:x1830963621778688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143755.496291:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143755.496297:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a45c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484083ae expref: 7 pid: 1945 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143755.496304:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a45c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484083ae expref: 7 pid: 1945 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143755.496327:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a45c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484083ae expref: 7 pid: 1945 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746143755.496347:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143755.496364:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2010:x1830963621778688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 81us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.496369:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4575 00000100:00100000:0.0:1746143755.498215:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.503974:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.512329:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.515425:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.515464:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.516639:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.520316:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.522665:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.568182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.574758:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.580084:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.580135:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.589157:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.589188:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.590110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.613664:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.618830:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.622605:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.631878:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.655327:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.693574:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.707766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.719790:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626468736 00000100:00100000:0.0:1746143755.719797:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626468736 00000100:00100000:0.0:1746143755.719830:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1746143755.719837:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3772:x1830963626468736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746143755.719854:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 208896 granted 980152384 pending 9347072 free 3914395648 avail 3682873344 00000100:00100000:0.0:1746143755.719889:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3772:x1830963626468736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.719895:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1746143755.721103:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.728362:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.728401:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.728464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.728789:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10106 00000100:00100000:0.0:1746143755.728795:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963621784960:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143755.728803:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.728811:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73a480b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484084fe expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.728821:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.728823:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.728830:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73a480b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484084fe expref: 40 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.728843:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73a480b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484084fe expref: 40 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.728863:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848e00, rc 0) 00000100:00100000:0.0:1746143755.728882:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963621784960:12345-192.168.202.3@tcp:101:cat.0 Request processed in 87us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.728887:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10106 00000100:00100000:0.0:1746143755.748515:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.748558:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.755147:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143755.755167:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626469248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143755.755229:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143755.756983:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626469248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143755.758080:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.772490:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+39:2008:x1830963621785472:12345-192.168.202.3@tcp:4:cat.0 Request processed in 14033us (14400us total) trans 21474840023 rc 0/0 00000100:00100000:0.0:1746143755.772503:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1171 00002000:00100000:0.0:1746143755.772515:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (417792->1048575) req@ffff88009719c700 x1830963621785472/t21474840023(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:151/0 lens 488/448 e 0 to 0 dl 1746143766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.772524:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c700 with x1830963621785472 ext(417792->1048575) 00010000:00010000:0.0:1746143755.772533:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73a476a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484084aa expref: 39 pid: 9586 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746143755.772549:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73a476a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484084aa expref: 39 pid: 9586 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746143755.772555:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009719c700 00000100:00100000:0.0:1746143755.776495:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.787661:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.790372:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.802951:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.810594:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.810622:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.810642:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.810669:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.814523:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.816007:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.816478:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.820466:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.824756:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.825729:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.830313:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.837111:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.837705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.837781:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.847957:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.861601:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.861690:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.862719:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.862752:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.867426:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.871290:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.872095:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.876369:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.876452:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.881811:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.897472:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.907578:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.916769:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.937793:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.942512:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.946271:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.950384:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963621791488:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7676us (7869us total) trans 17179872710 rc 0/0 00000100:00100000:0.0:1746143755.950395:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1176 00002000:00100000:0.0:1746143755.950405:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3764224->4194303) req@ffff8800939a5c00 x1830963621791488/t17179872710(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:151/0 lens 488/448 e 0 to 0 dl 1746143766 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.950415:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5c00 with x1830963621791488 ext(3764224->4194303) 00010000:00010000:0.0:1746143755.950423:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a484a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3764224->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840851a expref: 26 pid: 9585 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746143755.950436:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a484a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3764224->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840851a expref: 26 pid: 9585 timeout: 915 lvb_type: 0 00002000:00010000:0.0:1746143755.950443:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800939a5c00 00000100:00100000:0.0:1746143755.952495:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.954923:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.954960:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.956755:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.956814:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.958697:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.973435:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.980966:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.986456:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963621792896:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5272us (5489us total) trans 21474840025 rc 0/0 00000100:00100000:0.0:1746143755.986466:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1177 00002000:00100000:0.0:1746143755.986477:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (1015808->1048575) req@ffff880095cb7100 x1830963621792896/t21474840025(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:151/0 lens 488/448 e 0 to 0 dl 1746143766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.986484:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7100 with x1830963621792896 ext(1015808->1048575) 00010000:00010000:0.0:1746143755.986493:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a4843 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408513 expref: 43 pid: 9585 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746143755.986504:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a4843 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408513 expref: 43 pid: 9585 timeout: 915 lvb_type: 0 00002000:00010000:0.0:1746143755.986510:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cb7100 00000100:00100000:0.0:1746143755.986723:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621793024 00000100:00100000:0.0:1746143755.986730:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621793024 00000100:00100000:0.0:1746143755.986771:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10125 00000100:00100000:0.0:1746143755.986778:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963621793024:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143755.986791:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.986803:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a48d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840858a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143755.986845:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626472448:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143755.986897:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.990757:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.993781:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.993823:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143755.993889:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621793664 00000100:00100000:0.0:1746143755.993895:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621793664 00002000:00100000:0.0:1746143755.993950:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4677631) req@ffff880095cb5c00 x1830963621793664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.993958:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5c00 with x1830963621793664 ext(4194304->4677631) 00002000:00010000:0.0:1746143755.993962:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb5c00 00000100:00100000:0.0:1746143755.993979:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2524 00000100:00100000:0.0:1746143755.993985:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963621793664:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143755.999896:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.007068:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.007127:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.007210:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963621793664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13224us (13384us total) trans 0 rc 483328/483328 00000100:00100000:0.0:1746143756.007220:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2524 00002000:00100000:0.0:1746143756.007229:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4677631) req@ffff880095cb5c00 x1830963621793664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:151/0 lens 488/440 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 483328/483328 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.007238:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5c00 with x1830963621793664 ext(4194304->4677631) 00002000:00010000:0.0:1746143756.007244:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb5c00 00000100:00100000:0.0:1746143756.012640:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.027042:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.028189:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.038908:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.041111:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.043192:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.047343:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.047400:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.053989:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.055282:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.055334:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.058145:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.059469:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.061387:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.061891:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.063901:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.063944:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.093247:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.096211:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.106471:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.106523:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.115233:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.134566:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.145772:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.152058:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.160132:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.160176:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.160945:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10134 00000100:00100000:0.0:1746143756.160953:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963621800064:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143756.160961:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.160973:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73a4954 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484085d7 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.161012:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626474496:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143756.161079:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143756.162232:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.163950:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626474496:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143756.163972:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73a4954 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484085d7 expref: 32 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.163984:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73a4954 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484085d7 expref: 32 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.164583:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3d400, rc 0) 00000100:00100000:0.0:1746143756.166465:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.170176:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.172845:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.172873:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.172906:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.172935:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621801088 00000100:00100000:0.0:1746143756.172940:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621801088 00002000:00100000:0.0:1746143756.172963:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800921cc700 x1830963621801088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.172972:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc700 with x1830963621801088 ext(0->1048575) 00002000:00010000:0.0:1746143756.172976:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cc700 00000100:00100000:0.0:1746143756.172997:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621801216 00000100:00100000:0.0:1746143756.172999:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621801216 00002000:00100000:0.0:1746143756.173009:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1556479) req@ffff8800921cc000 x1830963621801216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.173016:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc000 with x1830963621801216 ext(1048576->1556479) 00002000:00010000:0.0:1746143756.173024:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cc000 00000100:00100000:0.0:1746143756.173032:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621801344 00000100:00100000:0.0:1746143756.173034:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621801344 00002000:00100000:0.0:1746143756.173042:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1064960->2097151) req@ffff880095c68380 x1830963621801344/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.173048:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68380 with x1830963621801344 ext(1064960->2097151) 00002000:00010000:0.0:1746143756.173051:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c68380 00000100:00100000:0.0:1746143756.173059:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2533 00000100:00100000:0.0:1746143756.173065:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963621801088:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143756.173723:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2534 00000100:00100000:0.0:1746143756.173729:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+52:2010:x1830963621801216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143756.174001:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2535 00000100:00100000:0.0:1746143756.174006:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+53:2011:x1830963621801344:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143756.191644:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.192568:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.192768:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+51:2011:x1830963621801344:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18760us (19860us total) trans 0 rc 1032192/1032192 00000100:00100000:0.0:1746143756.192776:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2535 00002000:00100000:0.0:1746143756.192785:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1064960->2097151) req@ffff880095c68380 x1830963621801344/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1032192/1032192 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.192794:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68380 with x1830963621801344 ext(1064960->2097151) 00002000:00010000:0.0:1746143756.192798:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c68380 00000100:00100000:0.0:1746143756.203380:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.204008:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.210003:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.219544:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.286178:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.293678:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.335694:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.338785:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.339058:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.343505:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.346665:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.348810:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.355509:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.360957:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.379010:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.384076:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.395709:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.395765:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.398221:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621805056 00000100:00100000:0.0:1746143756.398225:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621805056 00010000:00010000:0.0:1746143756.398246:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73a494d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484085c9 expref: 55 pid: 9586 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746143756.398271:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4600 00000100:00100000:0.0:1746143756.398276:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+55:2009:x1830963621805056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143756.398284:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143756.398298:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73a494d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484085c9 expref: 55 pid: 9586 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746143756.398306:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73a494d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484085c9 expref: 55 pid: 9586 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746143756.398330:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73a494d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484085c9 expref: 55 pid: 9586 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746143756.398345:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.398346:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.398352:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a4a0a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408632 expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.398359:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a4a0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408632 expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.398377:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a4a0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408632 expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.398384:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626475904:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143756.398707:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143756.401302:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.401337:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.402452:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.446833:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.454496:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.458735:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.463305:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.472974:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143756.492890:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872715 is committed 00000001:00080000:0.0:1746143756.492905:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872713 is committed 00000001:00080000:0.0:1746143756.492956:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872707 is committed 00000100:00100000:0.0:1746143756.494550:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.497636:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.499678:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.504350:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.507576:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.513678:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.513702:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.520794:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.529527:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.529892:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.529941:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.530014:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621809024 00000100:00100000:0.0:1746143756.530022:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621809024 00002000:00100000:0.0:1746143756.530062:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880082ed6a00 x1830963621809024/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.530072:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed6a00 with x1830963621809024 ext(1048576->2097151) 00002000:00010000:0.0:1746143756.530078:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed6a00 00000100:00100000:0.0:1746143756.530103:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2539 00000100:00100000:0.0:1746143756.530109:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963621809024:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143756.539699:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.550389:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.555266:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.555983:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.556020:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.557647:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.559313:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.561994:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.563203:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.578722:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.582719:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.590352:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.591971:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.620249:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.627514:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.632015:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.634725:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.635095:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621813248 00000100:00100000:0.0:1746143756.635099:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621813248 00002000:00100000:0.0:1746143756.635125:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092b22a00 x1830963621813248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.635132:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b22a00 with x1830963621813248 ext(3145728->4194303) 00002000:00010000:0.0:1746143756.635135:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b22a00 00000100:00100000:0.0:1746143756.635159:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2547 00000100:00100000:0.0:1746143756.635164:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963621813248:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143756.641443:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.671220:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.694562:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.699147:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.703124:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.706650:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.727614:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.735815:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.748687:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.752209:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143756.752491:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77400/0x87925e4cb73a4b45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143756.752497:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77400/0x87925e4cb73a4b45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143756.752554:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143756.752558:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143756.752576:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77400/0x87925e4cb73a4b45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143756.752606:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73a4b3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484086e1 expref: 11 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.752622:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77400/0x87925e4cb73a4b45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484086e1 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.752628:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143756.752631:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143756.752633:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77400, rc 0) 00000100:00100000:0.0:1746143756.752655:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:31260:x1830963621815936:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2530us (3976us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143756.752662:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12491 00000100:00100000:0.0:1746143756.755711:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.760240:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.803701:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.807823:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.810460:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.815364:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.830485:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.830516:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.830551:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.830593:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621817728 00000100:00100000:0.0:1746143756.830602:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621817728 00010000:00010000:0.0:1746143756.830687:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73a4aff lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484086b0 expref: 9 pid: 9586 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746143756.830716:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621817600 00000100:00100000:0.0:1746143756.830718:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621817600 00010000:00010000:0.0:1746143756.830729:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73a492a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484085a6 expref: 25 pid: 9587 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746143756.830739:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621817856 00000100:00100000:0.0:1746143756.830741:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621817856 00010000:00010000:0.0:1746143756.830749:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a48cf lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408583 expref: 12 pid: 9586 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746143756.830762:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4616 00000100:00100000:0.0:1746143756.830769:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963621817728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143756.830783:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143756.830804:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73a4aff lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484086b0 expref: 9 pid: 9586 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143756.830814:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73a4aff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484086b0 expref: 9 pid: 9586 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143756.830839:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143756.830889:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963621817728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 120us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143756.830895:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4616 00000100:00100000:0.0:1746143756.830940:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4617 00000100:00100000:0.0:1746143756.830945:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963621817600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143756.830953:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143756.830959:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73a492a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484085a6 expref: 25 pid: 9587 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143756.830971:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73a492a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484085a6 expref: 25 pid: 9587 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143756.830981:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143756.830995:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963621817600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 50us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143756.830999:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4617 00000100:00100000:0.0:1746143756.831008:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4618 00000100:00100000:0.0:1746143756.831012:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963621817856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143756.831018:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143756.831023:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a48cf lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408583 expref: 12 pid: 9586 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143756.831030:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a48cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408583 expref: 12 pid: 9586 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143756.831040:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.831048:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.831056:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73a4ba0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 122880->266239) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484086fd expref: 12 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.831065:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73a4ba0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 122880->266239) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484086fd expref: 12 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.831101:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73a4ba0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 122880->266239) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484086fd expref: 12 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.831121:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626479488:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143756.831176:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143756.831709:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.831726:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621817984 00000100:00100000:0.0:1746143756.831729:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621817984 00000100:00100000:0.0:1746143756.831748:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10163 00000100:00100000:0.0:1746143756.831753:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963621817984:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143756.831765:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.831777:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73a4ba7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408704 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.831806:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626479616:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143756.831840:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a29e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143756.845441:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.846180:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.851520:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.853513:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.869505:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.872427:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.876633:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143756.877651:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a4bbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 667648->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408719 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.877664:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626480128:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143756.877831:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a29e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143756.880628:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.887019:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.892879:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.892952:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.912682:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.912714:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.912798:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.921246:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.923450:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.928842:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.932180:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.946518:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.952201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.961116:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963621821824:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8658us (8901us total) trans 17179872718 rc 0/0 00000100:00100000:0.0:1746143756.961127:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1192 00002000:00100000:0.0:1746143756.961138:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1716223) req@ffff880092ef3800 x1830963621821824/t17179872718(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:152/0 lens 488/448 e 0 to 0 dl 1746143767 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.961146:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3800 with x1830963621821824 ext(1048576->1716223) 00010000:00010000:0.0:1746143756.961165:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73a4bc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408720 expref: 28 pid: 9586 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143756.961180:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73a4bc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408720 expref: 28 pid: 9586 timeout: 916 lvb_type: 0 00002000:00010000:0.0:1746143756.961187:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef3800 00000100:00100000:0.0:1746143756.969285:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.977663:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.984157:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.985316:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.988484:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.988516:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143756.988531:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.005773:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.007037:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.097971:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626481920 00000100:00100000:0.0:1746143757.097983:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626481920 00000100:00100000:0.0:1746143757.098061:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1746143757.098069:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626481920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746143757.098095:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1013141568 pending 1548288 free 3914395648 avail 3671187456 00000100:00100000:0.0:1746143757.098169:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626481920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.098176:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1746143757.155470:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.206758:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143757.207623:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143757.211131:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.211182:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.211221:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621824256 00000100:00100000:0.0:1746143757.211229:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621824256 00010000:00010000:0.0:1746143757.211266:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2000/0x87925e4cb73a4ab9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840869b expref: 12 pid: 9587 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746143757.211289:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621824128 00000100:00100000:0.0:1746143757.211291:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621824128 00010000:00010000:0.0:1746143757.211317:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a4b22 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484086d3 expref: 9 pid: 9839 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746143757.211329:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4628 00000100:00100000:0.0:1746143757.211336:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963621824256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.211351:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.211370:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801331d2000/0x87925e4cb73a4ab9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840869b expref: 12 pid: 9587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.211381:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331d2000/0x87925e4cb73a4ab9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840869b expref: 12 pid: 9587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.211409:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.211448:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963621824256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 112us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.211455:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4628 00000100:00100000:0.0:1746143757.211470:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4629 00000100:00100000:0.0:1746143757.211474:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963621824128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.211480:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.211491:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a4b22 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484086d3 expref: 9 pid: 9839 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143757.211498:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a4b22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484086d3 expref: 9 pid: 9839 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143757.211512:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.211525:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963621824128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.211529:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4629 00000100:00100000:0.0:1746143757.212740:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.222551:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.228471:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.228576:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143757.229409:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143757.248659:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.248692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.248723:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.248751:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621825024 00000100:00100000:0.0:1746143757.248760:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621825024 00010000:00010000:0.0:1746143757.248802:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a4b1b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484086cc expref: 8 pid: 12328 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746143757.248831:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621825152 00000100:00100000:0.0:1746143757.248833:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621825152 00010000:00010000:0.0:1746143757.248842:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550a00/0x87925e4cb73a4aa4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408686 expref: 29 pid: 9587 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746143757.248872:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621825280 00000100:00100000:0.0:1746143757.248884:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621825280 00010000:00010000:0.0:1746143757.248895:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73a4aab lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840868d expref: 13 pid: 9587 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746143757.248938:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4631 00000100:00100000:0.0:1746143757.248947:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963621825024:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.248961:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.248981:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a4b1b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484086cc expref: 8 pid: 12328 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143757.248991:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a4b1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484086cc expref: 8 pid: 12328 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143757.249016:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.249057:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963621825024:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 112us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.249062:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4631 00000100:00100000:0.0:1746143757.249078:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4632 00000100:00100000:0.0:1746143757.249082:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963621825152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.249088:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.249094:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d550a00/0x87925e4cb73a4aa4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408686 expref: 29 pid: 9587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.249101:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d550a00/0x87925e4cb73a4aa4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408686 expref: 29 pid: 9587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.249125:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.249146:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963621825152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 63us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.249151:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4632 00000100:00100000:0.0:1746143757.249162:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4633 00000100:00100000:0.0:1746143757.249166:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963621825280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.249174:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.249180:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73a4aab lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840868d expref: 13 pid: 9587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.249188:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73a4aab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840868d expref: 13 pid: 9587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.249199:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.249201:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.249209:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124512800/0x87925e4cb73a4c25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2195456->2752511) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408766 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.249217:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124512800/0x87925e4cb73a4c25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2195456->2752511) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408766 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.249225:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.249226:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.249229:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092137600/0x87925e4cb73a4c2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840876d expref: 13 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.249234:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092137600/0x87925e4cb73a4c2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840876d expref: 13 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.249278:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092137600/0x87925e4cb73a4c2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840876d expref: 13 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143757.249290:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626482944:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143757.249356:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880124512800/0x87925e4cb73a4c25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2195456->2752511) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408766 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143757.249363:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800960ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626483072:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143757.249380:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143757.263732:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.268182:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.272243:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.286471:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.303163:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.303199:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.303249:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143757.314020:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143756 -> 1746143757 00002000:00010000:0.0:1746143757.314026:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143756 -> 1746143757 00002000:00010000:0.0:1746143757.314028:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143756 -> 1746143757 00000100:00100000:0.0:1746143757.314045:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626483456:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143757.314073:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a4c41 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408782 expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.314085:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a4c41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408782 expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.314116:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137200, rc 0) 00000100:00100000:0.0:1746143757.314149:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800960fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963621826432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8617us (10948us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143757.314156:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10179 00000100:00100000:0.0:1746143757.320167:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.329621:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.329677:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.336968:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626483840:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143757.337001:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092458000/0x87925e4cb73a4c4f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408790 expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.337016:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092458000/0x87925e4cb73a4c4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408790 expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.337043:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092458000, rc 0) 00000100:00100000:0.0:1746143757.337088:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963621827072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3581us (7409us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143757.337096:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10181 00000100:00100000:0.0:1746143757.340443:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.347821:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.347879:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.361499:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.392870:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.394899:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.397033:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.403764:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.404392:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.406404:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.411867:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.414540:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.414582:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.431909:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.437333:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.454893:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963621829760:12345-192.168.202.3@tcp:4:cat.0 Request processed in 17373us (17548us total) trans 21474840031 rc 0/0 00000100:00100000:0.0:1746143757.454945:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1197 00002000:00100000:0.0:1746143757.454964:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3919871) req@ffff880091bc8a80 x1830963621829760/t21474840031(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:153/0 lens 488/448 e 0 to 0 dl 1746143768 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143757.454975:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc8a80 with x1830963621829760 ext(3145728->3919871) 00010000:00010000:0.0:1746143757.454987:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092137600/0x87925e4cb73a4c2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840876d expref: 15 pid: 12327 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.455006:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092137600/0x87925e4cb73a4c2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840876d expref: 15 pid: 12327 timeout: 916 lvb_type: 0 00002000:00010000:0.0:1746143757.455013:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bc8a80 00000100:00100000:0.0:1746143757.458290:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.469012:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.469062:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.494889:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.576049:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.581822:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.581879:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.581950:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621831040 00000100:00100000:0.0:1746143757.581959:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621831040 00010000:00010000:0.0:1746143757.581996:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73a4bed lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408743 expref: 32 pid: 10936 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746143757.582021:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621830912 00000100:00100000:0.0:1746143757.582023:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621830912 00010000:00010000:0.0:1746143757.582033:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a4c10 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408758 expref: 287 pid: 10936 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746143757.582057:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4637 00000100:00100000:0.0:1746143757.582064:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2010:x1830963621831040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.582078:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.582084:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73a4bed lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408743 expref: 32 pid: 10936 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.582094:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73a4bed lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408743 expref: 32 pid: 10936 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.582126:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143757.582131:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4ca3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143757.582140:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4ca3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143757.582144:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4ca3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143757.582148:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.582195:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2010:x1830963621831040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.582201:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4637 00000100:00100000:0.0:1746143757.582215:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4638 00000100:00100000:0.0:1746143757.582220:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+287:2010:x1830963621830912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.582226:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.582229:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a4c10 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408758 expref: 287 pid: 10936 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.582237:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a4c10 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408758 expref: 287 pid: 10936 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.582248:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143757.582251:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4ca3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143757.582258:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143757.582265:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4ca3 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143757.582287:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.582301:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+287:2010:x1830963621830912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 81us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.582306:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4638 00000100:00100000:0.0:1746143757.600389:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.600718:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.609449:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.609502:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.609540:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.609556:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621832320 00000100:00100000:0.0:1746143757.609560:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621832320 00010000:00010000:0.0:1746143757.609574:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27e00/0x87925e4cb73a4c87 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484087c8 expref: 30 pid: 9587 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746143757.609726:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4639 00000100:00100000:0.0:1746143757.609735:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963621832320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.609748:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.609842:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b27e00/0x87925e4cb73a4c87 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484087c8 expref: 30 pid: 9587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.609853:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b27e00/0x87925e4cb73a4c87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484087c8 expref: 30 pid: 9587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.609882:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.609952:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963621832320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 217us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.609958:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4639 00000100:00100000:0.0:1746143757.609975:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4640 00000100:00100000:0.0:1746143757.609980:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963621832192:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.609988:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.610254:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484087cf expref: 13 pid: 6587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.610262:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484087cf expref: 13 pid: 6587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.610283:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092458000/0x87925e4cb73a4ca3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484087cf expref: 13 pid: 6587 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746143757.610298:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143757.610303:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a4cd4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143757.610313:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a4cd4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143757.610319:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a4cd4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143757.610337:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.610352:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963621832192:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 372us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.610357:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4640 00000100:00100000:0.0:1746143757.610371:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4641 00000100:00100000:0.0:1746143757.610376:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963621832064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.610384:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.610392:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c528e00/0x87925e4cb73a4cb8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484087e4 expref: 9 pid: 9585 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143757.610400:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c528e00/0x87925e4cb73a4cb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484087e4 expref: 9 pid: 9585 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143757.610412:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c528e00/0x87925e4cb73a4cb8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484087e4 expref: 9 pid: 9585 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746143757.610431:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.610433:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.610439:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73a4cc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3784704->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484087f9 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.610446:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73a4cc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3784704->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484087f9 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.610470:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73a4cc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3784704->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484087f9 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143757.610482:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136aca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626485632:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143757.610526:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143757.619242:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.619288:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.622715:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143757.623740:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a4ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.623747:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a4ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143757.623797:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143757.623800:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143757.623815:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a4ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.623845:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a4ce2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408800 expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.623871:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a4ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408800 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.623877:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143757.623879:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143757.623882:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634600, rc 0) 00000100:00100000:0.0:1746143757.623902:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31299:x1830963621832704:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4487us (4615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.623908:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12499 00000100:00100000:0.0:1746143757.629442:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.632855:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.637126:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.637147:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.650869:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.650965:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.651014:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.655357:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621834368 00000100:00100000:0.0:1746143757.655361:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621834368 00000100:00100000:0.0:1746143757.655388:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12500 00000100:00100000:0.0:1746143757.655394:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31299:x1830963621834368:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143757.655409:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143757.655423:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136600/0x87925e4cb73a4d13 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840882a expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.655517:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73a4d1a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.655543:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73a4d1a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.655552:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73a4d1a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.655563:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73a4d1a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.655569:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73a4d1a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.655575:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73a4d1a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.655580:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092136200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143757.655583:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73a4d1a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.655589:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73a4d1a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.655597:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143757.655600:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143757.655603:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73a4d1a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.655607:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73a4d1a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143757.655632:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136600/0x87925e4cb73a4d13 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840882a expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.655646:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136600/0x87925e4cb73a4d13 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840882a expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.655653:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136600, rc 0) 00000100:00100000:0.0:1746143757.655673:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31299:x1830963621834368:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 279us (1278us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143757.655678:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12500 00000100:00100000:0.0:1746143757.664462:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.664484:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.664517:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.664536:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621834752 00000100:00100000:0.0:1746143757.664539:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621834752 00002000:00100000:0.0:1746143757.664571:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3723264->3727359) req@ffff880090e27800 x1830963621834752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143757.664579:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e27800 with x1830963621834752 ext(3723264->3727359) 00002000:00010000:0.0:1746143757.664583:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e27800 00000100:00100000:0.0:1746143757.664600:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621835264 00000100:00100000:0.0:1746143757.664602:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621835264 00002000:00100000:0.0:1746143757.664614:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b5:0x0] (1593344->1597439) req@ffff880095c39180 x1830963621835264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143757.664620:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39180 with x1830963621835264 ext(1593344->1597439) 00002000:00010000:0.0:1746143757.664623:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c39180 00000100:00100000:0.0:1746143757.664634:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2569 00000100:00100000:0.0:1746143757.664639:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963621834752:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143757.664754:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963621834752:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 114us (303us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143757.664759:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2569 00002000:00100000:0.0:1746143757.664764:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (3723264->3727359) req@ffff880090e27800 x1830963621834752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746143768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143757.664771:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e27800 with x1830963621834752 ext(3723264->3727359) 00002000:00010000:0.0:1746143757.664774:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e27800 00000100:00100000:0.0:1746143757.671595:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.687350:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.687416:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.687939:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10201 00000100:00100000:0.0:1746143757.687947:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:31296:x1830963621835776:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143757.687955:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143757.687963:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136c00/0x87925e4cb73a4d28 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408838 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.687980:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092459200/0x87925e4cb73a4c56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408797 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.687986:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143757.687987:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143757.687990:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136c00/0x87925e4cb73a4d28 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->2641919] (req 2097152->2641919) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408838 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.688006:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092459200/0x87925e4cb73a4c56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408797 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.688026:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092459200/0x87925e4cb73a4c56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408797 expref: 30 pid: 9586 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746143757.688033:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626487424:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143757.688079:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143757.691981:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.694464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.702208:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.705430:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.706966:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.708970:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.723832:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.728310:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.728331:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.728358:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.730069:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.739903:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.740591:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.752812:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.761077:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.763244:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.763461:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.763477:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621838720 00000100:00100000:0.0:1746143757.763480:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621838720 00000100:00100000:0.0:1746143757.763499:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10207 00000100:00100000:0.0:1746143757.763504:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963621838720:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143757.763519:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143757.763529:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a4d52 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408862 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143757.763552:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f604e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626488448:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143757.763620:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143757.785947:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.786540:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621838976 00000100:00100000:0.0:1746143757.786544:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621838976 00000100:00100000:0.0:1746143757.786577:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10209 00000100:00100000:0.0:1746143757.786585:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:31309:x1830963621838976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143757.786592:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143757.786599:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a4d60 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408870 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.786613:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.786614:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.786622:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a4d60 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408870 expref: 33 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.786635:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a4d60 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408870 expref: 33 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.786645:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55bc00, rc 0) 00000100:00100000:0.0:1746143757.786684:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:31309:x1830963621838976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 101us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.786691:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10209 00000100:00100000:0.0:1746143757.789742:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.790262:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.801773:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.801830:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143757.803408:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a4d59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408869 expref: 18 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143757.803418:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f606680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626488832:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143757.803457:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143757.809618:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.809665:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.824890:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.827738:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.831659:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.837277:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.841180:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.874368:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.878644:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.893587:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.893636:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.893941:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2582 00000100:00100000:0.0:1746143757.893949:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963621842048:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143757.909199:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.919162:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.925035:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.925086:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.938788:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.938843:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.947445:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.953409:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.963120:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.975776:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.977387:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.979636:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143757.987771:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.134971:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.152035:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.177586:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.193086:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.213672:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.213716:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.213762:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.213791:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621845504 00000100:00100000:0.0:1746143758.213802:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621845504 00000100:00100000:0.0:1746143758.214876:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621845760 00000100:00100000:0.0:1746143758.214881:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621845760 00000100:00100000:0.0:1746143758.215412:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10221 00000100:00100000:0.0:1746143758.215419:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963621845760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143758.215428:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.215438:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136000/0x87925e4cb73a4dde lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484088d2 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.215489:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626490624:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143758.215567:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00010000:00010000:0.0:1746143758.219950:0:1945:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff880096fdaa00 x1830963626490624) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73a4dc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2166784->2846719) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484088b6 expref: 32 pid: 9585 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.219985:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73a4dc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2166784->2846719) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484088b6 expref: 32 pid: 9585 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.219998:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626490624:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143758.220018:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136000/0x87925e4cb73a4dde lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484088d2 expref: 31 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.220027:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136000/0x87925e4cb73a4dde lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484088d2 expref: 31 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.220034:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136000, rc 0) 00000100:00100000:0.0:1746143758.220059:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963621845760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4641us (6297us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143758.220065:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10221 00000100:00100000:0.0:1746143758.232533:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.232571:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.232600:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621846144 00000100:00100000:0.0:1746143758.232609:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621846144 00000100:00100000:0.0:1746143758.232662:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10222 00000100:00100000:0.0:1746143758.232669:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:31327:x1830963621846144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143758.232689:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.232706:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73a4de5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484088d9 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.232749:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73a4da6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->1929215) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840889a expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.232757:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143758.232759:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143758.232762:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73a4de5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484088d9 expref: 34 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.232789:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73a4da6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->1929215) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840889a expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.232799:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73a4da6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->1929215) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840889a expref: 17 pid: 9585 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.232811:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626490880:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143758.232879:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.238831:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.238967:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.252320:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.252363:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.253765:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963621846400:12345-192.168.202.3@tcp:4:cat.0 Request processed in 14091us (14792us total) trans 21474840035 rc 0/0 00000100:00100000:0.0:1746143758.253775:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1203 00002000:00100000:0.0:1746143758.253787:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b5:0x0] (1822720->1929215) req@ffff880096fd8000 x1830963621846400/t21474840035(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.253809:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd8000 with x1830963621846400 ext(1822720->1929215) 00010000:00010000:0.0:1746143758.253819:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73a4da6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->1929215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840889a expref: 20 pid: 9585 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.253829:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73a4da6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->1929215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840889a expref: 20 pid: 9585 timeout: 917 lvb_type: 0 00002000:00010000:0.0:1746143758.253835:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd8000 00000100:00100000:0.0:1746143758.256535:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.262039:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.262640:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.262704:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.262725:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.267284:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.282502:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.287546:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626491904:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143758.287556:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626492032:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143758.287589:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e59e000/0x87925e4cb73a4e01 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->1265663] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484088f5 expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.287601:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e59e000, rc 0) 00000100:00100000:0.0:1746143758.287691:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:31328:x1830963621847552:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 20257us (20413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.287698:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10226 00000100:00100000:0.0:1746143758.306094:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626492544:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143758.306135:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.306158:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963621848704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5907us (5939us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.306167:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4667 00000100:00100000:0.0:1746143758.307824:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10235 00000100:00100000:0.0:1746143758.307830:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963621849856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143758.307836:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.307842:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a4e5c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408934 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.307861:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626493056:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143758.307881:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.315464:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.316967:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.332529:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.339713:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621851136 00000100:00100000:0.0:1746143758.339723:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621851136 00000100:00100000:0.0:1746143758.339774:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12505 00000100:00100000:0.0:1746143758.339782:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800960ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:31329:x1830963621851136:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143758.339806:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.339809:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143758.339835:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73a4e6a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408942 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.339860:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143758.339864:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143758.339883:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a4e78 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408949 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.341507:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a4e7f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143758.341526:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a4e7f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143758.341538:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a4e7f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143758.341550:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a4e7f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143758.341555:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a4e7f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143758.341560:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a4e7f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143758.341566:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143758.341569:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a4e7f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143758.341575:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a4e7f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143758.341583:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143758.341585:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143758.341588:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a4e7f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143758.341592:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a4e7f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143758.341639:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a4e78 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408949 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.341646:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a4e78 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408949 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.341653:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3000, rc 0) 00000100:00100000:0.0:1746143758.341713:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800960ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:31329:x1830963621851136:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 1931us (2036us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143758.341721:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12505 00000100:00100000:0.0:1746143758.347311:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.375408:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626493312 00000100:00100000:0.0:1746143758.375418:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626493312 00000100:00100000:0.0:1746143758.375464:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1746143758.375472:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963626493312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746143758.375496:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1016343744 pending 4251648 free 3913109504 avail 3681587200 00000100:00100000:0.0:1746143758.375532:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963626493312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.375539:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1746143758.403032:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.405435:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.418656:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.421375:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.429287:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.434464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.443578:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.449168:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.449457:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.459767:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.461728:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.463633:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.475745:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.477504:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.477532:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621854208 00000100:00100000:0.0:1746143758.477536:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621854208 00002000:00100000:0.0:1746143758.477567:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b3:0x0] (741376->745471) req@ffff8800921cc380 x1830963621854208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.477576:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc380 with x1830963621854208 ext(741376->745471) 00002000:00010000:0.0:1746143758.477581:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cc380 00000100:00100000:0.0:1746143758.477707:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2596 00000100:00100000:0.0:1746143758.477714:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963621854208:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143758.478527:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963621854208:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 812us (1022us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143758.478533:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2596 00002000:00100000:0.0:1746143758.478539:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b3:0x0] (741376->745471) req@ffff8800921cc380 x1830963621854208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.478547:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc380 with x1830963621854208 ext(741376->745471) 00002000:00010000:0.0:1746143758.478550:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cc380 00000100:00100000:0.0:1746143758.482309:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.482352:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.484331:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.485085:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.485124:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621854848 00000100:00100000:0.0:1746143758.485128:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621854848 00002000:00100000:0.0:1746143758.485154:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b3:0x0] (864256->868351) req@ffff880092b21880 x1830963621854848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.485163:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b21880 with x1830963621854848 ext(864256->868351) 00002000:00010000:0.0:1746143758.485167:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b21880 00000100:00100000:0.0:1746143758.485180:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2597 00000100:00100000:0.0:1746143758.485185:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963621854848:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143758.485309:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963621854848:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 123us (224us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143758.485316:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2597 00002000:00100000:0.0:1746143758.485322:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b3:0x0] (864256->868351) req@ffff880092b21880 x1830963621854848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.485329:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b21880 with x1830963621854848 ext(864256->868351) 00002000:00010000:0.0:1746143758.485331:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b21880 00000100:00100000:0.0:1746143758.490320:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.499757:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.503782:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.508079:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.514517:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.514549:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.514582:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.523670:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.528525:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.528650:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.529042:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.529073:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.529132:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10246 00000100:00100000:0.0:1746143758.529137:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963621856896:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143758.529173:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a4f3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.529189:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73a4de5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484088d9 expref: 33 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.529196:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a4e40 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840891f expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.529203:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db02800/0x87925e4cb73a4dfa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484088ee expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.529207:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.529208:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.529210:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a4f3c lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.529229:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db02800/0x87925e4cb73a4dfa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484088ee expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.529240:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db02800/0x87925e4cb73a4dfa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484088ee expref: 18 pid: 1945 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746143758.529252:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626495744:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143758.529404:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.529420:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621856768 00000100:00100000:0.0:1746143758.529423:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621856768 00000100:00100000:0.0:1746143758.529439:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10249 00000100:00100000:0.0:1746143758.529443:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963621856768:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143758.529457:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.529859:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73a4e8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408957 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.529866:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143758.529867:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143758.529869:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.529886:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73a4e8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408957 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.529894:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73a4e8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408957 expref: 13 pid: 9585 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.529902:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626496640:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143758.529959:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.531767:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.531833:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.531850:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621857280 00000100:00100000:0.0:1746143758.531860:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621857280 00010000:00010000:0.0:1746143758.531875:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db02800/0x87925e4cb73a4dfa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484088ee expref: 19 pid: 1945 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746143758.531892:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4678 00000100:00100000:0.0:1746143758.531897:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963621857280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.531905:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.531939:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db02800/0x87925e4cb73a4dfa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484088ee expref: 19 pid: 1945 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143758.531948:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db02800/0x87925e4cb73a4dfa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484088ee expref: 19 pid: 1945 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143758.532453:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db02800/0x87925e4cb73a4dfa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484088ee expref: 19 pid: 1945 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143758.532482:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.532506:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963621857280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 608us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.532513:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4678 00000100:00100000:0.0:1746143758.536178:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626496640:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143758.536192:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.538347:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963621857408:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 6452us (6577us total) trans 17179872724 rc 0/0 00000100:00100000:0.0:1746143758.538371:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1206 00002000:00100000:0.0:1746143758.538384:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x395:0x0] (1667072->2097151) req@ffff880091bdce00 x1830963621857408/t17179872724(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.538393:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdce00 with x1830963621857408 ext(1667072->2097151) 00010000:00010000:0.0:1746143758.538402:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a4e86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408950 expref: 16 pid: 9585 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.538413:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a4e86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408950 expref: 16 pid: 9585 timeout: 917 lvb_type: 0 00002000:00010000:0.0:1746143758.538419:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdce00 00000100:00100000:0.0:1746143758.538779:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621857664 00000100:00100000:0.0:1746143758.538786:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621857664 00002000:00100000:0.0:1746143758.538817:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b3:0x0] (741376->868351) req@ffff88012e35ad80 x1830963621857664/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.538824:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35ad80 with x1830963621857664 ext(741376->868351) 00010000:00010000:0.0:1746143758.538829:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a4ea9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->868351) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408965 expref: 34 pid: 9585 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.538840:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a4ea9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->868351) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408965 expref: 34 pid: 9585 timeout: 917 lvb_type: 0 00002000:00010000:0.0:1746143758.538846:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e35ad80 00000100:00100000:0.0:1746143758.538862:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1207 00000100:00100000:0.0:1746143758.538867:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963621857664:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143758.540134:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.540159:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.540171:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.540199:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.540213:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.540230:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.540242:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.540256:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621858176 00000100:00100000:0.0:1746143758.540260:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621858176 00010000:00010000:0.0:1746143758.540278:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092136800/0x87925e4cb73a4c33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [2646016->3145727] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408774 expref: 18 pid: 9586 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.540289:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621858304 00000100:00100000:0.0:1746143758.540290:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621858304 00010000:00010000:0.0:1746143758.540297:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092458000/0x87925e4cb73a4d2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840883f expref: 19 pid: 9839 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.540303:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621858560 00000100:00100000:0.0:1746143758.540305:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621858560 00010000:00010000:0.0:1746143758.540313:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a4e47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408926 expref: 10 pid: 12327 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746143758.540319:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621858944 00000100:00100000:0.0:1746143758.540321:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621858944 00010000:00010000:0.0:1746143758.540326:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a4d59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408869 expref: 20 pid: 9585 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.540332:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621857920 00000100:00100000:0.0:1746143758.540334:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621857920 00010000:00010000:0.0:1746143758.540352:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73a4de5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484088d9 expref: 36 pid: 1945 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.540360:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621858432 00000100:00100000:0.0:1746143758.540362:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621858432 00010000:00010000:0.0:1746143758.540370:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a4d60 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408870 expref: 37 pid: 1945 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.540379:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4682 00000100:00100000:0.0:1746143758.540384:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963621858176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.540394:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.540406:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092136800/0x87925e4cb73a4c33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 9 type: EXT [2646016->3145727] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408774 expref: 20 pid: 9586 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.540414:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092136800/0x87925e4cb73a4c33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 9 type: EXT [2646016->3145727] (req 2646016->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408774 expref: 20 pid: 9586 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.540429:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092136800/0x87925e4cb73a4c33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 9 type: EXT [2646016->3145727] (req 2646016->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408774 expref: 20 pid: 9586 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.540442:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.540463:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963621858176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.541025:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4682 00000100:00100000:0.0:1746143758.541041:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4684 00000100:00100000:0.0:1746143758.541047:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963621858560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.541055:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.541067:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a4e47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408926 expref: 10 pid: 12327 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143758.541083:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a4e47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408926 expref: 10 pid: 12327 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143758.541149:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a4e47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408926 expref: 10 pid: 12327 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143758.541157:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.541176:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621858560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.541182:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4684 00000100:00100000:0.0:1746143758.541218:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.541263:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.541274:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621859072 00000100:00100000:0.0:1746143758.541276:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621859072 00010000:00010000:0.0:1746143758.541286:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a4e2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840890a expref: 32 pid: 9585 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.541296:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4689 00000100:00100000:0.0:1746143758.541300:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963621859072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.541306:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.541316:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a4e2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840890a expref: 32 pid: 9585 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.541323:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a4e2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840890a expref: 32 pid: 9585 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.541338:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a4e2b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840890a expref: 32 pid: 9585 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.541346:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.541347:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.541350:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7dc00/0x87925e4cb73a4f2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.541356:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7dc00/0x87925e4cb73a4f2e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.541380:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.541393:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963621859072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 92us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.541398:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4689 00000100:00100000:0.0:1746143758.544008:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143758.546413:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a4f35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.546425:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a4f35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.546446:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a4f35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.546452:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a4f35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.546466:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a4f35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.546472:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092137e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143758.546476:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a4f35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.546483:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a4f35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.546497:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a4f35 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.546503:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a4f35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.546592:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963621856640:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 17456us (18076us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.546600:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10245 00000100:00100000:0.0:1746143758.551145:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143758.551489:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e504800/0x87925e4cb73a4f43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.551499:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e504800/0x87925e4cb73a4f43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.551536:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e504800/0x87925e4cb73a4f43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.551542:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e504800/0x87925e4cb73a4f43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.551549:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e504800/0x87925e4cb73a4f43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.551555:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e504800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143758.551558:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e504800/0x87925e4cb73a4f43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.551564:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e504800/0x87925e4cb73a4f43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.551580:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e504800/0x87925e4cb73a4f43 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.551587:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e504800/0x87925e4cb73a4f43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.551766:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2008:x1830963621856512:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 22414us (22689us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.551776:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10248 00000100:00100000:0.0:1746143758.556026:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621859456 00000100:00100000:0.0:1746143758.556051:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621859456 00000100:00100000:0.0:1746143758.556092:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621859712 00000100:00100000:0.0:1746143758.556106:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621859712 00000100:00100000:0.0:1746143758.556122:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10251 00000100:00100000:0.0:1746143758.556130:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963621859456:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143758.556150:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.556172:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a4f58 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484089b2 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143758.556196:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a0e, atime: 0x68140a0d, ctime: 0x68140a0e, blocks: 0x7d8 00010000:00010000:0.0:1746143758.556216:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.556218:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.556229:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a4f58 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484089b2 expref: 17 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.556244:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a4f58 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484089b2 expref: 17 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.556254:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3e00, rc 0) 00000100:00100000:0.0:1746143758.556310:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963621859456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 180us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.556316:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10251 00000100:00100000:0.0:1746143758.556332:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10253 00000100:00100000:0.0:1746143758.556337:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963621859712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143758.556343:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.556350:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a4f66 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484089c0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.556400:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626497536:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143758.557251:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a240 going to sleep for 11 seconds 00010000:00010000:0.0:1746143758.557701:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.557710:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.557728:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.557736:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.557743:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.557751:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143758.557755:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.557762:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.557772:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.557791:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a4f4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.558260:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963621856768:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 28814us (28853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.558267:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10249 00000100:00100000:0.0:1746143758.568506:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.568555:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.568590:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.582836:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.582868:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.582896:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.586536:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.586863:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143758.594863:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943144 is committed 00000004:00080000:0.0:1746143758.594872:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1694 committed 00000004:00080000:0.0:1746143758.594891:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1709 committed 00000004:00080000:0.0:1746143758.594897:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1708 committed 00000004:00080000:0.0:1746143758.594899:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1707 committed 00000004:00080000:0.0:1746143758.594900:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1706 committed 00000004:00080000:0.0:1746143758.594902:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1693 committed 00000004:00080000:0.0:1746143758.594904:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1705 committed 00000004:00080000:0.0:1746143758.594905:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1692 committed 00000004:00080000:0.0:1746143758.594907:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1704 committed 00000004:00080000:0.0:1746143758.594908:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1691 committed 00000004:00080000:0.0:1746143758.594930:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1690 committed 00000004:00080000:0.0:1746143758.594931:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1689 committed 00000004:00080000:0.0:1746143758.594940:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1703 committed 00000004:00080000:0.0:1746143758.594942:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1702 committed 00000004:00080000:0.0:1746143758.594944:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1688 committed 00000004:00080000:0.0:1746143758.594945:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1687 committed 00000004:00080000:0.0:1746143758.594947:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1701 committed 00000001:00080000:0.0:1746143758.594952:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943143 is committed 00000001:00080000:0.0:1746143758.594961:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943139 is committed 00000100:00100000:0.0:1746143758.595582:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10258 00000100:00100000:0.0:1746143758.595589:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3773:x1830963626498944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143758.595641:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143758.595644:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143758.595646:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143758.595647:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143758.595649:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746143758.595674:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3773:x1830963626498944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (323us total) trans 17179872727 rc 0/0 00000100:00100000:0.0:1746143758.595691:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10258 00000100:00100000:0.0:1746143758.595703:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10260 00000100:00100000:0.0:1746143758.595707:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3773:x1830963626499072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.595763:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3773:x1830963626499072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (345us total) trans 17179872729 rc 0/0 00000100:00100000:0.0:1746143758.595769:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10260 00000100:00100000:0.0:1746143758.598034:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626499712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.598061:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.598077:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626500224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.598103:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.598134:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143758.598138:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626499584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.598153:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.598174:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626500096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.598187:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.598206:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626500096 00000100:00100000:0.0:1746143758.598208:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626500096 00000100:00100000:0.0:1746143758.598223:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10266 00000100:00100000:0.0:1746143758.598227:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3771:x1830963626500352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.598301:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10267 00002000:00010000:0.0:1746143758.598322:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143758.598325:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143758.598327:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143758.598329:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143758.598331:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143758.598355:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963626500352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 127us (310us total) trans 21474840038 rc 0/0 00000100:00100000:0.0:1746143758.598363:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10266 00000100:00100000:0.0:1746143758.599229:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10270 00000100:00100000:0.0:1746143758.599241:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3774:x1830963626499584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143758.599291:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143758.599293:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143758.599295:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143757 -> 1746143757 00002000:00010000:0.0:1746143758.599297:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143758.599298:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:0.0:1746143758.599319:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963626499584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1165us total) trans 21474840041 rc 0/0 00000100:00100000:0.0:1746143758.599331:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10270 00000100:00100000:0.0:1746143758.599376:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840019 gen 2 00000004:00080000:0.0:1746143758.599381:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b48000, transno 21474839967 00000004:00080000:0.0:1746143758.599387:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b48700, transno 21474839968 00000004:00080000:0.0:1746143758.599390:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b4b800, transno 21474839969 00000004:00080000:0.0:1746143758.599392:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b48380, transno 21474839970 00000004:00080000:0.0:1746143758.599394:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b48a80, transno 21474839971 00000004:00080000:0.0:1746143758.599397:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b4aa00, transno 21474839972 00000004:00080000:0.0:1746143758.599399:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b4bb80, transno 21474839973 00000004:00080000:0.0:1746143758.599401:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b4a300, transno 21474839974 00000004:00080000:0.0:1746143758.599403:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c32300, transno 21474839975 00000004:00080000:0.0:1746143758.599406:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e58000, transno 21474839976 00000004:00080000:0.0:1746143758.599408:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d8700, transno 21474839977 00000004:00080000:0.0:1746143758.599410:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d8380, transno 21474839978 00000004:00080000:0.0:1746143758.599412:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1db100, transno 21474839979 00000004:00080000:0.0:1746143758.599414:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1dbb80, transno 21474839980 00000004:00080000:0.0:1746143758.599416:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5aa00, transno 21474839981 00000004:00080000:0.0:1746143758.599418:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d9c00, transno 21474839982 00000004:00080000:0.0:1746143758.599420:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d9180, transno 21474839983 00000004:00080000:0.0:1746143758.599422:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e58700, transno 21474839984 00000004:00080000:0.0:1746143758.599424:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a50e00, transno 21474840002 00000004:00080000:0.0:1746143758.599426:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a52680, transno 21474840003 00000004:00080000:0.0:1746143758.599428:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b9f80, transno 21474840004 00000004:00080000:0.0:1746143758.599430:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a52d80, transno 21474840005 00000004:00080000:0.0:1746143758.599432:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373bb800, transno 21474840006 00000004:00080000:0.0:1746143758.599434:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7aaa00, transno 21474840007 00000004:00080000:0.0:1746143758.599436:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a51f80, transno 21474840008 00000004:00080000:0.0:1746143758.599439:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373bad80, transno 21474840009 00000004:00080000:0.0:1746143758.599445:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373ba300, transno 21474840010 00000004:00080000:0.0:1746143758.599447:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7ab800, transno 21474840011 00000004:00080000:0.0:1746143758.599449:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b49500, transno 21474840012 00000004:00080000:0.0:1746143758.599451:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7a8380, transno 21474840013 00000004:00080000:0.0:1746143758.599453:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b4b100, transno 21474840014 00000004:00080000:0.0:1746143758.599455:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7a8a80, transno 21474840015 00000004:00080000:0.0:1746143758.599457:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7a9f80, transno 21474840016 00000004:00080000:0.0:1746143758.599459:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b49880, transno 21474840017 00000004:00080000:0.0:1746143758.599461:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b49f80, transno 21474840018 00000004:00080000:0.0:1746143758.599463:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d840e00, transno 21474840019 00000100:00100000:0.0:1746143758.599468:0:3774:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88007f605c00 x1830963626499584/t21474840041(21474840041) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143774 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143758.599476:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f605c00/2, rc 0, transno 21474840041 00000100:00100000:0.0:1746143758.599479:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626499584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143758.599489:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f607800/2, rc 0, transno 21474840042 00000100:00100000:0.0:1746143758.599492:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626500096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143758.599497:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093725f80/2, rc 0, transno 21474840040 00000100:00100000:0.0:1746143758.599499:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626500224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143758.600334:0:8224:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 1 in flight, 36 done 00000100:00100000:0.0:1746143758.601220:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963626499712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143758.601274:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143758.601277:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143758.601278:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143758.601280:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143758.601282:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143758.601307:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3774:x1830963626499712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2999us (3246us total) trans 21474840045 rc 0/0 00000100:00100000:0.0:1746143758.601324:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10267 00000100:00100000:0.0:1746143758.603340:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143758.604677:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a4f82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.604683:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a4f82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.604688:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a4f82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.604692:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408c600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143758.604695:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a4f82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.604700:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a4f82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.604708:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143758.604710:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143758.604713:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a4f82 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.604717:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a4f82 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143758.606649:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.609121:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.612229:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.619037:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10276 00000100:00100000:0.0:1746143758.619045:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963621863680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143758.619073:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.619081:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b6200/0x87925e4cb73a4fe4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408a22 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.619091:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.619102:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.619107:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b6200/0x87925e4cb73a4fe4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a22 expref: 34 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.619117:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b6200/0x87925e4cb73a4fe4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a22 expref: 34 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.619124:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6200, rc 0) 00000100:00100000:0.0:1746143758.619787:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963621863680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 742us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.619792:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10276 00000100:00100000:0.0:1746143758.626187:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621865088 00000100:00100000:0.0:1746143758.626196:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621865088 00010000:00010000:0.0:1746143758.626226:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73a4f20 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089ab expref: 9 pid: 10936 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.626264:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4699 00000100:00100000:0.0:1746143758.626271:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963621865088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.626284:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.626289:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73a4f20 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089ab expref: 9 pid: 10936 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.626299:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73a4f20 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089ab expref: 9 pid: 10936 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.626332:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73a4f20 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089ab expref: 9 pid: 10936 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.626360:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143758.626365:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73a5000 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.626375:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73a5000 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.626381:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73a5000 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.626400:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.626433:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963621865088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 161us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.626441:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4699 00000100:00100000:0.0:1746143758.635812:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.636197:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.637164:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621865344 00000100:00100000:0.0:1746143758.637167:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621865344 00000100:00100000:0.0:1746143758.637184:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621865600 00000100:00100000:0.0:1746143758.637186:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621865600 00000100:00100000:0.0:1746143758.637196:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621865856 00000100:00100000:0.0:1746143758.637197:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621865856 00000100:00100000:0.0:1746143758.637214:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10289 00000100:00100000:0.0:1746143758.637219:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963621865344:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143758.637361:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963621865344:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 44us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.637379:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10289 00000100:00100000:0.0:1746143758.638723:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.639457:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.639485:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.639500:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.639573:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.641218:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.642907:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.665180:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.665279:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.667832:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.671904:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.676579:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626500864:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143758.676593:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626500992:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143758.676603:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626501120:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143758.676633:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a505b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143758.681091:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621868928 00000100:00100000:0.0:1746143758.681108:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621868928 00010000:00010000:0.0:1746143758.681123:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a4fb3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089ea expref: 8 pid: 6587 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.681148:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621869184 00000100:00100000:0.0:1746143758.681150:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621869184 00010000:00010000:0.0:1746143758.681177:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a4fcf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089f8 expref: 10 pid: 6587 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143758.681212:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4701 00000100:00100000:0.0:1746143758.681217:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963621868928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.681225:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.681229:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a4fb3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089ea expref: 11 pid: 6587 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.681236:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a4fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089ea expref: 11 pid: 6587 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.681648:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a4fb3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089ea expref: 11 pid: 6587 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143758.681661:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143758.681671:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a505b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.681676:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a505b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.681680:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.681707:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963621868928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 490us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.681713:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4701 00010000:00010000:0.0:1746143758.682546:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a505b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143758.682553:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a505b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00000040:00080000:0.0:1746143758.682846:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2481, 88 off206032 00000004:00080000:0.0:1746143758.682853:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 817906939994ns, next at 775898816462ns, rc = 0 00000100:00100000:0.0:1746143758.701494:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.704871:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.704970:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.705796:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.708851:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.731737:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.731780:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.731811:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.731837:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.731878:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.734101:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.745439:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.745499:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.745524:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.745557:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621871488 00000100:00100000:0.0:1746143758.745569:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621871488 00010000:00010000:0.0:1746143758.745615:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73a502a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a4c expref: 11 pid: 1945 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746143758.745649:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621871616 00000100:00100000:0.0:1746143758.745652:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621871616 00010000:00010000:0.0:1746143758.745667:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b6200/0x87925e4cb73a4fe4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a22 expref: 40 pid: 9585 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746143758.745685:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621871744 00000100:00100000:0.0:1746143758.745700:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621871744 00010000:00010000:0.0:1746143758.745717:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8a00/0x87925e4cb73a4f7b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089d5 expref: 18 pid: 9586 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746143758.745739:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4703 00000100:00100000:0.0:1746143758.745749:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963621871488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.745766:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.745793:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73a502a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a4c expref: 11 pid: 1945 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143758.745805:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73a502a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a4c expref: 11 pid: 1945 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143758.745838:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.745898:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963621871488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 149us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.745905:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4703 00000100:00100000:0.0:1746143758.745958:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4705 00000100:00100000:0.0:1746143758.745965:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963621871744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.745974:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.745985:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b8a00/0x87925e4cb73a4f7b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089d5 expref: 18 pid: 9586 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143758.745995:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b8a00/0x87925e4cb73a4f7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484089d5 expref: 18 pid: 9586 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143758.746010:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.746020:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.746030:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73a50a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2609152->3051519) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a8b expref: 39 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.746040:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73a50a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2609152->3051519) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a8b expref: 39 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.746081:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73a50a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2609152->3051519) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a8b expref: 39 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.746109:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626504064:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143758.758188:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.762873:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.763030:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.767007:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.767164:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626504320:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143758.767190:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73a50b6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a99 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.767202:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73a50b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a99 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.767220:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7c00, rc 0) 00000100:00100000:0.0:1746143758.767237:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963621872256:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3071us (4207us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143758.767243:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10319 00000100:00100000:0.0:1746143758.774885:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.774953:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.775054:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.775995:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.776017:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621873664 00000100:00100000:0.0:1746143758.776020:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621873664 00002000:00100000:0.0:1746143758.776039:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bdf100 x1830963621873664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:154/0 lens 504/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.776047:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf100 with x1830963621873664 ext(2097152->4194303) 00002000:00010000:0.0:1746143758.776050:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdf100 00000100:00100000:0.0:1746143758.776078:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2614 00000100:00100000:0.0:1746143758.776084:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963621873664:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143758.796501:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.796543:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.796569:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.796597:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.796626:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.796638:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.796650:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.796677:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.797254:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2619 00000100:00100000:0.0:1746143758.797262:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963621875200:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143758.797277:0:20387:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c528200/0x87925e4cb73a50e7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.797284:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.797285:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.797287:0:20387:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c528200/0x87925e4cb73a50e7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.797305:0:20387:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c528200/0x87925e4cb73a50e7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.798018:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2620 00000100:00100000:0.0:1746143758.798024:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963621874944:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143758.798042:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a50ee lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.798048:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.798049:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.798052:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a50ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.798059:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a50ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.823277:0:29555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d849c00/0x87925e4cb73a50e0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.823296:0:29555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849c00/0x87925e4cb73a50e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.823394:0:29555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d849c00/0x87925e4cb73a50e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.823402:0:29555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143758.823406:0:29555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d849c00/0x87925e4cb73a50e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.823424:0:29555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d849c00/0x87925e4cb73a50e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.823443:0:29555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d849c00/0x87925e4cb73a50e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.823450:0:29555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d849c00/0x87925e4cb73a50e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.823544:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963621875072:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 26487us (26914us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143758.823555:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2618 00000100:00100000:0.0:1746143758.830603:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.834139:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.840841:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.841697:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.868839:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.883966:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963621876992:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 11572us (11831us total) trans 17179872744 rc 0/0 00000100:00100000:0.0:1746143758.883978:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1212 00002000:00100000:0.0:1746143758.883988:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3559424->4153343) req@ffff880095c6bb80 x1830963621876992/t17179872744(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.883996:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6bb80 with x1830963621876992 ext(3559424->4153343) 00010000:00010000:0.0:1746143758.884005:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d551400/0x87925e4cb73a50c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3559424->4153343) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408aa7 expref: 22 pid: 9586 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143758.884033:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d551400/0x87925e4cb73a50c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3559424->4153343) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408aa7 expref: 22 pid: 9586 timeout: 918 lvb_type: 0 00002000:00010000:0.0:1746143758.884040:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c6bb80 00000100:00100000:0.0:1746143758.889237:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143758.891229:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d849400/0x87925e4cb73a50f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.891238:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849400/0x87925e4cb73a50f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.900083:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.903544:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.920843:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.924690:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.938399:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.938436:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.938536:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.945339:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10327 00000100:00100000:0.0:1746143758.945354:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963621879424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143758.945371:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.945387:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73a511f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408aca expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.945444:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626505984:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143758.945542:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.957206:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.961978:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.962029:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.967356:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.967407:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.967437:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.968511:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.969100:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10331 00000100:00100000:0.0:1746143758.969108:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963621880832:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143758.969114:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.969122:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a513b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408ae6 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.969143:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626507264:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143758.969267:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.970626:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143758.975748:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime: 1746143758 -> 1746143759 00000100:00100000:0.0:1746143758.975759:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626507264:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143758.975773:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a513b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ae6 expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.975782:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a513b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ae6 expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.975792:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55a400, rc 0) 00000100:00100000:0.0:1746143758.975820:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963621880832:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6714us (7309us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143758.975825:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10331 00000100:00100000:0.0:1746143758.978733:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.979683:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621881344 00000100:00100000:0.0:1746143758.979687:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621881344 00010000:00010000:0.0:1746143758.979700:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a5023 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a3e expref: 10 pid: 1945 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746143758.979766:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4719 00000100:00100000:0.0:1746143758.979771:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963621881344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.979776:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.979784:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a5023 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a3e expref: 10 pid: 1945 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746143758.979798:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a5023 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a3e expref: 10 pid: 1945 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746143758.979852:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a5023 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a3e expref: 10 pid: 1945 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746143758.979859:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.979861:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.979867:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a5142 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408af4 expref: 9 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.979874:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a5142 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408af4 expref: 9 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.979903:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a5142 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408af4 expref: 9 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.979925:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e95180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626507776:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143758.979977:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.980400:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.980432:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.980452:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.980489:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.983446:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.992662:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.992719:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143758.998220:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.005047:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.017306:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.019100:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143759.019897:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143759.022800:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.022841:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143759.023866:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143759.030626:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.034564:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.038242:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.039001:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.041420:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.045346:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.048827:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.055651:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.064327:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621886080 00000100:00100000:0.0:1746143759.064335:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621886080 00002000:00100000:0.0:1746143759.064375:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1150976->1155071) req@ffff880090e25880 x1830963621886080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.064384:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25880 with x1830963621886080 ext(1150976->1155071) 00002000:00010000:0.0:1746143759.064389:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e25880 00000100:00100000:0.0:1746143759.064416:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2628 00000100:00100000:0.0:1746143759.064423:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963621886080:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143759.064579:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963621886080:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 156us (588us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143759.064585:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2628 00002000:00100000:0.0:1746143759.064590:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1150976->1155071) req@ffff880090e25880 x1830963621886080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.064597:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25880 with x1830963621886080 ext(1150976->1155071) 00002000:00010000:0.0:1746143759.064600:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e25880 00000100:00100000:0.0:1746143759.066701:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.073660:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.081661:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143759.082867:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143759.095319:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.102105:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.112459:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.142634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.154416:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.154488:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.157592:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.161514:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.169726:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.171165:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.179511:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.195765:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.199118:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.203502:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.203590:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.204880:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.209795:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.210243:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.210264:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621890432 00000100:00100000:0.0:1746143759.210268:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621890432 00000100:00100000:0.0:1746143759.210310:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4485 00000100:00100000:0.0:1746143759.210317:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:31364:x1830963621890432:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143759.210527:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:31364:x1830963621890432:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 208us (282us total) trans 8589943161 rc 0/0 00000100:00100000:0.0:1746143759.210534:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4485 00000100:00100000:0.0:1746143759.210612:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.214005:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.218326:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.222264:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.228369:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621891712 00000100:00100000:0.0:1746143759.228379:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621891712 00002000:00100000:0.0:1746143759.228432:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8801368e8380 x1830963621891712/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.228459:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8380 with x1830963621891712 ext(1048576->2097151) 00002000:00010000:0.0:1746143759.228464:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8380 00000100:00100000:0.0:1746143759.228495:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2633 00000100:00100000:0.0:1746143759.228503:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963621891712:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143759.229292:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.230330:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.230348:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.235838:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.235864:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.235878:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621891968 00000100:00100000:0.0:1746143759.235882:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621891968 00000100:00100000:0.0:1746143759.235904:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621892224 00000100:00100000:0.0:1746143759.235906:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621892224 00000100:00100000:0.0:1746143759.235932:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10361 00000100:00100000:0.0:1746143759.235937:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963621891968:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143759.235944:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143759.235950:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73a5284 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408baa expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143759.235974:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626512256:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143759.236003:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.236014:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10362 00000100:00100000:0.0:1746143759.236018:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963621892224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143759.236023:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143759.236040:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33400/0x87925e4cb73a528b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408bb8 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143759.236059:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087d73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626512384:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143759.236075:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.236105:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.236205:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963621891712:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7703us (7962us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143759.236212:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2633 00002000:00100000:0.0:1746143759.236222:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8801368e8380 x1830963621891712/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.236230:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8380 with x1830963621891712 ext(1048576->2097151) 00002000:00010000:0.0:1746143759.236234:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8380 00000100:00100000:0.0:1746143759.240935:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626512256:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143759.240959:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73a5284 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408baa expref: 41 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.240968:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73a5284 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408baa expref: 41 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.240986:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33c00, rc 0) 00000100:00100000:0.0:1746143759.241032:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963621891968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5092us (5193us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143759.241040:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10361 00000100:00100000:0.0:1746143759.247197:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.248189:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.248216:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.248230:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621892864 00000100:00100000:0.0:1746143759.248233:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621892864 00000100:00100000:0.0:1746143759.248249:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621892992 00000100:00100000:0.0:1746143759.248251:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621892992 00000100:00100000:0.0:1746143759.248261:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10366 00000100:00100000:0.0:1746143759.248266:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963621892864:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143759.248274:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143759.248284:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73a52a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408bdb expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143759.248311:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087d73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626512896:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143759.248341:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.248362:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.250261:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.250324:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.254358:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.254822:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.264555:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963621893632:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 9143us (9731us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143759.264565:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2634 00002000:00100000:0.0:1746143759.264576:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880094714700 x1830963621893632/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.264586:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094714700 with x1830963621893632 ext(1048576->2097151) 00002000:00010000:0.0:1746143759.264591:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094714700 00000100:00100000:0.0:1746143759.264607:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621893888 00000100:00100000:0.0:1746143759.264614:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621893888 00002000:00100000:0.0:1746143759.264659:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b3:0x0] (335872->1048575) req@ffff88009391e300 x1830963621893888/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.264665:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391e300 with x1830963621893888 ext(335872->1048575) 00010000:00010000:0.0:1746143759.264672:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73a5222 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408b80 expref: 17 pid: 3135 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143759.264686:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73a5222 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408b80 expref: 17 pid: 3135 timeout: 918 lvb_type: 0 00002000:00010000:0.0:1746143759.264692:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391e300 00000100:00100000:0.0:1746143759.264715:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1217 00000100:00100000:0.0:1746143759.264722:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963621893888:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143759.271782:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.273236:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621894144 00000100:00100000:0.0:1746143759.273242:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621894144 00000100:00100000:0.0:1746143759.275290:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963621893888:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 10561us (11377us total) trans 21474840058 rc 0/0 00000100:00100000:0.0:1746143759.275301:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1217 00002000:00100000:0.0:1746143759.275312:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b3:0x0] (335872->1048575) req@ffff88009391e300 x1830963621893888/t21474840058(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.275322:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391e300 with x1830963621893888 ext(335872->1048575) 00010000:00010000:0.0:1746143759.275332:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73a5222 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408b80 expref: 23 pid: 3135 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143759.275346:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73a5222 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408b80 expref: 23 pid: 3135 timeout: 918 lvb_type: 0 00002000:00010000:0.0:1746143759.275368:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391e300 00000100:00100000:0.0:1746143759.278655:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626513792:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143759.278684:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a52d8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c0c expref: 20 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.278696:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a52d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c0c expref: 20 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.278710:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123269200, rc 0) 00000100:00100000:0.0:1746143759.278743:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963621894272:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4666us (5687us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143759.278750:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10373 00000100:00100000:0.0:1746143759.281110:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4734 00000100:00100000:0.0:1746143759.281121:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963621894400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143759.281137:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143759.281156:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73a5222 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408b80 expref: 19 pid: 3135 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143759.281167:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73a5222 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408b80 expref: 19 pid: 3135 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143759.281188:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73a5222 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408b80 expref: 19 pid: 3135 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143759.281222:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.281224:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.281232:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800972eda00/0x87925e4cb73a52c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408bf7 expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.281240:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800972eda00/0x87925e4cb73a52c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408bf7 expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.281274:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800972eda00/0x87925e4cb73a52c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408bf7 expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143759.281285:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094714e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626514048:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143759.281395:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.282439:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.285440:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.286485:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.294331:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.306649:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.306880:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.310341:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.312001:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.318653:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2639 00000100:00100000:0.0:1746143759.318660:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963621896448:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143759.342650:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.347342:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.349143:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.349580:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.354141:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.354541:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.357585:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.357685:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.363357:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.373145:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.373220:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.375134:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.378339:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.380411:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.380723:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.387265:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.394239:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.429184:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.441520:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.462551:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.462597:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.462634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.462883:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2644 00000100:00100000:0.0:1746143759.462890:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963621901568:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143759.514653:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.539402:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.545597:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.546814:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.554009:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.558359:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.565589:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.629507:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.647454:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.648622:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.651040:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.663522:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.664829:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.687422:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.690487:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.696564:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621905152 00000100:00100000:0.0:1746143759.696575:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621905152 00000100:00100000:0.0:1746143759.696630:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 674 00000100:00100000:0.0:1746143759.696638:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963621905152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143759.696655:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143759.696681:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a53d4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c91 expref: 21 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.696701:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143759.696705:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143759.697112:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963621905152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 473us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.697119:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 674 00002000:00010000:0.0:1746143759.700218:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143758 -> 1746143760 00002000:00010000:0.0:1746143759.700222:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143758 -> 1746143760 00002000:00010000:0.0:1746143759.700223:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143759 -> 1746143760 00000100:00100000:0.0:1746143759.700236:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626516736:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143759.700255:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73a53e9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c9f expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.700273:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73a53e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c9f expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.700734:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7200, rc 0) 00000100:00100000:0.0:1746143759.711664:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.711713:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.711742:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.711778:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.711825:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.711844:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621906048 00000100:00100000:0.0:1746143759.711848:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621906048 00000100:00100000:0.0:1746143759.711874:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1053 00000100:00100000:0.0:1746143759.711879:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2010:x1830963621906176:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143759.712094:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2010:x1830963621906176:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 213us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.712100:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1053 00000100:00100000:0.0:1746143759.715968:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.736129:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.736230:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.740238:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.745048:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.750848:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.754007:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.755478:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.757516:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.757566:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.762064:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.762581:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963621907584:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 4732us (5068us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143759.762588:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2653 00002000:00100000:0.0:1746143759.762599:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880092f10000 x1830963621907584/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.762607:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f10000 with x1830963621907584 ext(2097152->3145727) 00002000:00010000:0.0:1746143759.762611:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f10000 00000100:00100000:0.0:1746143759.766196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.770264:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.770506:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621908224 00000100:00100000:0.0:1746143759.770512:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621908224 00002000:00100000:0.0:1746143759.770561:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2842623) req@ffff880129dc0700 x1830963621908224/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.770570:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0700 with x1830963621908224 ext(2097152->2842623) 00010000:00010000:0.0:1746143759.770577:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c600/0x87925e4cb73a5372 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2842623) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c7c expref: 40 pid: 9585 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143759.770589:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7c600/0x87925e4cb73a5372 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2842623) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c7c expref: 40 pid: 9585 timeout: 918 lvb_type: 0 00002000:00010000:0.0:1746143759.770595:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129dc0700 00000100:00100000:0.0:1746143759.770624:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1224 00000100:00100000:0.0:1746143759.770635:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963621908224:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143759.780865:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963621908224:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10222us (10593us total) trans 17179872751 rc 0/0 00000100:00100000:0.0:1746143759.780886:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1224 00002000:00100000:0.0:1746143759.780897:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2842623) req@ffff880129dc0700 x1830963621908224/t17179872751(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.780907:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0700 with x1830963621908224 ext(2097152->2842623) 00010000:00010000:0.0:1746143759.780932:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c600/0x87925e4cb73a5372 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2842623) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c7c expref: 42 pid: 9585 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143759.780947:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7c600/0x87925e4cb73a5372 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2842623) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c7c expref: 42 pid: 9585 timeout: 919 lvb_type: 0 00002000:00010000:0.0:1746143759.780954:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129dc0700 00000100:00100000:0.0:1746143759.785623:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.788174:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.788404:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.788443:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.795977:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.800751:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621909888 00000100:00100000:0.0:1746143759.800762:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621909888 00002000:00100000:0.0:1746143759.800813:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88012b134450 x1830963621909888/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.800823:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b134450 with x1830963621909888 ext(2097152->4194303) 00002000:00010000:0.0:1746143759.800828:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b134450 00000100:00100000:0.0:1746143759.800848:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621910144 00000100:00100000:0.0:1746143759.800850:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621910144 00002000:00100000:0.0:1746143759.800861:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff88012b7a8a80 x1830963621910144/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.800881:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8a80 with x1830963621910144 ext(3145728->4194303) 00002000:00010000:0.0:1746143759.800884:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a8a80 00000100:00100000:0.0:1746143759.800908:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2656 00000100:00100000:0.0:1746143759.800947:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963621909888:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143759.810573:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.819988:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.825953:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.832689:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.840422:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.845047:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.852411:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.854578:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.861096:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.864282:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.864315:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.864339:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.864363:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.864375:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.864400:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.864418:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621912448 00000100:00100000:0.0:1746143759.864425:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621912448 00000100:00100000:0.0:1746143759.864455:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621912576 00000100:00100000:0.0:1746143759.864457:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621912576 00000100:00100000:0.0:1746143759.864467:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621912832 00000100:00100000:0.0:1746143759.864469:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621912832 00000100:00100000:0.0:1746143759.864479:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621912704 00000100:00100000:0.0:1746143759.864480:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621912704 00000100:00100000:0.0:1746143759.864501:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621912960 00000100:00100000:0.0:1746143759.864502:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621912960 00000100:00100000:0.0:1746143759.864511:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621913088 00000100:00100000:0.0:1746143759.864513:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621913088 00000100:00100000:0.0:1746143759.864525:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10399 00000100:00100000:0.0:1746143759.864532:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963621912448:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143759.864548:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143759.864565:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a546e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408cf3 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143759.864613:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626518912:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143759.865822:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.873163:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.875510:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.879032:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.881671:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143759.881927:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a54b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143759.881933:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a54b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143759.881983:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143759.881987:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143759.882003:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a54b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143759.882032:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a54ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d24 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.882049:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a54b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d24 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.882066:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143759.882068:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143759.882070:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6200, rc 0) 00000100:00100000:0.0:1746143759.882108:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:31393:x1830963621913600:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2798us (3085us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.882113:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12538 00000100:00100000:0.0:1746143759.885950:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.885997:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.893724:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.899507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.899852:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.899882:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.899897:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.900126:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.900403:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.900975:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10410 00000100:00100000:0.0:1746143759.900982:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963621914752:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143759.900998:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092459200/0x87925e4cb73a54ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.901009:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73a5299 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408bcd expref: 21 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.901015:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73a547c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d08 expref: 13 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.901037:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73a5302 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c2f expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.901042:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.901044:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.901046:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092459200/0x87925e4cb73a54ec lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.901063:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73a5302 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c2f expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.901071:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73a5302 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c2f expref: 34 pid: 3135 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.901093:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626519808:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143759.901121:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73a547c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d08 expref: 13 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.901129:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73a547c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d08 expref: 13 pid: 12328 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143759.901136:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626520064:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143759.901156:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73a5299 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408bcd expref: 21 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.901172:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73a5299 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408bcd expref: 21 pid: 3134 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.901179:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626520320:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143759.901195:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.901211:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10411 00000100:00100000:0.0:1746143759.901217:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2008:x1830963621915008:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143759.901231:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a54f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.901241:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a540c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408cc2 expref: 20 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.901247:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73a5491 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d16 expref: 15 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.901252:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.901253:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.901255:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a54f3 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.901268:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73a5491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d16 expref: 15 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.901275:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73a5491 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d16 expref: 15 pid: 1945 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143759.901287:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626520448:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143759.901313:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a540c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408cc2 expref: 20 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.902215:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a540c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408cc2 expref: 20 pid: 9585 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.902224:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626520576:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143759.902488:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.905230:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.905244:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.905278:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.906027:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.923279:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.923319:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.923338:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.923355:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.923366:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.923397:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.923417:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621916416 00000100:00100000:0.0:1746143759.923420:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621916416 00002000:00100000:0.0:1746143759.923438:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1245184->1454079) req@ffff880091d4f800 x1830963621916416/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.923445:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4f800 with x1830963621916416 ext(1245184->1454079) 00010000:00010000:0.0:1746143759.923452:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73a5436 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408cd0 expref: 40 pid: 9585 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143759.923474:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73a5436 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408cd0 expref: 40 pid: 9585 timeout: 919 lvb_type: 0 00002000:00010000:0.0:1746143759.923480:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d4f800 00000100:00100000:0.0:1746143759.923493:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1226 00000100:00100000:0.0:1746143759.923499:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963621916416:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143759.923615:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.923684:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.934572:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143759.935356:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880124adf800/0x87925e4cb73a5501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.935365:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124adf800/0x87925e4cb73a5501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.935383:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880124adf800/0x87925e4cb73a5501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.935390:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880124adf800/0x87925e4cb73a5501 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.935397:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880124adf800/0x87925e4cb73a5501 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.935405:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880124adf800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143759.935417:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880124adf800/0x87925e4cb73a5501 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.935424:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880124adf800/0x87925e4cb73a5501 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.935434:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880124adf800/0x87925e4cb73a5501 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.935439:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124adf800/0x87925e4cb73a5501 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143759.935500:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963621914496:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 33893us (35601us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.935508:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10412 00000100:00100000:0.0:1746143759.940785:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621917568 00000100:00100000:0.0:1746143759.940790:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621917568 00000100:00100000:0.0:1746143759.940882:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12541 00000100:00100000:0.0:1746143759.940889:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:31393:x1830963621917568:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:0.0:1746143759.940948:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1746143759.940966:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a54b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d24 expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.940984:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a5069 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a6f expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.940992:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143759.940996:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143759.941029:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.941040:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a5325 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c36 expref: 21 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941048:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76000/0x87925e4cb73a53b1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c8a expref: 278 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941054:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a505b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a61 expref: 278 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941060:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a5062 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a68 expref: 278 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941065:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a5093 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a7d expref: 21 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941071:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73a5261 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408b9c expref: 278 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941077:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 9/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.941115:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73a5261 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408b9c expref: 278 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941127:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73a5261 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408b9c expref: 278 pid: 10936 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.941140:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521216:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143759.941220:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a5093 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a7d expref: 21 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941228:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a5093 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a7d expref: 21 pid: 6587 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.941235:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521344:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143759.941259:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a5062 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a68 expref: 278 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941265:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a5062 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a68 expref: 278 pid: 6587 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.941271:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521472:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143759.941290:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a505b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a61 expref: 278 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941296:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a505b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a61 expref: 278 pid: 10936 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.941302:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521600:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143759.941320:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76000/0x87925e4cb73a53b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c8a expref: 278 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941326:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76000/0x87925e4cb73a53b1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c8a expref: 278 pid: 10936 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.941342:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521728:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143759.941360:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a5325 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c36 expref: 21 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.941367:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a5325 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c36 expref: 21 pid: 10936 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.941373:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521856:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143759.941388:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.942299:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621918336 00000100:00100000:0.0:1746143759.942302:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621918336 00000100:00100000:0.0:1746143759.946730:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521216:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143759.946739:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a5093 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408a7d expref: 21 pid: 6587 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.946750:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521344:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143759.946756:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521472:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143759.946761:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521600:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143759.946767:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521728:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143759.946771:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626521856:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143759.947260:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143759.947541:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621918976 00000100:00100000:0.0:1746143759.947555:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621918976 00010000:00010000:0.0:1746143759.947569:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a5325 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c36 expref: 21 pid: 10936 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143759.947608:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4772 00000100:00100000:0.0:1746143759.947613:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963621918976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143759.947620:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143759.947624:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a5325 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c36 expref: 21 pid: 10936 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143759.947632:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a5325 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c36 expref: 21 pid: 10936 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143759.947644:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a5325 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408c36 expref: 21 pid: 10936 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143759.947652:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143759.947655:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.947661:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.947668:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.947685:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143759.947704:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963621918976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 91us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.947710:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4772 00010000:00010000:0.0:1746143759.947737:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.947743:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143759.956074:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626523008 00000100:00100000:0.0:1746143759.956078:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626523008 00000100:00100000:0.0:1746143759.956103:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626522240 00000100:00100000:0.0:1746143759.956105:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626522240 00000100:00100000:0.0:1746143759.956115:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626522880 00000100:00100000:0.0:1746143759.956116:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626522880 00000100:00100000:0.0:1746143759.956121:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626523520 00000100:00100000:0.0:1746143759.956123:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626523520 00000100:00100000:0.0:1746143759.956128:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626523392 00000100:00100000:0.0:1746143759.956130:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626523392 00000100:00100000:0.0:1746143759.956135:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626523904 00000100:00100000:0.0:1746143759.956137:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626523904 00000100:00100000:0.0:1746143759.956146:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10423 00000100:00100000:0.0:1746143759.956150:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963626522240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143759.956197:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4676512 -> 4676512 00002000:00010000:0.0:1746143759.956199:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143759.956201:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143759.956203:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:0.0:1746143759.956205:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5048 -> 5048 00000100:00100000:0.0:1746143759.956227:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963626522240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (224us total) trans 21474840065 rc 0/0 00000100:00100000:0.0:1746143759.956233:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10423 00000100:00100000:0.0:1746143759.956244:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10425 00000100:00100000:0.0:1746143759.956248:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963626523520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143759.956312:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963626523520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (272us total) trans 21474840066 rc 0/0 00000100:00100000:0.0:1746143759.956317:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10425 00000100:00100000:0.0:1746143759.956327:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10426 00000100:00100000:0.0:1746143759.956331:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3774:x1830963626523392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143759.956376:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143759.956378:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143759.956380:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:0.0:1746143759.956382:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143759.956383:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143759.956402:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3774:x1830963626523392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (323us total) trans 17179872753 rc 0/0 00000100:00100000:0.0:1746143759.956408:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10426 00000100:00100000:0.0:1746143759.962405:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143759.962771:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.962779:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.962785:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.962790:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7d600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143759.962793:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.962799:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.962820:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143759.962822:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143759.962825:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143759.962830:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a5539 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143759.964800:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.971489:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621919616 00000100:00100000:0.0:1746143759.971501:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621919616 00000100:00100000:0.0:1746143759.971558:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12544 00000100:00100000:0.0:1746143759.971567:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31393:x1830963621919616:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143759.971589:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143759.971607:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a556a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408d7f expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.971706:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73a5571 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143759.971720:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73a5571 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143759.971730:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73a5571 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143759.971757:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143759.971762:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143759.971777:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73a5571 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143759.971815:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a556a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d7f expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.971829:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73a5571 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d7f expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.971836:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143759.971839:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143759.971843:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551400, rc 0) 00000100:00100000:0.0:1746143759.971908:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:31393:x1830963621919616:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 342us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.971933:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12544 00000100:00100000:0.0:1746143759.977581:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.977620:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.977941:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.978255:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.978267:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.978551:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10439 00000100:00100000:0.0:1746143759.978558:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963621920256:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143759.978565:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143759.978572:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550a00/0x87925e4cb73a558d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408da2 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.978581:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.978582:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.978587:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550a00/0x87925e4cb73a558d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408da2 expref: 13 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.978612:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550a00/0x87925e4cb73a558d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408da2 expref: 13 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.978618:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550a00, rc 0) 00000100:00100000:0.0:1746143759.980861:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963621920256:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2302us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.980866:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10439 00000100:00100000:0.0:1746143759.982515:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.982545:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.982568:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.982617:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.982937:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621921152 00000100:00100000:0.0:1746143759.982940:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621921152 00002000:00100000:0.0:1746143759.982950:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092ef1f80 x1830963621921152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.982957:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1f80 with x1830963621921152 ext(1048576->2097151) 00002000:00010000:0.0:1746143759.982960:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef1f80 00000100:00100000:0.0:1746143759.982974:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621921408 00000100:00100000:0.0:1746143759.982975:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621921408 00002000:00100000:0.0:1746143759.982984:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092ef0a80 x1830963621921408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.982990:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0a80 with x1830963621921408 ext(1048576->2097151) 00002000:00010000:0.0:1746143759.982993:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef0a80 00000100:00100000:0.0:1746143759.983112:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2662 00000100:00100000:0.0:1746143759.983117:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963621921152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143759.984018:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.991047:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.991094:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143759.991119:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621921920 00000100:00100000:0.0:1746143759.991128:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621921920 00000100:00100000:0.0:1746143759.991165:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621922176 00000100:00100000:0.0:1746143759.991169:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621922176 00000100:00100000:0.0:1746143759.991195:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10442 00000100:00100000:0.0:1746143759.991205:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963621921920:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143759.993684:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963621921920:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 2476us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.993692:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10442 00000100:00100000:0.0:1746143760.005642:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963621921152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22515us (23063us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143760.005652:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2662 00002000:00100000:0.0:1746143760.005662:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092ef1f80 x1830963621921152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.005671:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1f80 with x1830963621921152 ext(1048576->2097151) 00002000:00010000:0.0:1746143760.005676:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef1f80 00000100:00100000:0.0:1746143760.012564:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.012604:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.012631:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.012644:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.012655:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.012680:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.030710:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.030758:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.030797:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.032629:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12547 00000100:00100000:0.0:1746143760.032636:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31400:x1830963621923456:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143760.032643:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.032651:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db03200/0x87925e4cb73a55e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408db7 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.032690:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a55e8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143760.032697:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a55e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143760.032704:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a55e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746143760.032720:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143760.032724:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143760.032736:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a55e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143760.032752:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db03200/0x87925e4cb73a55e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408db7 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.032768:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a55e8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408db7 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.032774:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143760.032776:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143760.032779:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db02800, rc 0) 00000100:00100000:0.0:1746143760.032806:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:31400:x1830963621923456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 171us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.032811:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12547 00000100:00080000:0.0:1746143760.032826:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746143760.041103:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143760.052226:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.052275:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.052290:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.052312:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.052323:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.052332:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.052341:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.052362:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.057704:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621926912 00000100:00100000:0.0:1746143760.057713:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621926912 00002000:00100000:0.0:1746143760.057746:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012b7ab100 x1830963621926912/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.057754:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ab100 with x1830963621926912 ext(2097152->4194303) 00002000:00010000:0.0:1746143760.057759:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7ab100 00000100:00100000:0.0:1746143760.062799:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.062832:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.062852:0:29558:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 11 min 3 max 116 00000100:00100000:0.0:1746143760.062860:0:29558:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost_io00_011' 00000100:00100000:0.0:1746143760.062896:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.062931:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.063096:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621927424 00000100:00100000:0.0:1746143760.063103:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621927424 00002000:00100000:0.0:1746143760.063136:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b71180 x1830963621927424/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.063155:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71180 with x1830963621927424 ext(0->1048575) 00002000:00010000:0.0:1746143760.063160:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b71180 00000100:00100000:0.0:1746143760.063172:0:29558:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 11 min 3 max 116 00000100:00100000:0.0:1746143760.063176:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621927680 00000100:00100000:0.0:1746143760.063178:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621927680 00002000:00100000:0.0:1746143760.063190:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092b70380 x1830963621927680/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.063196:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70380 with x1830963621927680 ext(1048576->2097151) 00002000:00010000:0.0:1746143760.063198:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b70380 00000100:00100000:0.0:1746143760.063203:0:29558:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 11 min 3 max 116 00000100:00100000:0.0:1746143760.063205:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621927936 00000100:00100000:0.0:1746143760.063207:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621927936 00002000:00100000:0.0:1746143760.063214:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800921cd500 x1830963621927936/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.063219:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cd500 with x1830963621927936 ext(1048576->2097151) 00002000:00010000:0.0:1746143760.063221:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cd500 00000100:00100000:0.0:1746143760.063224:0:29558:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 11 min 3 max 116 00000100:00100000:0.0:1746143760.063227:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621928192 00000100:00100000:0.0:1746143760.063228:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621928192 00002000:00100000:0.0:1746143760.063234:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff8800921cf800 x1830963621928192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.063239:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cf800 with x1830963621928192 ext(1048576->2097151) 00002000:00010000:0.0:1746143760.063241:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cf800 00000100:00100000:0.0:1746143760.063642:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2674 00000100:00100000:0.0:1746143760.063651:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963621926912:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143760.071572:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.097315:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143760.104999:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129d10000/0x87925e4cb73a5651 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.105012:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129d10000/0x87925e4cb73a5651 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.105018:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129d10000/0x87925e4cb73a5651 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.105023:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d10000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143760.105027:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129d10000/0x87925e4cb73a5651 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.105033:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129d10000/0x87925e4cb73a5651 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.105046:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129d10000/0x87925e4cb73a5651 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.105051:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d10000/0x87925e4cb73a5651 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143760.105107:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963621926272:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 50715us (52739us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143760.105115:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2672 00000100:00100000:0.0:1746143760.116368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.116406:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.116427:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.120866:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626525056 00000100:00100000:0.0:1746143760.120873:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626525056 00000100:00100000:0.0:1746143760.123740:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10478 00000100:00100000:0.0:1746143760.123747:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963626525056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143760.123791:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4676512 -> 4676512 00002000:00010000:0.0:1746143760.123793:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143760.123795:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143760.123797:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:0.0:1746143760.123798:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5048 -> 5048 00000100:00100000:0.0:1746143760.123821:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963626525056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (3007us total) trans 21474840080 rc 0/0 00000100:00100000:0.0:1746143760.123825:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10478 00000100:00080000:0.0:1746143760.123930:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143760.123934:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143760.124071:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963621926912:12345-192.168.202.3@tcp:3:cat.0 Request processed in 60419us (66422us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143760.124087:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2674 00002000:00100000:0.0:1746143760.124094:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012b7ab100 x1830963621926912/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.124102:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ab100 with x1830963621926912 ext(2097152->4194303) 00002000:00010000:0.0:1746143760.124106:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7ab100 00000100:00100000:0.0:1746143760.124205:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.130667:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.139007:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.145109:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.145137:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.145157:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.145178:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.145202:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621929728 00000100:00100000:0.0:1746143760.145210:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621929728 00000100:00100000:0.0:1746143760.145245:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621929984 00000100:00100000:0.0:1746143760.145246:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621929984 00000100:00100000:0.0:1746143760.145259:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10479 00000100:00100000:0.0:1746143760.145266:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963621929728:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143760.145407:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143760.145410:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143760.145412:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143759 -> 1746143760 00002000:00010000:0.0:1746143760.145414:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143760.145416:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:0.0:1746143760.145453:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963621929728:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 188us (352us total) trans 21474840081 rc 0/0 00000100:00100000:0.0:1746143760.145458:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10479 00000100:00100000:0.0:1746143760.145469:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621930240 00000100:00100000:0.0:1746143760.145472:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621930240 00000100:00100000:0.0:1746143760.145480:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621929856 00000100:00100000:0.0:1746143760.145481:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621929856 00000100:00100000:0.0:1746143760.145490:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10480 00000100:00100000:0.0:1746143760.145494:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963621929984:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143760.145548:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143760.145550:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143759 -> 1746143760 00002000:00010000:0.0:1746143760.145552:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143758 -> 1746143760 00002000:00010000:0.0:1746143760.145567:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143759 -> 1746143760 00002000:00010000:0.0:1746143760.145569:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746143760.145588:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963621929984:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 92us (449us total) trans 17179872770 rc 0/0 00000100:00100000:0.0:1746143760.145593:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10480 00000100:00100000:0.0:1746143760.145602:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10481 00000100:00100000:0.0:1746143760.145607:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963621930240:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143760.145646:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4676512 -> 4676512 00002000:00010000:0.0:1746143760.145648:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143760.145650:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143760.145652:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143759 -> 1746143760 00002000:00010000:0.0:1746143760.145653:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5048 -> 5048 00000100:00100000:0.0:1746143760.145667:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963621930240:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 60us (509us total) trans 21474840082 rc 0/0 00000100:00100000:0.0:1746143760.145672:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10481 00000100:00100000:0.0:1746143760.145681:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10482 00000100:00100000:0.0:1746143760.145686:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963621929856:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143760.145721:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143760.145723:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143760.145725:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143759 -> 1746143760 00002000:00010000:0.0:1746143760.145727:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143760.145729:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143760.145743:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963621929856:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 57us (564us total) trans 17179872771 rc 0/0 00000100:00100000:0.0:1746143760.145747:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10482 00000100:00100000:0.0:1746143760.145781:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.145793:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621930112 00000100:00100000:0.0:1746143760.145796:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621930112 00000100:00100000:0.0:1746143760.145818:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10483 00000100:00100000:0.0:1746143760.145822:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963621930112:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143760.146341:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143760.146344:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143758 -> 1746143760 00002000:00010000:0.0:1746143760.146345:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143758 -> 1746143760 00002000:00010000:0.0:1746143760.146347:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143759 -> 1746143760 00002000:00010000:0.0:1746143760.146348:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143760.146364:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963621930112:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 541us (583us total) trans 21474840083 rc 0/0 00000100:00100000:0.0:1746143760.146369:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10483 00000100:00100000:0.0:1746143760.148247:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.151690:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.160695:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621931008 00000100:00100000:0.0:1746143760.160705:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621931008 00000100:00100000:0.0:1746143760.160751:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10485 00000100:00100000:0.0:1746143760.160758:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:31402:x1830963621931008:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143760.160777:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.160795:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x87925e4cb73a569e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408e0b expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.160823:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73a5532 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d4e expref: 43 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.160831:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a55ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408dcc expref: 23 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.160846:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a5578 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d8d expref: 17 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.160852:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.160854:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.160857:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x87925e4cb73a569e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1839104->2097151] (req 1839104->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e0b expref: 23 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.160885:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a5578 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d8d expref: 17 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.160896:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a5578 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d8d expref: 17 pid: 12327 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143760.160907:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626526976:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143760.161022:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a55ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408dcc expref: 23 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.161030:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a55ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408dcc expref: 23 pid: 3135 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143760.161037:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626527104:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143760.161058:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73a5532 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d4e expref: 43 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.161073:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73a5532 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d4e expref: 43 pid: 1947 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143760.161090:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626527232:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143760.161106:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.168711:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.168752:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.168777:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.168833:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626526976:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143760.168865:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626527104:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143760.168889:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626527232:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143760.168945:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x87925e4cb73a569e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1839104->2097151] (req 1839104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e0b expref: 24 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.168960:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107a00, rc 0) 00000100:00100000:0.0:1746143760.169004:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:31402:x1830963621931008:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8245us (8454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.169013:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10485 00000100:00100000:0.0:1746143760.169058:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.169602:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621931904 00000100:00100000:0.0:1746143760.169606:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621931904 00010000:00010000:0.0:1746143760.169625:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a5578 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d8d expref: 18 pid: 12327 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143760.169659:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4777 00000100:00100000:0.0:1746143760.169664:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2011:x1830963621931904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.169673:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.169684:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a5578 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d8d expref: 18 pid: 12327 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.169692:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a5578 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d8d expref: 18 pid: 12327 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.169709:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a5578 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d8d expref: 18 pid: 12327 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.169721:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.169736:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963621931904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.169741:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4777 00000100:00100000:0.0:1746143760.169852:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.169865:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621932032 00000100:00100000:0.0:1746143760.169868:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621932032 00010000:00010000:0.0:1746143760.169878:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73a5532 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d4e expref: 44 pid: 1947 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143760.169891:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4778 00000100:00100000:0.0:1746143760.169896:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963621932032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.169908:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.169930:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73a5532 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d4e expref: 44 pid: 1947 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.169938:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73a5532 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d4e expref: 44 pid: 1947 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.169949:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73a5532 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d4e expref: 44 pid: 1947 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.169956:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.169969:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963621932032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 73us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.169975:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4778 00000100:00100000:0.0:1746143760.176552:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621932544 00000100:00100000:0.0:1746143760.176564:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621932544 00002000:00100000:0.0:1746143760.176601:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88012b7a8700 x1830963621932544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.176609:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8700 with x1830963621932544 ext(2097152->4194303) 00002000:00010000:0.0:1746143760.176614:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7a8700 00000100:00100000:0.0:1746143760.205196:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.205291:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.212189:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.216232:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.223007:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.223044:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.229743:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.232286:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.232333:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.233525:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.233542:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621934720 00000100:00100000:0.0:1746143760.233545:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621934720 00002000:00100000:0.0:1746143760.233563:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bddf80 x1830963621934720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.233570:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddf80 with x1830963621934720 ext(2097152->4194303) 00002000:00010000:0.0:1746143760.233573:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bddf80 00000100:00100000:0.0:1746143760.233586:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2687 00000100:00100000:0.0:1746143760.233590:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963621934720:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143760.252420:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.252459:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.252553:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10490 00000100:00100000:0.0:1746143760.252557:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963621935232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143760.252575:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.252586:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73a56c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408e2e expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143760.252625:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626528384:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143760.256271:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.260221:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963621934720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 26629us (26697us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143760.260230:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2687 00002000:00100000:0.0:1746143760.260239:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bddf80 x1830963621934720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.260259:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddf80 with x1830963621934720 ext(2097152->4194303) 00002000:00010000:0.0:1746143760.260263:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bddf80 00000100:00100000:0.0:1746143760.279474:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.279523:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.288602:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.293166:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.311203:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.322327:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.322664:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.323572:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.325180:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621936640 00000100:00100000:0.0:1746143760.325188:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621936640 00010000:00010000:0.0:1746143760.325218:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a55fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408de8 expref: 22 pid: 3135 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143760.325242:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4784 00000100:00100000:0.0:1746143760.325248:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963621936768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.325260:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.325568:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a5555 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d6a expref: 43 pid: 9587 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.325581:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a5555 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d6a expref: 43 pid: 9587 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.325603:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a5555 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d6a expref: 43 pid: 9587 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.325635:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.325637:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.325643:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73a56d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3395584->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e43 expref: 42 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.325650:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73a56d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3395584->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e43 expref: 42 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.325679:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73a56d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3395584->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e43 expref: 42 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143760.325689:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626529152:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143760.325759:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.328981:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.339287:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.347615:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.347677:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.349055:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.355038:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.357593:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.415978:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.416730:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.420587:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.421961:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.422192:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.422220:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.426864:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626530176:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143760.426884:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73a573f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e66 expref: 43 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.426893:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73a573f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e66 expref: 43 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.426904:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c400, rc 0) 00000100:00100000:0.0:1746143760.427109:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963621938816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4163us (4887us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143760.427115:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10498 00000100:00100000:0.0:1746143760.433545:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.437990:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.438026:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621939584 00000100:00100000:0.0:1746143760.438035:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621939584 00002000:00100000:0.0:1746143760.438090:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b46300 x1830963621939584/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.438100:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b46300 with x1830963621939584 ext(0->1048575) 00002000:00010000:0.0:1746143760.438106:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b46300 00000100:00100000:0.0:1746143760.438129:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2692 00000100:00100000:0.0:1746143760.438137:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963621939584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143760.439900:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.441094:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.458441:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.470452:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.474115:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621940608 00000100:00100000:0.0:1746143760.474132:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621940608 00010000:00010000:0.0:1746143760.474162:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73a571c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e51 expref: 265 pid: 7243 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143760.474182:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4790 00000100:00100000:0.0:1746143760.474188:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:2009:x1830963621940608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.474200:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.474205:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73a571c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e51 expref: 265 pid: 7243 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143760.474953:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73a571c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e51 expref: 265 pid: 7243 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143760.474970:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73a571c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e51 expref: 265 pid: 7243 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143760.474989:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143760.474992:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a574d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143760.474999:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a574d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143760.475005:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a574d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143760.475139:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.475157:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:2009:x1830963621940608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 969us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.475163:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4790 00000100:00100000:0.0:1746143760.478024:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.488780:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.488820:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.488847:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.489427:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.504344:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.504374:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.504701:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.505246:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.506653:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.509298:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.525448:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.526523:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.532352:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.532380:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621943296 00000100:00100000:0.0:1746143760.532388:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621943296 00002000:00100000:0.0:1746143760.532433:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092b46680 x1830963621943296/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 504/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.532444:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b46680 with x1830963621943296 ext(1048576->2097151) 00010000:00010000:0.0:1746143760.532453:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f84e000/0x87925e4cb73a56ac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e19 expref: 22 pid: 9585 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143760.532465:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f84e000/0x87925e4cb73a56ac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e19 expref: 22 pid: 9585 timeout: 919 lvb_type: 0 00002000:00010000:0.0:1746143760.532473:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b46680 00000100:00100000:0.0:1746143760.532497:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1230 00000100:00100000:0.0:1746143760.532504:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963621943296:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143760.541769:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.545170:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.548242:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.554109:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.566821:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.569438:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626532352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746143760.573715:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.580461:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.580521:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.595848:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.597797:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.601385:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b99f1f93-ef24-4932-a1b4-452b64359da1:3774:1830963626532864:0@lo:400:kworker.0 00000100:00100000:0.0:1746143760.601445:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.601490:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626533376:0@lo:400:kworker.0 00000100:00100000:0.0:1746143760.601515:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.601530:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3774:1830963626533888:0@lo:400:kworker.0 00000100:00100000:0.0:1746143760.601550:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.601571:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143760.601575:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626533248:0@lo:400:kworker.0 00000100:00100000:0.0:1746143760.601590:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.601600:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3774:1830963626533760:0@lo:400:kworker.0 00000100:00100000:0.0:1746143760.601614:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746143760.604090:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143760.604099:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143760.604102:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746143760.604119:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143760.604177:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626533248:0@lo:400:kworker.0 00000100:00100000:0.0:1746143760.604191:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3774:1830963626533760:0@lo:400:kworker.0 00000100:00100000:0.0:1746143760.604200:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b99f1f93-ef24-4932-a1b4-452b64359da1:3774:1830963626532864:0@lo:400:kworker.0 00000100:00100000:0.0:1746143760.604212:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626533376:0@lo:400:kworker.0 00000100:00100000:0.0:1746143760.604223:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3774:1830963626533888:0@lo:400:kworker.0 00000100:00100000:0.0:1746143760.615211:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.615275:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.615326:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.623467:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.632395:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.633111:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.639357:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.639410:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.641063:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.645303:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.645342:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.646986:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2704 00000100:00100000:0.0:1746143760.646996:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963621947776:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143760.649723:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.649762:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.649789:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.649816:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.650120:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621948032 00000100:00100000:0.0:1746143760.650125:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621948032 00010000:00010000:0.0:1746143760.650156:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47c200/0x87925e4cb73a552b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d47 expref: 42 pid: 1947 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143760.650179:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621948160 00000100:00100000:0.0:1746143760.650182:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621948160 00010000:00010000:0.0:1746143760.650194:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a5604 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408dc5 expref: 26 pid: 3135 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143760.650208:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4799 00000100:00100000:0.0:1746143760.650215:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963621948032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.650228:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.650250:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c47c200/0x87925e4cb73a552b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d47 expref: 42 pid: 1947 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.650261:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c47c200/0x87925e4cb73a552b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d47 expref: 42 pid: 1947 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.650286:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c47c200/0x87925e4cb73a552b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408d47 expref: 42 pid: 1947 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.650308:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.650338:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963621948032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 124us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.650344:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4799 00000100:00100000:0.0:1746143760.650358:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4800 00000100:00100000:0.0:1746143760.650460:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963621948160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.650469:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.650480:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a5604 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408dc5 expref: 26 pid: 3135 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.650487:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a5604 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408dc5 expref: 26 pid: 3135 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.650498:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a5604 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408dc5 expref: 26 pid: 3135 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143760.650507:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.650521:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963621948160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 159us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.650526:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4800 00000100:00100000:0.0:1746143760.657289:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.670475:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.671173:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.674518:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.675874:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621949056 00000100:00100000:0.0:1746143760.675879:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621949056 00010000:00010000:0.0:1746143760.675906:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73a5754 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e82 expref: 47 pid: 1947 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143760.675940:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4803 00000100:00100000:0.0:1746143760.675946:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963621949056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.675955:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.675965:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73a5754 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e82 expref: 47 pid: 1947 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143760.675988:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73a5754 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e82 expref: 47 pid: 1947 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143760.676000:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73a5754 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408e82 expref: 47 pid: 1947 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143760.676012:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.676015:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.676022:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47c200/0x87925e4cb73a5811 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f00 expref: 46 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.676030:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47c200/0x87925e4cb73a5811 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f00 expref: 46 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.676062:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47c200/0x87925e4cb73a5811 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f00 expref: 46 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143760.676087:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626535040:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143760.676275:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.680335:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.680405:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.680450:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626535040:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143760.680471:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.680509:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963621949056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4563us (4741us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.680525:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4803 00000100:00100000:0.0:1746143760.683936:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963621948928:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7671us (8210us total) trans 21474840086 rc 0/0 00000100:00100000:0.0:1746143760.683944:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1233 00002000:00100000:0.0:1746143760.683953:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b3:0x0] (622592->1048575) req@ffff88012b7a9f80 x1830963621948928/t21474840086(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:156/0 lens 488/448 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.683961:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9f80 with x1830963621948928 ext(622592->1048575) 00010000:00010000:0.0:1746143760.683969:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e7f200/0x87925e4cb73a57e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ef2 expref: 41 pid: 1947 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143760.683980:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e7f200/0x87925e4cb73a57e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ef2 expref: 41 pid: 1947 timeout: 919 lvb_type: 0 00002000:00010000:0.0:1746143760.683985:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7a9f80 00000100:00100000:0.0:1746143760.687174:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.687268:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.690239:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.697856:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.697882:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.697983:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.704851:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.704900:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.706760:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.710037:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.713500:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.759697:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626536448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143760.759779:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.759867:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626536448 00000100:00100000:0.0:1746143760.759875:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626536448 00000100:00100000:0.0:1746143760.759933:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1746143760.759942:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963626536448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746143760.759967:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 450560 granted 1019198656 pending 7106560 free 3913109504 avail 3681587200 00000100:00100000:0.0:1746143760.760006:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963626536448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.760012:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1746143760.760052:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626536448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143760.776281:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626536576 00000100:00100000:0.0:1746143760.776289:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626536576 00000100:00100000:0.0:1746143760.776330:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:0.0:1746143760.776338:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963626536576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746143760.776372:0:12158:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445355520 avail 1315893248 00000100:00100000:0.0:1746143760.776423:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963626536576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.776429:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:0.0:1746143760.790476:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.804661:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.808231:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.809054:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4807 00000100:00100000:0.0:1746143760.809063:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2010:x1830963621953536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.809090:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.809096:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73a585e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f38 expref: 14 pid: 7245 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143760.809115:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73a585e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f38 expref: 14 pid: 7245 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143760.809138:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73a585e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f38 expref: 14 pid: 7245 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143760.809227:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143760.809231:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a5896 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143760.809241:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a5896 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143760.809248:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a5896 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143760.809277:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.809320:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963621953536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 259us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.809327:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4807 00000100:00100000:0.0:1746143760.818660:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.827384:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.828293:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.844695:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.844823:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.844843:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.844870:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.844899:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621955200 00000100:00100000:0.0:1746143760.844908:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621955200 00010000:00010000:0.0:1746143760.844983:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a57d9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ee4 expref: 47 pid: 12327 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143760.845013:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621955456 00000100:00100000:0.0:1746143760.845016:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621955456 00010000:00010000:0.0:1746143760.845027:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a5881 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f62 expref: 20 pid: 1945 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143760.845041:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621955072 00000100:00100000:0.0:1746143760.845043:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621955072 00010000:00010000:0.0:1746143760.845053:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a57cb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ed6 expref: 26 pid: 3134 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143760.845067:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4808 00000100:00100000:0.0:1746143760.845085:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+47:2011:x1830963621955200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.845099:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.845119:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a57d9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ee4 expref: 47 pid: 12327 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143760.845130:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a57d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ee4 expref: 47 pid: 12327 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143760.845155:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.845196:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+47:2011:x1830963621955200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 123us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.845202:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4808 00000100:00100000:0.0:1746143760.845252:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4809 00000100:00100000:0.0:1746143760.845258:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2011:x1830963621955456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.845268:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.845275:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a5881 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f62 expref: 20 pid: 1945 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143760.845284:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a5881 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f62 expref: 20 pid: 1945 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143760.845294:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.845307:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2011:x1830963621955456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 50us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.845313:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4809 00000100:00100000:0.0:1746143760.845323:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4810 00000100:00100000:0.0:1746143760.845327:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963621955072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.845334:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.845346:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a57cb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ed6 expref: 26 pid: 3134 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143760.845354:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a57cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ed6 expref: 26 pid: 3134 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143760.845365:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.845378:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963621955072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.845384:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4810 00000100:00100000:0.0:1746143760.846710:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.846739:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.846813:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.846828:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.846841:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621955840 00000100:00100000:0.0:1746143760.846844:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621955840 00002000:00100000:0.0:1746143760.846864:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (1028096->1048575) req@ffff880092b20e00 x1830963621955840/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.846872:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20e00 with x1830963621955840 ext(1028096->1048575) 00010000:00010000:0.0:1746143760.846878:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a580a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ef9 expref: 25 pid: 1947 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143760.846886:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a580a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ef9 expref: 25 pid: 1947 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746143760.846891:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b20e00 00000100:00100000:0.0:1746143760.846903:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1236 00000100:00100000:0.0:1746143760.846932:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963621955840:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143760.847009:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4811 00000100:00100000:0.0:1746143760.847014:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2011:x1830963621955328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.847022:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.847032:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012224fa00/0x87925e4cb73a587a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f54 expref: 18 pid: 1945 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143760.847040:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012224fa00/0x87925e4cb73a587a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f54 expref: 18 pid: 1945 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143760.847052:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012224fa00/0x87925e4cb73a587a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f54 expref: 18 pid: 1945 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143760.847296:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.847298:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.847300:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a58c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.847306:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a58c0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.847325:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.847338:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963621955328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 324us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.847342:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4811 00000100:00100000:0.0:1746143760.847407:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.847428:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.847457:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.847472:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.847485:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.847498:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.847522:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.868040:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963621955840:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 21120us (21198us total) trans 21474840087 rc 0/0 00000100:00100000:0.0:1746143760.868053:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1236 00002000:00100000:0.0:1746143760.868065:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (1028096->1048575) req@ffff880092b20e00 x1830963621955840/t21474840087(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 488/448 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.868087:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20e00 with x1830963621955840 ext(1028096->1048575) 00010000:00010000:0.0:1746143760.868106:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a580a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ef9 expref: 26 pid: 1947 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143760.868118:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a580a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ef9 expref: 26 pid: 1947 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746143760.868124:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b20e00 00000100:00100000:0.0:1746143760.878933:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621956992 00000100:00100000:0.0:1746143760.878938:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621956992 00000100:00100000:0.0:1746143760.878964:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12562 00000100:00100000:0.0:1746143760.878969:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:31434:x1830963621956992:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143760.878989:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.879002:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a5906 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408f7e expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.879098:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879111:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879119:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879129:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a5914 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879134:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a5914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879138:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a5914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879254:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a591b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879263:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a591b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879269:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a591b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143760.879277:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143760.879350:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a591b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879356:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a591b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879361:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a591b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879365:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143760.879368:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a591b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879373:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a591b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879380:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143760.879382:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143760.879385:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a591b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879389:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a591b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879425:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879430:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879434:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879438:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879442:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143760.879444:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879449:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879456:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143760.879458:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143760.879460:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879464:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a590d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879471:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a5914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879475:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a5914 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879479:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a5914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879489:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143760.879491:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a5914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879500:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a5914 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879507:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9dd00) 00010000:00010000:0.0:1746143760.879508:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143760.879511:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a5914 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879515:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a5914 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143760.879546:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a5906 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f7e expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.879553:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a5906 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f7e expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.879559:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:0.0:1746143760.879581:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:31434:x1830963621956992:12345-192.168.202.3@tcp:101:cat.0 Request processed in 612us (1450us total) trans 8589943206 rc 301/301 00000100:00100000:0.0:1746143760.879587:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12562 00000100:00100000:0.0:1746143760.890673:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.890719:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.890751:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.890770:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.890801:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.890830:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.890905:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.890947:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621958272 00000100:00100000:0.0:1746143760.890951:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621958272 00000100:00100000:0.0:1746143760.890972:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10536 00000100:00100000:0.0:1746143760.890977:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2010:x1830963621957760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143760.890992:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.891005:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73a5930 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408f8c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143760.891019:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a11, atime: 0x68140a11, ctime: 0x68140a11, blocks: 0x808 00010000:00010000:0.0:1746143760.891028:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.891030:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.891035:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73a5930 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f8c expref: 28 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.891046:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73a5930 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f8c expref: 28 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.891053:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75200, rc 0) 00000100:00100000:0.0:1746143760.891094:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2010:x1830963621957760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 115us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.891101:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10536 00000100:00100000:0.0:1746143760.891119:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10538 00000100:00100000:0.0:1746143760.891125:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2010:x1830963621958016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143760.891131:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.891146:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73a593e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248408f9a expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143760.891156:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a10, atime: 0x68140a10, ctime: 0x68140a10, blocks: 0x808 00010000:00010000:0.0:1746143760.891165:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.891166:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.891170:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73a593e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f9a expref: 30 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.891179:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73a593e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f9a expref: 30 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.891185:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74e00, rc 0) 00000100:00100000:0.0:1746143760.892188:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2010:x1830963621958016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1060us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.892194:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10538 00000100:00100000:0.0:1746143760.893743:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.896004:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.896093:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.904217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.911206:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.911298:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.913049:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.913065:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621960064 00000100:00100000:0.0:1746143760.913071:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621960064 00002000:00100000:0.0:1746143760.913109:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092b20000 x1830963621960064/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.913116:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20000 with x1830963621960064 ext(1048576->2097151) 00002000:00010000:0.0:1746143760.913128:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b20000 00000100:00100000:0.0:1746143760.913156:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2713 00000100:00100000:0.0:1746143760.913161:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963621960064:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143760.918845:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.931795:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.948112:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.955862:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.955947:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.958976:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.959015:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.959056:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.961773:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.969086:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.972129:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.972151:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.972222:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143760.979219:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963621961728:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9895us (10140us total) trans 21474840088 rc 0/0 00000100:00100000:0.0:1746143760.979231:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1237 00002000:00100000:0.0:1746143760.979243:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b5:0x0] (1470464->1806335) req@ffff880090e59f80 x1830963621961728/t21474840088(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:156/0 lens 488/448 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.979253:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59f80 with x1830963621961728 ext(1470464->1806335) 00010000:00010000:0.0:1746143760.979265:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a5953 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408faf expref: 45 pid: 13436 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143760.979281:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a5953 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408faf expref: 45 pid: 13436 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746143760.979295:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e59f80 00000100:00100000:0.0:1746143760.995247:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.008953:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143761.010223:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143761.025394:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.028600:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143761.029501:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143761.029505:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143761.060620:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.060679:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.060727:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143761.060768:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746143761.061313:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143761.081004:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.089631:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.090454:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.098321:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.098360:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.098404:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.110211:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.110385:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.126561:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.133334:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.134161:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.147855:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.157963:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.168084:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.168385:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.176851:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.182647:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.186760:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.188708:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.192321:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.198788:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.200218:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.212396:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.212964:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10558 00000100:00100000:0.0:1746143761.212974:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+48:31443:x1830963621969792:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143761.212995:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.213016:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55b800/0x87925e4cb73a5a25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840903b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.213049:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136000/0x87925e4cb73a5937 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f93 expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.213058:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a59ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408fd2 expref: 49 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.213065:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.213067:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.213079:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b800/0x87925e4cb73a5a25 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1449984->2097151] (req 1449984->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840903b expref: 49 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.213113:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a59ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408fd2 expref: 49 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.213139:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a59ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408fd2 expref: 49 pid: 9585 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143761.213152:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093726300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626541568:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143761.214477:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092136000/0x87925e4cb73a5937 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f93 expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.214489:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092136000/0x87925e4cb73a5937 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f93 expref: 30 pid: 13436 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143761.214497:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626541696:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143761.215601:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.221237:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.221288:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.227695:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.240222:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.248066:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.248127:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.256641:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.265867:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.275951:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.403579:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.411088:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.411386:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.426425:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.426451:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.426474:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621972480 00000100:00100000:0.0:1746143761.426483:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621972480 00000100:00100000:0.0:1746143761.426530:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621972608 00000100:00100000:0.0:1746143761.426532:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621972608 00000100:00100000:0.0:1746143761.426546:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10560 00000100:00100000:0.0:1746143761.426552:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963621972480:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143761.426570:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.426586:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a5a9c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840905e expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.426642:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626542336:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143761.426723:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.426788:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10561 00000100:00100000:0.0:1746143761.426793:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2008:x1830963621972608:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143761.426800:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.426810:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d10000/0x87925e4cb73a5aa3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409065 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.426834:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626542464:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143761.426856:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00002000:00010000:0.0:1746143761.432256:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime: 1746143760 -> 1746143761 00002000:00010000:0.0:1746143761.432259:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143760 -> 1746143761 00002000:00010000:0.0:1746143761.432262:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime: 1746143760 -> 1746143761 00000100:00100000:0.0:1746143761.432275:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626542336:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143761.432293:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a5a9c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840905e expref: 31 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.432499:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a5a9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840905e expref: 31 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.432821:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b400, rc 0) 00000100:00100000:0.0:1746143761.432861:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963621972480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6308us (6435us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143761.432869:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10560 00000100:00100000:0.0:1746143761.442187:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.451711:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.458681:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.460753:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.469657:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.469701:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.474040:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.474174:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.474813:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2735 00000100:00100000:0.0:1746143761.474820:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2011:x1830963621974912:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143761.474894:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2011:x1830963621974912:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 76us (721us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143761.474901:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2735 00002000:00100000:0.0:1746143761.474906:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x395:0x0] (1142784->1146879) req@ffff88012e359880 x1830963621974912/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.474933:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359880 with x1830963621974912 ext(1142784->1146879) 00002000:00010000:0.0:1746143761.474937:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e359880 00000100:00100000:0.0:1746143761.483759:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.489585:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.520274:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.520363:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.533627:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.536456:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.536525:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.542838:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.542869:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.542977:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626543616:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143761.543000:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73a5af0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840908f expref: 49 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.543011:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73a5af0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840908f expref: 49 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.543022:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d200, rc 0) 00000100:00100000:0.0:1746143761.543046:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+48:2011:x1830963621975680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6177us (6521us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143761.543053:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10567 00000100:00100000:0.0:1746143761.543084:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621976320 00000100:00100000:0.0:1746143761.543087:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621976320 00000100:00100000:0.0:1746143761.543107:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10568 00000100:00100000:0.0:1746143761.543112:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:31455:x1830963621976320:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143761.543126:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.543137:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a5af7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840909d expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.543165:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a5a2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409042 expref: 43 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.543170:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143761.543171:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143761.543174:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a5af7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840909d expref: 29 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.543194:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a5a2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409042 expref: 43 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.543203:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a5a2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409042 expref: 43 pid: 13436 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746143761.543212:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626543744:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143761.543260:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.545211:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626543744:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143761.545234:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a5af7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840909d expref: 29 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.545246:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e505400, rc 0) 00000100:00100000:0.0:1746143761.545515:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:31455:x1830963621976320:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2401us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.545522:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10568 00000100:00100000:0.0:1746143761.546082:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.546140:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.546633:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.547514:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.557727:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.573190:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.573710:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.582571:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.588461:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.594641:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.594687:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.595632:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.595674:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.595705:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.595718:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621979392 00000100:00100000:0.0:1746143761.595721:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621979392 00000100:00100000:0.0:1746143761.595898:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10574 00000100:00100000:0.0:1746143761.595904:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963621979520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143761.595929:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.595938:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73a5b1a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484090ce expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.595951:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.595953:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.595957:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73a5b1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484090ce expref: 25 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.595968:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73a5b1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484090ce expref: 25 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.595992:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25000, rc 0) 00000100:00100000:0.0:1746143761.596018:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963621979520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.596024:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10574 00000100:00100000:0.0:1746143761.596036:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10575 00000100:00100000:0.0:1746143761.596040:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+50:2009:x1830963621979392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143761.596047:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.596053:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a5b28 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484090c7 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.596085:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626545280:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143761.596107:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a240 going to sleep for 11 seconds 00002000:00010000:0.0:1746143761.597909:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143761 -> 1746143762 00000100:00100000:0.0:1746143761.597937:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626545280:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143761.597953:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a5b28 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484090c7 expref: 51 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.597963:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a5b28 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484090c7 expref: 51 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.597974:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24800, rc 0) 00000100:00100000:0.0:1746143761.598250:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+49:2009:x1830963621979392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2208us (2543us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143761.598262:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10575 00000100:00100000:0.0:1746143761.600477:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.600524:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.602160:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.611869:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.617174:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.620465:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143761.625378:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872780 is committed 00000001:00080000:0.0:1746143761.625398:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872778 is committed 00000001:00080000:0.0:1746143761.625433:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872772 is committed 00000001:00080000:0.0:1746143761.625446:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872769 is committed 00000100:00100000:0.0:1746143761.629529:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.633488:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.637451:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.640072:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.640148:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.641702:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.641721:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621981568 00000100:00100000:0.0:1746143761.641724:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621981568 00002000:00100000:0.0:1746143761.641744:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095cb7100 x1830963621981568/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.641752:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7100 with x1830963621981568 ext(3145728->4194303) 00002000:00010000:0.0:1746143761.641756:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb7100 00000100:00100000:0.0:1746143761.641769:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2743 00000100:00100000:0.0:1746143761.641774:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963621981568:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143761.648757:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.648774:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621982336 00000100:00100000:0.0:1746143761.648777:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621982336 00000100:00100000:0.0:1746143761.648803:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10583 00000100:00100000:0.0:1746143761.648807:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963621982336:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143761.648814:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.648821:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a5b7c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840910d expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.648831:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.648832:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.648837:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a5b7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840910d expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.648845:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a5b7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840910d expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.648852:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136000, rc 0) 00000100:00100000:0.0:1746143761.648866:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963621982336:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.648872:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10583 00000100:00100000:0.0:1746143761.649010:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963621981568:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7235us (7309us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143761.649018:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2743 00002000:00100000:0.0:1746143761.649027:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095cb7100 x1830963621981568/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.649035:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7100 with x1830963621981568 ext(3145728->4194303) 00002000:00010000:0.0:1746143761.649039:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb7100 00000100:00100000:0.0:1746143761.667550:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.669146:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143761.670224:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73a5b91 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143761.670230:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73a5b91 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143761.670249:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143761.670377:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a5b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840911b expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.670395:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73a5b91 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840911b expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.670400:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143761.670403:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143761.670405:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084a00, rc 0) 00000100:00100000:0.0:1746143761.670430:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:31461:x1830963621982720:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 2718us (2890us total) trans 8589943224 rc 0/0 00000100:00100000:0.0:1746143761.670436:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12572 00000100:00100000:0.0:1746143761.672705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.673819:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.681977:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.684284:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.686517:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10588 00000100:00100000:0.0:1746143761.686526:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963621983616:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143761.686545:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96600/0x87925e4cb73a5bc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.686570:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a5929 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f85 expref: 7 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.686576:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73a5b60 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484090f1 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.686583:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75400/0x87925e4cb73a59a0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248408fc4 expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.686587:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.686589:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.686590:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96600/0x87925e4cb73a5bc9 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.686608:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75400/0x87925e4cb73a59a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408fc4 expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.686617:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d75400/0x87925e4cb73a59a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408fc4 expref: 24 pid: 12327 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143761.686627:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626546688:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143761.687385:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73a5b60 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484090f1 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.687394:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73a5b60 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484090f1 expref: 11 pid: 13436 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143761.687412:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626547072:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143761.687438:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a5929 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f85 expref: 7 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.687446:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a5929 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f85 expref: 7 pid: 12328 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143761.687453:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626547200:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143761.687469:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.689657:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.697006:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4852 00000100:00100000:0.0:1746143761.697056:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963621984768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.697076:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143761.697122:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73a5b83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409114 expref: 11 pid: 1947 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.697158:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73a5b83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409114 expref: 11 pid: 1947 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.697180:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73a5b83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409114 expref: 11 pid: 1947 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.697204:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143761.697246:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963621984768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 233us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.697260:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4852 00000100:00100000:0.0:1746143761.697277:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4853 00000100:00100000:0.0:1746143761.697282:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963621984896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.697288:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143761.697546:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73a5b60 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484090f1 expref: 12 pid: 13436 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.697555:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73a5b60 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484090f1 expref: 12 pid: 13436 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.697755:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73a5b60 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484090f1 expref: 12 pid: 13436 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.697764:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143761.697779:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963621984896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 497us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.697786:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4853 00000100:00100000:0.0:1746143761.697827:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621985408 00000100:00100000:0.0:1746143761.697830:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621985408 00010000:00010000:0.0:1746143761.697842:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a5b75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409106 expref: 11 pid: 12327 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143761.697856:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621985536 00000100:00100000:0.0:1746143761.697858:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621985536 00010000:00010000:0.0:1746143761.697866:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a5b7c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840910d expref: 12 pid: 13430 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143761.697886:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4856 00000100:00100000:0.0:1746143761.697890:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963621985408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.697897:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143761.697903:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a5b75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409106 expref: 12 pid: 12327 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.697926:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a5b75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409106 expref: 12 pid: 12327 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.697937:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a5b75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409106 expref: 12 pid: 12327 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.697945:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143761.697960:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963621985408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 69us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.697964:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4856 00000100:00100000:0.0:1746143761.697974:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4858 00000100:00100000:0.0:1746143761.697978:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963621985920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.697984:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143761.697990:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a5afe lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484090a4 expref: 25 pid: 9839 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143761.697996:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a5afe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484090a4 expref: 25 pid: 9839 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143761.698013:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143761.698024:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963621985920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 46us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.698029:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4858 00000100:00100000:0.0:1746143761.698055:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4859 00000100:00100000:0.0:1746143761.698059:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963621985664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.698074:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143761.698080:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a5929 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f85 expref: 8 pid: 12328 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.698087:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a5929 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f85 expref: 8 pid: 12328 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.698095:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f634600/0x87925e4cb73a5929 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408f85 expref: 8 pid: 12328 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143761.698105:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143761.698115:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963621985664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.698120:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4859 00000100:00100000:0.0:1746143761.698127:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4860 00000100:00100000:0.0:1746143761.698131:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2010:x1830963621986048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.698136:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143761.698141:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a5af7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840909d expref: 7 pid: 9839 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143761.698150:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a5af7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840909d expref: 7 pid: 9839 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143761.698158:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a5af7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840909d expref: 7 pid: 9839 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143761.698164:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.698165:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.698168:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73a5bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.698173:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73a5bd0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.698184:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143761.698195:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2010:x1830963621986048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 64us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.698199:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4860 00000100:00100000:0.0:1746143761.706005:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.706054:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.711081:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.714577:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.714605:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.714643:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.717442:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621987200 00000100:00100000:0.0:1746143761.717447:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621987200 00010000:00010000:0.0:1746143761.717468:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a57af lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ec1 expref: 277 pid: 7245 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746143761.717494:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4867 00000100:00100000:0.0:1746143761.717500:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+277:2009:x1830963621987200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.717510:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143761.717514:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a57af lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ec1 expref: 277 pid: 7245 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143761.717523:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a57af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ec1 expref: 277 pid: 7245 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143761.717539:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a57af lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248408ec1 expref: 277 pid: 7245 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143761.717563:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143761.717567:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a5be5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143761.717575:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a5be5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143761.717580:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a5be5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143761.717602:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143761.717744:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+276:2009:x1830963621987200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.717757:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4867 00010000:00010000:0.0:1746143761.722391:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73a5689 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143761.722418:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73a5689 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143761.722425:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73a5689 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143761.722431:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0a800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143761.722435:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73a5689 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143761.722441:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73a5689 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143761.722459:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143761.722462:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143761.722465:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73a5689 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143761.722470:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73a5689 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746143761.722822:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626548864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143761.723820:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143761.723834:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626549376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143761.723851:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143761.724501:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626549888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143761.724526:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143761.724538:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626550400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143761.724556:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143761.725449:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143761.725466:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626550272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143761.725489:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143761.725589:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e25880/2, rc 0, transno 17179872788 00000100:00100000:0.0:1746143761.725594:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626549376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143761.725603:0:3773:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840080 gen 2 00000004:00080000:0.0:1746143761.725607:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f606a00, transno 21474840037 00000004:00080000:0.0:1746143761.725615:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a6680, transno 21474840038 00000004:00080000:0.0:1746143761.725617:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f607100, transno 21474840039 00000004:00080000:0.0:1746143761.725619:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093725f80, transno 21474840040 00000004:00080000:0.0:1746143761.725622:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f605c00, transno 21474840041 00000004:00080000:0.0:1746143761.725624:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f607800, transno 21474840042 00000004:00080000:0.0:1746143761.725626:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33100, transno 21474840043 00000004:00080000:0.0:1746143761.725628:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a50e00, transno 21474840044 00000004:00080000:0.0:1746143761.725630:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f607b80, transno 21474840045 00000004:00080000:0.0:1746143761.725633:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d5880, transno 21474840046 00000004:00080000:0.0:1746143761.725635:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f607480, transno 21474840047 00000004:00080000:0.0:1746143761.725637:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f605180, transno 21474840048 00000004:00080000:0.0:1746143761.725640:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e58700, transno 21474840049 00000004:00080000:0.0:1746143761.725642:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d5180, transno 21474840050 00000004:00080000:0.0:1746143761.725644:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e58000, transno 21474840051 00000004:00080000:0.0:1746143761.725646:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5aa00, transno 21474840052 00000004:00080000:0.0:1746143761.725648:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d4700, transno 21474840053 00000004:00080000:0.0:1746143761.725650:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972e8380, transno 21474840054 00000004:00080000:0.0:1746143761.725652:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368ebb80, transno 21474840062 00000004:00080000:0.0:1746143761.725655:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368e8700, transno 21474840063 00000004:00080000:0.0:1746143761.725657:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368eb480, transno 21474840064 00000004:00080000:0.0:1746143761.725658:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368e9c00, transno 21474840065 00000004:00080000:0.0:1746143761.725661:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368eb100, transno 21474840066 00000004:00080000:0.0:1746143761.725670:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368eaa00, transno 21474840067 00000004:00080000:0.0:1746143761.725672:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368e8a80, transno 21474840068 00000004:00080000:0.0:1746143761.725674:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368ea300, transno 21474840069 00000004:00080000:0.0:1746143761.725677:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f64aa00, transno 21474840070 00000004:00080000:0.0:1746143761.725679:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391d880, transno 21474840072 00000004:00080000:0.0:1746143761.725681:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391ed80, transno 21474840073 00000004:00080000:0.0:1746143761.725683:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391d500, transno 21474840074 00000004:00080000:0.0:1746143761.725686:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391ea00, transno 21474840075 00000004:00080000:0.0:1746143761.725688:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391ce00, transno 21474840076 00000004:00080000:0.0:1746143761.725690:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391df80, transno 21474840077 00000004:00080000:0.0:1746143761.725692:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391e300, transno 21474840078 00000004:00080000:0.0:1746143761.725694:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391e680, transno 21474840079 00000004:00080000:0.0:1746143761.725696:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391f800, transno 21474840080 00000100:00100000:0.0:1746143761.725701:0:3773:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009391c380 x1830963626549888/t21474840093(21474840093) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143777 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143761.725708:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009391c380/2, rc 0, transno 21474840093 00000100:00100000:0.0:1746143761.725711:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626549888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143761.725722:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb4000/2, rc 0, transno 21474840094 00000100:00100000:0.0:1746143761.725725:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626550400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143761.725962:0:8224:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 6 in flight, 36 done 00000100:00100000:0.0:1746143761.726006:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626550656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143761.726028:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143761.726052:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009391c700/2, rc 0, transno 21474840098 00000100:00100000:0.0:1746143761.726055:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626549632:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143761.726063:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb6680/2, rc 0, transno 21474840099 00000100:00100000:0.0:1746143761.726079:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626550144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143761.726106:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009391f480/2, rc 0, transno 21474840096 00000100:00100000:0.0:1746143761.726109:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626549760:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143761.726116:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb4a80/2, rc 0, transno 21474840097 00000100:00100000:0.0:1746143761.726119:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626550272:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143761.726132:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719ca80/2, rc 0, transno 21474840100 00000100:00100000:0.0:1746143761.726135:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626550656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143761.727599:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e27800/2, rc 0, transno 17179872789 00000100:00100000:0.0:1746143761.727603:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626549248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143761.727620:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e26d80/2, rc 0, transno 17179872790 00000100:00100000:0.0:1746143761.727622:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626548864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143761.729814:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.735683:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.740395:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.740438:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.741293:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.741403:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.741417:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.741441:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.748543:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.753479:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.764136:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.764180:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.765050:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.765128:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.765864:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.765979:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.783361:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.787771:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.788171:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.788190:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.788204:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.791411:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.805488:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.814205:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963621990272:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23910us (26022us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143761.814217:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2746 00002000:00100000:0.0:1746143761.814230:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88009391fb80 x1830963621990272/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.814239:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391fb80 with x1830963621990272 ext(1048576->2097151) 00002000:00010000:0.0:1746143761.814245:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391fb80 00000100:00100000:0.0:1746143761.845689:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.846504:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.849528:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.853199:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.865887:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.865947:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143761.873387:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76400/0x87925e4cb73a5cda lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143761.873394:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76400/0x87925e4cb73a5cda lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000040:00080000:0.0:1746143761.873662:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2517, 88 off209200 00000004:00080000:0.0:1746143761.873678:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821097764962ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143761.873712:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2496, 88 off207704 00000004:00080000:0.0:1746143761.873715:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821097802603ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143761.873725:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2497, 88 off207792 00000004:00080000:0.0:1746143761.873728:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821097815905ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143761.873736:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2518, 88 off209288 00000004:00080000:0.0:1746143761.873738:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821097826045ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143761.873745:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2519, 88 off209376 00000004:00080000:0.0:1746143761.873748:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821097835522ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143761.873754:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2498, 88 off207880 00000004:00080000:0.0:1746143761.873757:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821097844672ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143761.873764:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2499, 88 off207968 00000004:00080000:0.0:1746143761.873766:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821097853852ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143761.873772:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2500, 88 off208056 00000004:00080000:0.0:1746143761.873775:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821097862732ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143761.873782:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2520, 88 off209464 00000004:00080000:0.0:1746143761.873784:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821097872140ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143761.873792:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2501, 88 off208144 00000004:00080000:0.0:1746143761.873794:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821097881993ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143761.873801:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2521, 88 off209552 00000004:00080000:0.0:1746143761.873804:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821097891505ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143761.873810:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2502, 88 off208232 00000004:00080000:0.0:1746143761.873813:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821097900817ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143761.873820:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2522, 88 off209640 00000004:00080000:0.0:1746143761.873822:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821097909800ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143761.873828:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2523, 88 off209728 00000004:00080000:0.0:1746143761.873830:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821097918332ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143761.873844:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2524, 88 off209816 00000004:00080000:0.0:1746143761.873847:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821097934487ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143761.873853:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2525, 88 off209904 00000004:00080000:0.0:1746143761.873856:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821097943715ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143761.873863:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2503, 88 off208320 00000004:00080000:0.0:1746143761.873865:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821097953095ns, next at 770855090093ns, rc = 0 00010000:00010000:0.0:1746143761.882052:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76400/0x87925e4cb73a5cda lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484091b5 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.882079:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143761.882083:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143761.882098:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73a5cd3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484091b5 expref: 9 pid: 7245 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143761.882115:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76400/0x87925e4cb73a5cda lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484091b5 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.882143:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143761.882145:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143761.882147:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76400, rc 0) 00000100:00100000:0.0:1746143761.882191:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31469:x1830963621991936:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 25104us (29001us total) trans 8589943231 rc 0/0 00000100:00100000:0.0:1746143761.882198:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12583 00000100:00100000:0.0:1746143761.882225:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626551424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143761.882246:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143761.882259:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626551936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143761.882270:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143761.884187:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093726300/2, rc 0, transno 21474840105 00000100:00100000:0.0:1746143761.884191:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626551936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143761.884202:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093727100/2, rc 0, transno 21474840108 00000100:00100000:0.0:1746143761.884204:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626551424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143761.884232:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621992448 00000100:00100000:0.0:1746143761.884235:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621992448 00000100:00100000:0.0:1746143761.884263:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12584 00000100:00100000:0.0:1746143761.884268:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+260:31471:x1830963621992448:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143761.884285:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.884300:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a5ce1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484091bc expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.884344:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a5ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484091bc expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.884356:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a5ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484091bc expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.884370:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143761.884372:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143761.884376:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa16000, rc 0) 00000100:00100000:0.0:1746143761.884401:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+261:31471:x1830963621992448:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 133us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.884406:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12584 00000100:00100000:0.0:1746143761.886155:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963621991424:12345-192.168.202.3@tcp:3:cat.0 Request processed in 39512us (40475us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143761.886166:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2749 00002000:00100000:0.0:1746143761.886193:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88009391ce00 x1830963621991424/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.886207:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ce00 with x1830963621991424 ext(2097152->4194303) 00002000:00010000:0.0:1746143761.886214:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ce00 00000100:00100000:0.0:1746143761.889850:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.898961:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.899054:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.902590:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.904647:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.910798:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.914951:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.914969:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.914990:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.920411:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.925644:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621994624 00000100:00100000:0.0:1746143761.925659:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621994624 00000100:00100000:0.0:1746143761.925735:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4518 00000100:00100000:0.0:1746143761.925744:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31469:x1830963621994624:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143761.939258:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621994752 00000100:00100000:0.0:1746143761.939271:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621994752 00000100:00100000:0.0:1746143761.939339:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12586 00000100:00100000:0.0:1746143761.939347:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31474:x1830963621994752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143761.939374:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.939397:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66800/0x87925e4cb73a5d19 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484091d8 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.939490:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a5d20 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143761.939514:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a5d20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143761.939525:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a5d20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746143761.939552:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143761.939557:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143761.939572:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a5d20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143761.939594:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66800/0x87925e4cb73a5d19 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484091d8 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.939626:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a5d20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484091d8 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.939634:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143761.939636:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143761.939640:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d67200, rc 0) 00000100:00100000:0.0:1746143761.939695:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:31474:x1830963621994752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 349us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.939701:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12586 00000100:00100000:0.0:1746143761.940974:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.946254:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.947410:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.947440:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.947468:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.947482:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.947510:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.948185:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.954743:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.954825:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.956340:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.957231:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963621996288 00000100:00100000:0.0:1746143761.957236:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963621996288 00010000:00010000:0.0:1746143761.957254:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73a5c24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409161 expref: 10 pid: 1947 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746143761.957275:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4878 00000100:00100000:0.0:1746143761.957280:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963621996288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.957288:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143761.957296:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73a5c24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409161 expref: 10 pid: 1947 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746143761.957304:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73a5c24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409161 expref: 10 pid: 1947 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746143761.957316:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73a5c24 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409161 expref: 10 pid: 1947 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746143761.957335:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.957337:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.957344:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73a5d51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409209 expref: 23 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.957352:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73a5d51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409209 expref: 23 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.957391:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73a5d51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409209 expref: 23 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.957403:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626554880:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143761.957454:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.966868:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.966953:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.967863:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.967890:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.967979:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626554880:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143761.967998:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143761.968041:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963621996288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10761us (11702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.968052:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4878 00000100:00100000:0.0:1746143761.968093:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2754 00000100:00100000:0.0:1746143761.968100:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963621996544:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143761.970329:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.970728:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.982781:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143761.997044:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.002080:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.012049:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.012386:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.021466:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.022728:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963621998720:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6061us (10341us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143762.022735:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10647 00000100:00100000:0.0:1746143762.031534:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.039976:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.050029:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.053475:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.063969:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.070971:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.071373:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.071878:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622000000 00000100:00100000:0.0:1746143762.071882:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622000000 00000100:00100000:0.0:1746143762.079475:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.086303:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622000384 00000100:00100000:0.0:1746143762.086314:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622000384 00000100:00100000:0.0:1746143762.086374:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4520 00000100:00100000:0.0:1746143762.086383:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:31467:x1830963622000384:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143762.086591:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:31467:x1830963622000384:12345-192.168.202.3@tcp:35:cat.0 Request processed in 210us (379us total) trans 8589943235 rc 0/0 00000100:00100000:0.0:1746143762.086598:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4520 00000100:00100000:0.0:1746143762.100001:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.100034:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.104756:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622000896 00000100:00100000:0.0:1746143762.104760:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622000896 00002000:00100000:0.0:1746143762.104794:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff88012b1db100 x1830963622000896/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143762.104803:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db100 with x1830963622000896 ext(3145728->4194303) 00002000:00010000:0.0:1746143762.104821:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1db100 00000100:00100000:0.0:1746143762.104903:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2763 00000100:00100000:0.0:1746143762.106151:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622000768:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143762.150272:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.170171:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.172278:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143762.172882:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143762.244351:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.304280:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.327055:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.336215:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.336311:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622002560 00000100:00100000:0.0:1746143762.336322:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622002560 00000100:00100000:0.0:1746143762.336372:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12590 00000100:00100000:0.0:1746143762.336380:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:31488:x1830963622002560:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143762.336407:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143762.336426:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b600/0x87925e4cb73a5df9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840925d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.336503:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336515:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336525:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336535:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73a5e07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336544:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73a5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336548:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73a5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336640:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a000/0x87925e4cb73a5e0e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336649:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a000/0x87925e4cb73a5e0e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336654:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a000/0x87925e4cb73a5e0e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143762.336662:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143762.336729:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a000/0x87925e4cb73a5e0e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336736:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a000/0x87925e4cb73a5e0e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336742:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a000/0x87925e4cb73a5e0e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336747:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0a000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143762.336751:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a000/0x87925e4cb73a5e0e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336758:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a000/0x87925e4cb73a5e0e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336768:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143762.336775:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143762.336779:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a000/0x87925e4cb73a5e0e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336783:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a000/0x87925e4cb73a5e0e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336813:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336817:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336820:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336824:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336827:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0ba00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143762.336829:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336833:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336840:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143762.336842:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143762.336844:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336848:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a5e00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336854:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73a5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336864:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73a5e07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336868:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73a5e07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336872:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0b400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143762.336875:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73a5e07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336880:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73a5e07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336886:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880082e65f00) 00010000:00010000:0.0:1746143762.336888:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143762.336890:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73a5e07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336894:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73a5e07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143762.336964:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b600/0x87925e4cb73a5df9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840925d expref: 266 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.336971:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b600/0x87925e4cb73a5df9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840925d expref: 266 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.336978:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b600, rc 0) 00000100:00100000:0.0:1746143762.338764:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.340931:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.341032:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.342081:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622003072 00000100:00100000:0.0:1746143762.342084:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622003072 00000100:00100000:0.0:1746143762.342109:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4522 00000100:00100000:0.0:1746143762.342114:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:31485:x1830963622003072:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143762.342265:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:31485:x1830963622003072:12345-192.168.202.3@tcp:35:cat.0 Request processed in 151us (1233us total) trans 8589943241 rc 0/0 00000100:00100000:0.0:1746143762.342272:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4522 00000100:00100000:0.0:1746143762.345372:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.345408:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.345518:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.345546:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622003584 00000100:00100000:0.0:1746143762.345548:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622003584 00002000:00100000:0.0:1746143762.345574:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (4136960->4141055) req@ffff880093416d80 x1830963622003584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143762.345584:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416d80 with x1830963622003584 ext(4136960->4141055) 00002000:00010000:0.0:1746143762.345589:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093416d80 00000100:00100000:0.0:1746143762.345602:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2766 00000100:00100000:0.0:1746143762.345606:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963622003584:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143762.345715:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963622003584:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 107us (195us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143762.345721:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2766 00002000:00100000:0.0:1746143762.345726:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (4136960->4141055) req@ffff880093416d80 x1830963622003584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143762.345733:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416d80 with x1830963622003584 ext(4136960->4141055) 00002000:00010000:0.0:1746143762.345736:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093416d80 00000100:00100000:0.0:1746143762.350035:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.355346:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.355394:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.356581:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.356686:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.357044:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.369185:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.378011:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.383654:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.384564:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.389074:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.389300:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.397759:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.402695:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.403603:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.408376:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.422789:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.427886:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.440716:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.445302:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.455296:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.460334:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.461249:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.465196:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10663 00000100:00100000:0.0:1746143762.465205:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622008576:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143762.465213:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143762.465227:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b6600/0x87925e4cb73a5e8c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484092b8 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.465257:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.465259:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.465264:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b6600/0x87925e4cb73a5e8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484092b8 expref: 14 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.465275:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b6600/0x87925e4cb73a5e8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484092b8 expref: 14 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.465283:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6600, rc 0) 00000100:00100000:0.0:1746143762.465316:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622008576:12345-192.168.202.3@tcp:101:cat.0 Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.465323:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10663 00000100:00100000:0.0:1746143762.473486:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.477164:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.477792:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.484818:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622009088:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6848us (7026us total) trans 21474840112 rc 0/0 00000100:00100000:0.0:1746143762.484825:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1253 00002000:00100000:0.0:1746143762.484831:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3846144->4194303) req@ffff880095c68380 x1830963622009088/t21474840112(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:158/0 lens 488/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143762.484838:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68380 with x1830963622009088 ext(3846144->4194303) 00010000:00010000:0.0:1746143762.484847:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408d400/0x87925e4cb73a5e3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3846144->4194303] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409280 expref: 12 pid: 9585 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746143762.484863:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408d400/0x87925e4cb73a5e3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3846144->4194303] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409280 expref: 12 pid: 9585 timeout: 921 lvb_type: 0 00002000:00010000:0.0:1746143762.484878:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c68380 00000100:00100000:0.0:1746143762.491018:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.491085:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.505547:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.505631:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.512115:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.541015:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.545614:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.549706:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.552357:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.553749:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.570721:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.576634:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.587050:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.598425:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.632051:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.643042:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.651814:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.651852:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.651889:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.651905:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622012800 00000100:00100000:0.0:1746143762.651937:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622012800 00010000:00010000:0.0:1746143762.651968:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73a5c63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409184 expref: 28 pid: 9586 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746143762.651989:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622013056 00000100:00100000:0.0:1746143762.651990:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622013056 00010000:00010000:0.0:1746143762.652006:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a5d43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484091f4 expref: 15 pid: 3134 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746143762.652016:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4890 00000100:00100000:0.0:1746143762.652019:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622012928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.652025:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.652036:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb3800/0x87925e4cb73a5c0f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840914c expref: 9 pid: 13430 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746143762.652044:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb3800/0x87925e4cb73a5c0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840914c expref: 9 pid: 13430 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746143762.652085:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb3800/0x87925e4cb73a5c0f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840914c expref: 9 pid: 13430 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746143762.652101:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.652129:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622012928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.652133:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4890 00000100:00100000:0.0:1746143762.661239:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.667233:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.692205:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.697468:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.698675:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.717200:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.726306:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.742095:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.748659:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143762.750022:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143762.750388:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.764061:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.776315:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.780820:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.780860:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.780907:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.784536:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.788010:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.792650:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.797485:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.803994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.812110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.815944:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.815989:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.816097:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.817517:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143762.821669:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime: 1746143762 -> 1746143763 00002000:00010000:0.0:1746143762.821673:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143761 -> 1746143763 00002000:00010000:0.0:1746143762.821675:0:9585:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime: 1746143761 -> 1746143763 00000100:00100000:0.0:1746143762.821683:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626560896:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143762.821702:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e522c00/0x87925e4cb73a5f8f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840933d expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.821710:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e522c00/0x87925e4cb73a5f8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840933d expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.821734:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e522c00, rc 0) 00000100:00100000:0.0:1746143762.821751:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622017920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3742us (5654us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143762.821756:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10680 00000100:00100000:0.0:1746143762.825323:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.833373:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.839575:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.854871:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.860246:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.877537:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.905139:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.908900:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.909519:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.909610:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.922647:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.927678:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.928697:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.931796:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143762.937550:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.033237:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.036084:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143763.037191:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143763.048075:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.048121:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.048162:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.048199:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622021888 00000100:00100000:0.0:1746143763.048217:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622021888 00000100:00080000:0.0:1746143763.051677:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143763.053519:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622022656 00000100:00100000:0.0:1746143763.053524:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622022656 00000100:00100000:0.0:1746143763.053605:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12600 00000100:00100000:0.0:1746143763.053611:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+273:31524:x1830963622022656:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143763.053627:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.053642:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a601b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840938a expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.053712:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053724:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053734:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053746:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a6029 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053752:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a6029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053758:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a6029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053856:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a6030 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053864:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a6030 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053881:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a6030 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746143763.053889:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143763.053973:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053978:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053983:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053988:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.053993:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b27000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143763.053996:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054001:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054010:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143763.054012:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143763.054015:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054019:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a6022 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054033:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a6029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054043:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a6029 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054048:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a6029 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054051:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b47bc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143763.054064:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a6029 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054068:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a6029 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054074:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5bc9700) 00010000:00010000:0.0:1746143763.054076:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143763.054078:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a6029 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054082:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a6029 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143763.054114:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a601b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840938a expref: 276 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.054123:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a6030 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840938a expref: 275 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.054128:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143763.054130:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143763.054132:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133566200, rc 0) 00000100:00100000:0.0:1746143763.054165:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+275:31524:x1830963622022656:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 555us (713us total) trans 8589943260 rc 0/0 00000100:00100000:0.0:1746143763.054174:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12600 00000100:00100000:0.0:1746143763.066797:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.073631:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.073691:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.083533:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.103764:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.110897:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.111836:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.113163:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4903 00000100:00100000:0.0:1746143763.113173:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622024192:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.113186:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.113194:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73a5fab lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409359 expref: 27 pid: 6587 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143763.113204:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73a5fab lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409359 expref: 27 pid: 6587 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143763.113225:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73a5fab lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409359 expref: 27 pid: 6587 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143763.113254:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143763.113259:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a6053 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143763.113268:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a6053 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143763.113275:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a6053 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143763.113309:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.113355:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622024192:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 184us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.113361:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4903 00000100:00100000:0.0:1746143763.114149:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.117709:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.118284:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.118308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.118437:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10690 00000100:00100000:0.0:1746143763.118443:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622024832:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143763.118449:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.118457:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a606f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484093b4 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.118470:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.118472:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.118480:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a606f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484093b4 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.118493:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a606f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484093b4 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.118499:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523800, rc 0) 00000100:00100000:0.0:1746143763.118516:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622024832:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.118521:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10690 00000100:00100000:0.0:1746143763.118557:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.118580:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.118612:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.118627:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622024960 00000100:00100000:0.0:1746143763.118629:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622024960 00000100:00100000:0.0:1746143763.119650:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10693 00000100:00100000:0.0:1746143763.119658:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622024960:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143763.119668:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.119676:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b25200/0x87925e4cb73a6084 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484093bb expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.119690:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.119691:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.119697:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25200/0x87925e4cb73a6084 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484093bb expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.119707:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b25200/0x87925e4cb73a6084 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484093bb expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.119714:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25200, rc 0) 00000100:00100000:0.0:1746143763.119745:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622024960:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 88us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.119751:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10693 00000100:00100000:0.0:1746143763.127111:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.128041:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.128305:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2794 00000100:00100000:0.0:1746143763.128312:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622025600:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143763.128447:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622025600:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 136us (1339us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143763.128453:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2794 00002000:00100000:0.0:1746143763.128458:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (2052096->2056191) req@ffff880093070700 x1830963622025600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746143774 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143763.128465:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070700 with x1830963622025600 ext(2052096->2056191) 00002000:00010000:0.0:1746143763.128468:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093070700 00000100:00100000:0.0:1746143763.130686:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.131615:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.136331:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.136373:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.144340:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.150698:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.154084:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.154477:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.154808:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.154823:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622027776 00000100:00100000:0.0:1746143763.154825:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622027776 00000100:00100000:0.0:1746143763.154841:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10697 00000100:00100000:0.0:1746143763.154845:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622027776:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143763.154851:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.154858:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a60c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484093ec expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.154868:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.154869:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.154884:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a60c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484093ec expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.154897:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a60c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484093ec expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.154905:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24800, rc 0) 00000100:00100000:0.0:1746143763.154936:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622027776:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 90us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.154940:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10697 00000100:00100000:0.0:1746143763.163264:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.164820:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.169476:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.171855:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.173859:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.173897:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.173935:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.173961:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622028544 00000100:00100000:0.0:1746143763.173970:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622028544 00000100:00100000:0.0:1746143763.174270:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10699 00000100:00100000:0.0:1746143763.174278:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622028544:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143763.174334:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.174351:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a6061 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840939f expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.174358:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143763.174372:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143763.174374:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.174391:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a6061 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840939f expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.174402:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a6061 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840939f expref: 31 pid: 1945 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143763.174414:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626564736:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143763.175249:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143763.175285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.175619:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.176005:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.176861:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4913 00000100:00100000:0.0:1746143763.176867:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622029696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.176873:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.176883:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a5d3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484091e6 expref: 13 pid: 1947 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143763.177492:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a5d3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484091e6 expref: 13 pid: 1947 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143763.177960:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a5d3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484091e6 expref: 13 pid: 1947 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143763.177995:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.178011:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622029696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1144us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.178016:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4913 00010000:00010000:0.0:1746143763.178067:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012323ac00/0x87925e4cb73a5c01 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840913e expref: 12 pid: 13436 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143763.178079:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626564480:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143763.178897:0:13436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a60df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.178905:0:13436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a60df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.178924:0:13436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a60df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.178937:0:13436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a60df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.178944:0:13436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a60df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.178950:0:13436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a60df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.178982:0:13436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d429400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143763.178986:0:13436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a60df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.178993:0:13436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a60df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.179002:0:13436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a60df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.179006:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a60df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143763.179039:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622028416:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 9432us (9599us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.179047:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10698 00000100:00100000:0.0:1746143763.181348:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626564736:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143763.181369:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143763.182459:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626565120:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143763.182467:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626565376:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143763.182481:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a6102 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143763.188956:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.190659:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.192726:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4919 00000100:00100000:0.0:1746143763.192733:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622030720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.192743:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.192754:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73a5e4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840928e expref: 32 pid: 13436 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143763.192762:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73a5e4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840928e expref: 32 pid: 13436 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143763.192779:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73a5e4d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840928e expref: 32 pid: 13436 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143763.192790:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.192811:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622030720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.192816:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4919 00000100:00100000:0.0:1746143763.192827:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4920 00000100:00100000:0.0:1746143763.192831:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622030976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.192836:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.193036:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a5e54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409295 expref: 29 pid: 13436 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143763.193067:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a5e54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409295 expref: 29 pid: 13436 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143763.193077:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a5e54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409295 expref: 29 pid: 13436 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143763.193086:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.193097:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622030976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 265us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.193102:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4920 00010000:00010000:0.0:1746143763.194440:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a60fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.194447:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a60fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.194461:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a60fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.194467:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a60fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.194473:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a60fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.194478:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7da00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143763.194488:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a60fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.194494:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a60fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.194503:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a60fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.194508:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a60fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143763.194545:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622028800:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 19979us (20646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.194552:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10701 00000100:00100000:0.0:1746143763.200843:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143763.201727:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.201746:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.201767:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.201774:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.201795:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.201801:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b25c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143763.201805:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.201812:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.201822:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.201828:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73a60e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143763.201889:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622028544:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 27610us (30039us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.201898:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10699 00000100:00100000:0.0:1746143763.206567:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.209767:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.214623:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622032768 00000100:00100000:0.0:1746143763.214636:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622032768 00000100:00100000:0.0:1746143763.214711:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4538 00000100:00100000:0.0:1746143763.214722:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:31525:x1830963622032768:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1746143763.215037:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31525:x1830963622032768:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 314us (534us total) trans 8589943269 rc 0/0 00000100:00100000:0.0:1746143763.215069:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4538 00000100:00100000:0.0:1746143763.226976:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.244016:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.244068:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.244097:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.244123:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.291883:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.291973:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.315447:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622035712 00000100:00100000:0.0:1746143763.315459:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622035712 00000100:00100000:0.0:1746143763.315541:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10710 00000100:00100000:0.0:1746143763.315553:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31528:x1830963622035712:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143763.315575:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.315598:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a619c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409439 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.315633:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a616b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409424 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.315641:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.315643:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.315647:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a619c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3825664->4194303] (req 3825664->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409439 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.315685:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a616b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409424 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.315717:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a616b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409424 expref: 13 pid: 9586 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143763.315732:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626566400:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143763.315845:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143763.319134:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.324322:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622036096 00000100:00100000:0.0:1746143763.324332:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622036096 00002000:00100000:0.0:1746143763.324380:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3825664->3829759) req@ffff880129e7bb80 x1830963622036096/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:159/0 lens 488/0 e 0 to 0 dl 1746143774 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143763.324390:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e7bb80 with x1830963622036096 ext(3825664->3829759) 00002000:00010000:0.0:1746143763.324396:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e7bb80 00000100:00100000:0.0:1746143763.324492:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2803 00000100:00100000:0.0:1746143763.324502:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622036096:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143763.324889:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622036096:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 386us (1371us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143763.324896:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2803 00002000:00100000:0.0:1746143763.324902:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3825664->3829759) req@ffff880129e7bb80 x1830963622036096/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746143774 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143763.324908:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e7bb80 with x1830963622036096 ext(3825664->3829759) 00002000:00010000:0.0:1746143763.324938:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e7bb80 00000100:00100000:0.0:1746143763.325418:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.339477:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.344450:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.347368:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.348667:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.352606:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.353244:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.354191:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.357973:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.358008:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.358562:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.358582:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622038144 00000100:00100000:0.0:1746143763.358585:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622038144 00000100:00100000:0.0:1746143763.358618:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4539 00000100:00100000:0.0:1746143763.358624:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:31528:x1830963622038144:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143763.358802:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:31528:x1830963622038144:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 178us (240us total) trans 8589943272 rc 0/0 00000100:00100000:0.0:1746143763.358808:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4539 00000100:00100000:0.0:1746143763.364284:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.364533:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.368280:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.377545:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.381042:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.384999:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.412381:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.418559:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.418602:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.418643:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.418945:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10717 00000100:00100000:0.0:1746143763.418963:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622039808:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143763.418973:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.418984:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a61e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409471 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.418997:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.418999:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.419004:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a61e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409471 expref: 35 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.419014:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a61e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409471 expref: 35 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.419021:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429400, rc 0) 00000100:00100000:0.0:1746143763.419099:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622039808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 131us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.419109:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10717 00000100:00100000:0.0:1746143763.432774:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.432827:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.432979:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.433223:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2810 00000100:00100000:0.0:1746143763.433234:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622040576:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143763.470537:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.481323:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.483890:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.484713:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.484760:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.488653:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.495603:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.506016:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.506068:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.506096:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.506115:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622042752 00000100:00100000:0.0:1746143763.506118:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622042752 00000100:00100000:0.0:1746143763.506167:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622042624 00000100:00100000:0.0:1746143763.506169:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622042624 00000100:00100000:0.0:1746143763.506693:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.510673:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.518323:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.518411:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.519861:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.536122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.539000:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.539109:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.541318:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.543741:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.546842:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.551478:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.554869:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.557117:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622046080 00000100:00100000:0.0:1746143763.557123:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622046080 00002000:00100000:0.0:1746143763.557161:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x397:0x0] (2150400->2154495) req@ffff880095e32300 x1830963622046080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:159/0 lens 488/0 e 0 to 0 dl 1746143774 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143763.557170:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32300 with x1830963622046080 ext(2150400->2154495) 00002000:00010000:0.0:1746143763.557174:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32300 00000100:00100000:0.0:1746143763.558982:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2815 00000100:00100000:0.0:1746143763.559004:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622046080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143763.559157:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622046080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 156us (2472us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143763.559164:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2815 00002000:00100000:0.0:1746143763.559170:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x397:0x0] (2150400->2154495) req@ffff880095e32300 x1830963622046080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746143774 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143763.559178:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32300 with x1830963622046080 ext(2150400->2154495) 00002000:00010000:0.0:1746143763.559182:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32300 00000100:00100000:0.0:1746143763.576345:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.579559:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.579604:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.586041:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.588781:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.590262:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622047360:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3962us (4220us total) trans 21474840119 rc 0/0 00000100:00100000:0.0:1746143763.590272:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1268 00002000:00100000:0.0:1746143763.590282:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2801664->3047423) req@ffff880082ed6a00 x1830963622047360/t21474840119(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:159/0 lens 488/448 e 0 to 0 dl 1746143774 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143763.590295:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed6a00 with x1830963622047360 ext(2801664->3047423) 00010000:00010000:0.0:1746143763.590302:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a628a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2801664->3145727] (req 2801664->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484094e1 expref: 36 pid: 9586 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143763.590315:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a628a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2801664->3145727] (req 2801664->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484094e1 expref: 36 pid: 9586 timeout: 922 lvb_type: 0 00002000:00010000:0.0:1746143763.590334:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880082ed6a00 00000100:00100000:0.0:1746143763.594879:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.596122:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.601416:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.616639:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.616669:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.616701:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.621169:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.624170:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.624951:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.648024:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.657658:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.790338:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.803728:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.803767:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.803805:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.807744:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.866070:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.867138:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.879496:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.888041:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.888257:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.888643:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.888662:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622052096 00000100:00100000:0.0:1746143763.888665:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622052096 00010000:00010000:0.0:1746143763.888686:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a62ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409504 expref: 37 pid: 12328 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143763.888714:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622052480 00000100:00100000:0.0:1746143763.888715:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622052480 00010000:00010000:0.0:1746143763.888723:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a627c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484094d3 expref: 17 pid: 12327 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143763.888734:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4945 00000100:00100000:0.0:1746143763.888739:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622052096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.888750:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.888770:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a62ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409504 expref: 37 pid: 12328 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143763.888779:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a62ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409504 expref: 37 pid: 12328 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143763.889103:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a62ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409504 expref: 37 pid: 12328 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143763.889116:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.889135:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622052096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 395us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.889141:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4945 00000100:00100000:0.0:1746143763.892250:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.892893:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.894473:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.898729:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.901887:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.904522:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.910692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.915670:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.919431:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.941444:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.947882:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.948003:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.963511:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.967682:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.968368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143763.999515:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.038905:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.047694:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.048139:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.053531:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622056576 00000100:00100000:0.0:1746143764.053541:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622056576 00002000:00100000:0.0:1746143764.053586:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b5:0x0] (1466368->1470463) req@ffff880093073800 x1830963622056576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.053596:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093073800 with x1830963622056576 ext(1466368->1470463) 00002000:00010000:0.0:1746143764.053601:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093073800 00000100:00100000:0.0:1746143764.053633:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2835 00000100:00100000:0.0:1746143764.053640:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622056576:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143764.053787:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622056576:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 146us (797us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143764.053793:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2835 00002000:00100000:0.0:1746143764.053798:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b5:0x0] (1466368->1470463) req@ffff880093073800 x1830963622056576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.053816:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093073800 with x1830963622056576 ext(1466368->1470463) 00002000:00010000:0.0:1746143764.053818:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093073800 00000100:00100000:0.0:1746143764.061975:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.070015:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.070093:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.075481:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.090788:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.094837:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.096030:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.098421:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.098457:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.104115:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.104323:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.104393:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.104422:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.104434:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.104466:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.115058:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.121142:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.126822:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.131818:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.135089:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.135117:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.135156:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.135180:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.135193:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.135228:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.135249:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622059776 00000100:00100000:0.0:1746143764.135258:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622059776 00000100:00100000:0.0:1746143764.135292:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622059904 00000100:00100000:0.0:1746143764.135294:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622059904 00000100:00100000:0.0:1746143764.135306:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622060032 00000100:00100000:0.0:1746143764.135308:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622060032 00000100:00100000:0.0:1746143764.135318:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622060160 00000100:00100000:0.0:1746143764.135319:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622060160 00000100:00100000:0.0:1746143764.135328:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622060288 00000100:00100000:0.0:1746143764.135330:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622060288 00000100:00100000:0.0:1746143764.135338:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622060416 00000100:00100000:0.0:1746143764.135340:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622060416 00000100:00100000:0.0:1746143764.135353:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10752 00000100:00100000:0.0:1746143764.135359:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622059776:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143764.135404:0:13436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a63b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.135422:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a614f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409408 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135429:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a635c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409566 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135438:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77200/0x87925e4cb73a61db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840946a expref: 36 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135445:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.135447:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.135450:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a63b7 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.135489:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77200/0x87925e4cb73a61db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840946a expref: 36 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135500:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e77200/0x87925e4cb73a61db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840946a expref: 36 pid: 12327 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143764.135512:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626573440:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.135595:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a635c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409566 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135602:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a635c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409566 expref: 9 pid: 13430 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143764.135609:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626573568:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.135633:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a614f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409408 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135641:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a614f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409408 expref: 15 pid: 9586 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143764.135648:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093726680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626573696:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143764.135666:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.135688:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10753 00000100:00100000:0.0:1746143764.135694:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622059904:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143764.135720:0:12328:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a63be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.135732:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a6156 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840940f expref: 21 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135739:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73a6363 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840956d expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135746:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a61e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409471 expref: 37 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135751:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.135753:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.135755:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a63be lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.135772:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a61e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409471 expref: 37 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135779:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a61e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409471 expref: 37 pid: 13430 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143764.135787:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626573824:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.135814:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73a6363 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840956d expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135832:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73a6363 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840956d expref: 12 pid: 13430 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143764.135841:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626573952:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.135868:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a6156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840940f expref: 21 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.135876:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a6156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840940f expref: 21 pid: 13430 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143764.135883:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626574080:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143764.135900:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.141767:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626573824:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143764.141840:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626573952:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143764.144436:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.144471:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.144498:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.144523:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.144578:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626574080:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.144606:0:12328:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a63be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143764.144638:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622060544 00000100:00100000:0.0:1746143764.144655:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622060544 00010000:00010000:0.0:1746143764.144669:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a635c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409566 expref: 10 pid: 13430 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143764.144683:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4956 00000100:00100000:0.0:1746143764.144698:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622060672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.144709:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.144728:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a614f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409408 expref: 16 pid: 9586 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.144737:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a614f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409408 expref: 16 pid: 9586 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.144760:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7da00/0x87925e4cb73a614f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409408 expref: 16 pid: 9586 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.144781:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.144819:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622060672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 128us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.144825:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4956 00000100:00100000:0.0:1746143764.144841:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4958 00000100:00100000:0.0:1746143764.144846:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622060544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.144852:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.144858:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a635c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409566 expref: 10 pid: 13430 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.144865:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a635c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409566 expref: 10 pid: 13430 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.144881:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73a635c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409566 expref: 10 pid: 13430 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.144889:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.144904:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622060544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 58us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.144935:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4958 00000100:00100000:0.0:1746143764.144958:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.144970:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622061056 00000100:00100000:0.0:1746143764.144973:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622061056 00010000:00010000:0.0:1746143764.144984:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77200/0x87925e4cb73a61db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840946a expref: 37 pid: 12327 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143764.145840:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4960 00000100:00100000:0.0:1746143764.145850:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129c37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622061056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.145858:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.145867:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e77200/0x87925e4cb73a61db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840946a expref: 37 pid: 12327 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.145877:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e77200/0x87925e4cb73a61db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840946a expref: 37 pid: 12327 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.145889:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e77200/0x87925e4cb73a61db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840946a expref: 37 pid: 12327 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.145898:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.145905:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.145929:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a63b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.145942:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a63b7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.145963:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.145980:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129c37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622061056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 132us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.145986:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4960 00000100:00100000:0.0:1746143764.146675:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622061184 00000100:00100000:0.0:1746143764.146678:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622061184 00010000:00010000:0.0:1746143764.146693:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a6156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840940f expref: 22 pid: 13430 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143764.146708:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4961 00000100:00100000:0.0:1746143764.146712:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622061184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.146719:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.146726:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a6156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840940f expref: 22 pid: 13430 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.146735:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a6156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840940f expref: 22 pid: 13430 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.146745:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a6156 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840940f expref: 22 pid: 13430 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143764.146763:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.146764:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.146767:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a63be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.146773:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a63be lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.146784:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.146801:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622061184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.146806:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4961 00000100:00100000:0.0:1746143764.149680:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622061312 00000100:00100000:0.0:1746143764.149686:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622061312 00010000:00010000:0.0:1746143764.149710:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a632b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840954a expref: 37 pid: 9585 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143764.149735:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622061696 00000100:00100000:0.0:1746143764.149737:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622061696 00010000:00010000:0.0:1746143764.149747:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a631d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840953c expref: 21 pid: 9585 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143764.151203:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4963 00000100:00100000:0.0:1746143764.151211:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622061696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.151219:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.151228:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a631d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840953c expref: 21 pid: 9585 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746143764.151255:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a631d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840953c expref: 21 pid: 9585 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746143764.151269:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a631d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840953c expref: 21 pid: 9585 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746143764.151279:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.151295:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622061696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.151301:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4963 00000100:00100000:0.0:1746143764.152295:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622062208 00000100:00100000:0.0:1746143764.152299:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622062208 00010000:00010000:0.0:1746143764.152311:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e5f800/0x87925e4cb73a62a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484094fd expref: 20 pid: 12328 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143764.152336:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4967 00000100:00100000:0.0:1746143764.152341:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5220050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622062208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.152348:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.152354:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e5f800/0x87925e4cb73a62a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484094fd expref: 20 pid: 12328 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746143764.152361:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1e5f800/0x87925e4cb73a62a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484094fd expref: 20 pid: 12328 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746143764.152372:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e5f800/0x87925e4cb73a62a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484094fd expref: 20 pid: 12328 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746143764.152386:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.152405:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5220050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622062208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 64us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.152410:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4967 00000100:00100000:0.0:1746143764.162798:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.168878:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622062464 00000100:00100000:0.0:1746143764.168886:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622062464 00010000:00010000:0.0:1746143764.168906:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a6339 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409558 expref: 39 pid: 9585 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143764.168952:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4969 00000100:00100000:0.0:1746143764.168957:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963622062464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.168968:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143764.168977:0:16784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143763 -> 1746143764 00002000:00010000:0.0:1746143764.168979:0:16784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143763 -> 1746143764 00010000:00010000:0.0:1746143764.168983:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a6339 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409558 expref: 39 pid: 9585 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746143764.168991:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a6339 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2326527) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409558 expref: 39 pid: 9585 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746143764.169004:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a6339 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2326527) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409558 expref: 39 pid: 9585 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746143764.169013:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.169024:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.169028:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73a63d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.169034:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73a63d3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.169063:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.169079:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963622062464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 121us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.169084:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4969 00000100:00100000:0.0:1746143764.173385:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.180681:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622062848 00000100:00100000:0.0:1746143764.180692:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622062848 00000100:00100000:0.0:1746143764.180909:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12619 00000100:00100000:0.0:1746143764.181018:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:31573:x1830963622062848:12345-192.168.202.3@tcp:36:mirror_io.0 00010000:00010000:0.0:1746143764.181081:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.181112:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5800/0x87925e4cb73a63b0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840959e expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181131:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143764.181136:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143764.181166:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73a63e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143764.181180:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a5fd5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409367 expref: 37 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181187:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512800/0x87925e4cb73a5ff8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840936e expref: 281 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181206:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76400/0x87925e4cb73a5cda lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484091b5 expref: 37 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181212:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a5ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484091bc expref: 281 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181218:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a61cd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409463 expref: 281 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181224:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73a63e1 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143764.181259:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a61cd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409463 expref: 281 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181271:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a61cd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409463 expref: 281 pid: 6587 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143764.181286:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626575360:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.181713:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a5ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484091bc expref: 281 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181722:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a5ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484091bc expref: 281 pid: 7245 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143764.181729:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626575488:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.181754:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76400/0x87925e4cb73a5cda lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484091b5 expref: 37 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181768:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76400/0x87925e4cb73a5cda lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484091b5 expref: 37 pid: 7245 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143764.181775:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626575616:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.181797:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512800/0x87925e4cb73a5ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840936e expref: 281 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181803:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512800/0x87925e4cb73a5ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840936e expref: 281 pid: 6587 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143764.181809:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626575744:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.181828:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a5fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409367 expref: 37 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.181834:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a5fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409367 expref: 37 pid: 6587 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143764.181841:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626575872:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143764.181861:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f8796c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.187968:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626575360:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.187979:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a5ce1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484091bc expref: 283 pid: 7245 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143764.187990:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626575488:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.187997:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76400/0x87925e4cb73a5cda lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484091b5 expref: 38 pid: 7245 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746143764.188017:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626575616:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143764.188026:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626575744:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143764.188032:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626575872:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143764.188967:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73a63e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143764.189973:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143764.190941:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73a63e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143764.190949:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73a63e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000040:00080000:0.0:1746143764.191216:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2526, 88 off209992 00000004:00080000:0.0:1746143764.191224:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823415310921ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143764.191248:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2504, 88 off208408 00000004:00080000:0.0:1746143764.191253:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823415340842ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143764.191266:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2505, 88 off208496 00000004:00080000:0.0:1746143764.191269:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823415356801ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143764.191278:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2527, 88 off210080 00000004:00080000:0.0:1746143764.191280:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823415368048ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143764.191286:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2528, 88 off210168 00000004:00080000:0.0:1746143764.191289:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823415376898ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143764.191296:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2506, 88 off208584 00000004:00080000:0.0:1746143764.191298:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823415386390ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143764.191305:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2507, 88 off208672 00000004:00080000:0.0:1746143764.191319:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823415406918ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143764.191330:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2508, 88 off208760 00000004:00080000:0.0:1746143764.191333:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823415420567ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143764.191341:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2529, 88 off210256 00000004:00080000:0.0:1746143764.191343:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823415431392ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143764.191350:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2509, 88 off208848 00000004:00080000:0.0:1746143764.191353:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823415440685ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143764.191360:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2530, 88 off210344 00000004:00080000:0.0:1746143764.191362:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823415449835ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143764.192359:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2510, 88 off208936 00000004:00080000:0.0:1746143764.192365:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823416453310ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143764.192383:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2531, 88 off210432 00000004:00080000:0.0:1746143764.192388:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823416475580ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143764.192411:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2532, 88 off210520 00000004:00080000:0.0:1746143764.192414:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823416501828ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143764.192421:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2533, 88 off210608 00000004:00080000:0.0:1746143764.192424:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823416511606ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143764.192431:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2534, 88 off210696 00000004:00080000:0.0:1746143764.192433:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823416520745ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143764.192581:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2511, 88 off209024 00000004:00080000:0.0:1746143764.192586:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823416673380ns, next at 770855090093ns, rc = 0 00000004:00010000:0.0:1746143764.194996:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880082ed5f80 reply state ffff88012b7f5800 transno 8589943289 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73a63e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143764.195018:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73a63e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143764.195027:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143764.195036:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746143764.195051:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746143764.195150:0:6587:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746143764.195167:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31573:x1830963622062848:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 14146us (14553us total) trans 8589943289 rc 0/0 00000100:00100000:0.0:1746143764.195174:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12619 00000100:00100000:0.0:1746143764.197761:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626576384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143764.201722:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143764.201758:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626576896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143764.201783:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143764.201794:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626577408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143764.201809:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143764.201819:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626577920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143764.201831:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143764.202598:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938df100/2, rc 0, transno 21474840130 00000100:00100000:0.0:1746143764.202602:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626576384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143764.202609:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e31f80/2, rc 0, transno 17179872817 00000100:00100000:0.0:1746143764.202612:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626576896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143764.202617:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093725f80/2, rc 0, transno 17179872818 00000100:00100000:0.0:1746143764.202619:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626577408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143764.202624:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f648e00/2, rc 0, transno 21474840131 00000100:00100000:0.0:1746143764.202627:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626577920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143764.204246:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.208981:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.214726:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10775 00000100:00100000:0.0:1746143764.214746:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2008:x1830963622064128:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143764.214765:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143764.214785:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa000/0x87925e4cb73a63fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484095b3 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143764.214807:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a11, atime: 0x68140a11, ctime: 0x68140a11, blocks: 0x7d8 00010000:00010000:0.0:1746143764.214828:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.214830:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.214841:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa000/0x87925e4cb73a63fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484095b3 expref: 7 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.214856:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa000/0x87925e4cb73a63fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484095b3 expref: 7 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.214867:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5aa000, rc 0) 00000100:00100000:0.0:1746143764.214935:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622064128:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 191us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.216278:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10775 00000100:00100000:0.0:1746143764.718829:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.718880:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.718939:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.719028:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143764.719075:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622065024 00000100:00100000:0.0:1746143764.719085:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622065024 00000100:00100000:0.0:1746143764.719130:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622065152 00000100:00100000:0.0:1746143764.719132:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622065152 00000100:00100000:0.0:1746143764.719145:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622065280 00000100:00100000:0.0:1746143764.719147:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622065280 00000100:00100000:0.0:1746143764.719175:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1061 00000100:00100000:0.0:1746143764.719182:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+20:2010:x1830963622065024:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143764.719249:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+20:2010:x1830963622065024:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 67us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.719255:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1061 00000100:00100000:0.0:1746143764.719270:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1062 00000100:00100000:0.0:1746143764.719274:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2011:x1830963622065152:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143764.719296:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2011:x1830963622065152:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.719301:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1062 00000100:00100000:0.0:1746143764.719310:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1063 00000100:00100000:0.0:1746143764.719314:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2010:x1830963622065280:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143764.719330:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2010:x1830963622065280:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 16us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.719335:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1063 00000100:00100000:0.0:1746143765.228860:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.228909:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.228991:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.229011:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.229026:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.229111:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.233076:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.233112:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.233822:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.234040:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.234453:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.234475:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.234563:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622066816 00000100:00100000:0.0:1746143765.234566:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622066816 00000100:00100000:0.0:1746143765.234582:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10790 00000100:00100000:0.0:1746143765.234586:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622066688:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143765.234624:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622066688:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 37us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.234630:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10790 00000100:00100000:0.0:1746143765.234638:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10791 00000100:00100000:0.0:1746143765.234643:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622066560:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143765.234870:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622066560:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 225us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.234876:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10791 00000100:00100000:0.0:1746143765.240550:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.246449:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.252889:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.254744:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.254791:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.258999:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.259049:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.259077:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.259591:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.307212:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.311578:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.333470:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.337334:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143765.337591:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143765.338750:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.338769:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622070144 00000100:00100000:0.0:1746143765.338773:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622070144 00000100:00100000:0.0:1746143765.338821:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10795 00000100:00100000:0.0:1746143765.338827:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622070144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143765.338838:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.338849:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73a649e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484095eb expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.338865:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.338867:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.338875:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73a649e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484095eb expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.338887:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73a649e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484095eb expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.338894:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5ad600, rc 0) 00000100:00100000:0.0:1746143765.339556:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622070144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.339563:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10795 00000100:00080000:0.0:1746143765.339580:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143765.339603:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.339614:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622070400 00000100:00100000:0.0:1746143765.339617:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622070400 00000100:00100000:0.0:1746143765.339649:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10796 00000100:00100000:0.0:1746143765.339654:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622070400:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143765.339674:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.339684:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73a64a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484095f9 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.339697:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.339698:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.339703:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73a64a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484095f9 expref: 20 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.339713:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73a64a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484095f9 expref: 20 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.339720:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5ace00, rc 0) 00000100:00100000:0.0:1746143765.339737:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622070400:12345-192.168.202.3@tcp:101:cat.0 Request processed in 83us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.339742:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10796 00000100:00080000:0.0:1746143765.339753:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143765.339798:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.341576:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622070784 00000100:00100000:0.0:1746143765.341578:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622070784 00000100:00100000:0.0:1746143765.341592:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10797 00000100:00100000:0.0:1746143765.341597:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622070656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143765.341608:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.341619:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73a64ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409607 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.341634:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.341641:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.342541:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73a64ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409607 expref: 18 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.342558:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73a64ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409607 expref: 18 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.342567:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26c00, rc 0) 00000100:00100000:0.0:1746143765.342583:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622070656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 986us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.342656:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10797 00000100:00100000:0.0:1746143765.342740:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.343706:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.343734:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.343782:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.348520:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.349543:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.351491:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.356531:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.356568:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.357434:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.357459:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622072448 00000100:00100000:0.0:1746143765.357462:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622072448 00000100:00100000:0.0:1746143765.357491:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10803 00000100:00100000:0.0:1746143765.357497:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622072448:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143765.357504:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.357514:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73a6515 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840963f expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.357540:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.357542:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.357546:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73a6515 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840963f expref: 37 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.357555:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73a6515 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840963f expref: 37 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.357562:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26400, rc 0) 00000100:00100000:0.0:1746143765.357582:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622072448:12345-192.168.202.3@tcp:101:cat.0 Request processed in 85us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.357587:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10803 00000100:00100000:0.0:1746143765.358246:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.358274:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.358305:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.359171:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.365789:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.365858:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.367657:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.367701:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.369489:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.369527:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.370788:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2847 00000100:00100000:0.0:1746143765.370796:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622074368:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143765.377950:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622074624 00000100:00100000:0.0:1746143765.377962:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622074624 00010000:00010000:0.0:1746143765.377990:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d800/0x87925e4cb73a63e8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095a5 expref: 9 pid: 6587 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746143765.378026:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622074496 00000100:00100000:0.0:1746143765.378029:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622074496 00010000:00010000:0.0:1746143765.378050:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a64dd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840961c expref: 264 pid: 10936 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746143765.378065:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4981 00000100:00100000:0.0:1746143765.378069:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:2009:x1830963622074496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.378075:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.378078:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a64dd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840961c expref: 264 pid: 10936 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.378095:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a64dd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840961c expref: 264 pid: 10936 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.378117:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a64dd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840961c expref: 264 pid: 10936 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.378136:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143765.378140:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a653f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143765.378147:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a653f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143765.378152:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.378187:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2009:x1830963622074496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 117us (2825us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.378197:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4981 00000100:00100000:0.0:1746143765.378455:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622075392 00000100:00100000:0.0:1746143765.378458:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622075392 00010000:00010000:0.0:1746143765.378471:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a6500 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840962a expref: 263 pid: 7244 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746143765.378489:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4982 00000100:00100000:0.0:1746143765.378494:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+263:2011:x1830963622075392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.378502:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.378505:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a6500 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840962a expref: 263 pid: 7244 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.378514:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a6500 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840962a expref: 263 pid: 7244 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.378525:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143765.378528:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a653f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143765.378535:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a653f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143765.378542:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a653f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143765.378559:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.378574:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+263:2011:x1830963622075392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.378579:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4982 00000100:00100000:0.0:1746143765.385363:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626579328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.385386:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.385398:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626579840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.385409:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.385417:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626580352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.385431:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.385453:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626580864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.385468:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.385481:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746143765.385485:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626579200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.385501:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.385512:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626579712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.385526:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.385536:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626580224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.385549:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.385557:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626580736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.385568:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.385591:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626579456 00000100:00100000:0.0:1746143765.385598:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626579456 00000100:00100000:0.0:1746143765.385627:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626579968 00000100:00100000:0.0:1746143765.385629:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626579968 00000100:00100000:0.0:1746143765.385637:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626580480 00000100:00100000:0.0:1746143765.385639:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626580480 00000100:00100000:0.0:1746143765.385645:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626579328 00000100:00100000:0.0:1746143765.385647:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626579328 00000100:00100000:0.0:1746143765.385653:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626579840 00000100:00100000:0.0:1746143765.385654:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626579840 00000100:00100000:0.0:1746143765.385674:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626580352 00000100:00100000:0.0:1746143765.385676:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626580352 00000100:00100000:0.0:1746143765.385681:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626580864 00000100:00100000:0.0:1746143765.385683:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626580864 00000100:00100000:0.0:1746143765.385688:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626579712 00000100:00100000:0.0:1746143765.385689:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626579712 00000100:00100000:0.0:1746143765.385695:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626580224 00000100:00100000:0.0:1746143765.385696:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626580224 00000100:00100000:0.0:1746143765.385702:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626580736 00000100:00100000:0.0:1746143765.385703:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626580736 00000100:00100000:0.0:1746143765.385713:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10808 00000100:00100000:0.0:1746143765.385718:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3771:x1830963626579968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143765.385847:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143765.385850:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143763 -> 1746143763 00002000:00010000:0.0:1746143765.385852:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143763 -> 1746143763 00002000:00010000:0.0:1746143765.385854:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143763 -> 1746143763 00002000:00010000:0.0:1746143765.385856:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143765.385879:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3771:x1830963626579968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (624us total) trans 17179872820 rc 0/0 00000100:00100000:0.0:1746143765.385886:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10808 00000100:00100000:0.0:1746143765.404668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.405780:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.413372:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.416688:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.420333:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622076416 00000100:00100000:0.0:1746143765.420341:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622076416 00000100:00100000:0.0:1746143765.420377:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10824 00000100:00100000:0.0:1746143765.420384:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:31581:x1830963622076416:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143765.420400:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.420427:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a655b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840967e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.420457:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a6412 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484095cf expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.420466:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a651c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840964d expref: 41 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.420473:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73a64ba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409607 expref: 17 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.420480:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.420482:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.420486:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a655b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840967e expref: 41 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.420516:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73a64ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409607 expref: 17 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.420527:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73a64ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409607 expref: 17 pid: 9839 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.420539:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626581248:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143765.420627:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a651c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840964d expref: 41 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.420635:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a651c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840964d expref: 41 pid: 9585 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.420648:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626581376:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143765.420683:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a6412 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095cf expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.420691:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a6412 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095cf expref: 9 pid: 3134 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.420698:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093071f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626581504:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143765.420714:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.423477:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.423508:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.425198:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.425219:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.425242:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.425260:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622077184 00000100:00100000:0.0:1746143765.425263:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622077184 00010000:00010000:0.0:1746143765.425282:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a651c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840964d expref: 42 pid: 9585 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.425304:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4983 00000100:00100000:0.0:1746143765.425309:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622077184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.425318:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.425336:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a651c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840964d expref: 42 pid: 9585 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746143765.425412:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a651c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840964d expref: 42 pid: 9585 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746143765.425425:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a651c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840964d expref: 42 pid: 9585 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746143765.425437:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.425460:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622077184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.425469:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4983 00000100:00100000:0.0:1746143765.425499:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.425754:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.425769:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622077696 00000100:00100000:0.0:1746143765.425772:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622077696 00010000:00010000:0.0:1746143765.425785:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a6412 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095cf expref: 10 pid: 3134 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.425801:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4985 00000100:00100000:0.0:1746143765.425806:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622077696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.425812:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.425819:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a6412 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095cf expref: 10 pid: 3134 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746143765.426444:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a6412 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095cf expref: 10 pid: 3134 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746143765.426465:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a6412 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095cf expref: 10 pid: 3134 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746143765.426474:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.426475:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.426482:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a655b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2314240->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840967e expref: 40 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.426489:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a655b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2314240->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840967e expref: 40 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.426498:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.426499:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.426501:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33e00/0x87925e4cb73a6562 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2195456->2314239] (req 2195456->2314239) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409685 expref: 18 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.426508:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33e00/0x87925e4cb73a6562 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2195456->2314239] (req 2195456->2314239) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409685 expref: 18 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.426535:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33e00/0x87925e4cb73a6562 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2195456->2314239] (req 2195456->2314239) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409685 expref: 18 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.426548:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626581632:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143765.426598:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a655b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2314240->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840967e expref: 41 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.426617:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626581760:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143765.426636:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.435022:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.435059:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.435086:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.435098:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.435121:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.449451:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.450956:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.457208:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.457281:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.457869:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622079488 00000100:00100000:0.0:1746143765.457876:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622079488 00000100:00100000:0.0:1746143765.457908:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622079616 00000100:00100000:0.0:1746143765.457925:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622079616 00000100:00100000:0.0:1746143765.457943:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10826 00000100:00100000:0.0:1746143765.457949:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:31581:x1830963622079488:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143765.457967:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.457984:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a6585 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409693 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.458012:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73a6419 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484095d6 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.458021:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a652a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409654 expref: 39 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.458051:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a64cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840960e expref: 23 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.458058:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.458060:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.458063:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a6585 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->3719167] (req 3145728->3719167) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409693 expref: 39 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.458094:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a64cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840960e expref: 23 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.458106:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73a64cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840960e expref: 23 pid: 12327 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.458118:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136aca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626581888:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143765.458178:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a652a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409654 expref: 39 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.458186:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a652a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409654 expref: 39 pid: 9585 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.458194:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626582016:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143765.458224:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73a6419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095d6 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.459073:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73a6419 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095d6 expref: 10 pid: 9585 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.459082:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626582144:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143765.462421:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.463604:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136aca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626581888:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143765.464833:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.465279:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.465306:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622080256 00000100:00100000:0.0:1746143765.465309:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622080256 00010000:00010000:0.0:1746143765.465324:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a652a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409654 expref: 40 pid: 9585 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.465352:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4987 00000100:00100000:0.0:1746143765.465358:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622080256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.465365:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.465373:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a652a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409654 expref: 40 pid: 9585 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746143765.465531:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a652a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409654 expref: 40 pid: 9585 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746143765.465542:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a652a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409654 expref: 40 pid: 9585 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746143765.465569:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.465585:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622080256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 227us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.465591:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4987 00000100:00100000:0.0:1746143765.465723:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.465742:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.465766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.469533:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.474317:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.476543:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.477328:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.477347:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.478802:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.478855:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.486172:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.488308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.489023:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.495690:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.509986:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.510328:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.510395:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.511147:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.511209:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10833 00000100:00100000:0.0:1746143765.511216:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622083840:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143765.511235:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73a65e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.511252:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a6420 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484095c8 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.511260:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a6523 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409646 expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.511267:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092136e00/0x87925e4cb73a64c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409600 expref: 19 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.511272:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.511273:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.511275:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73a65e7 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.511292:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092136e00/0x87925e4cb73a64c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409600 expref: 19 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.511300:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092136e00/0x87925e4cb73a64c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409600 expref: 19 pid: 12327 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.511308:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626583552:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143765.511543:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a6523 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409646 expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.511551:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a6523 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409646 expref: 41 pid: 3134 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.511567:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626583936:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143765.511589:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a6420 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095c8 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.511597:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a6420 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484095c8 expref: 10 pid: 3134 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746143765.511603:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626584064:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143765.511615:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.511636:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.511653:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.516873:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.516891:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.518270:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.518299:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.518703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.518718:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622085632 00000100:00100000:0.0:1746143765.518721:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622085632 00000100:00100000:0.0:1746143765.519472:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10839 00000100:00100000:0.0:1746143765.519477:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:31587:x1830963622085632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143765.519484:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.519492:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a6611 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484096d9 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.519503:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143765.519514:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a6611 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d9 expref: 40 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.519522:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a6611 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d9 expref: 40 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.519530:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:0.0:1746143765.519545:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:31587:x1830963622085632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 68us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.519550:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10839 00000100:00100000:0.0:1746143765.524695:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.529677:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622086272 00000100:00100000:0.0:1746143765.529683:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622086272 00010000:00010000:0.0:1746143765.529705:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1600/0x87925e4cb73a658c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840969a expref: 40 pid: 9839 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746143765.529727:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5005 00000100:00100000:0.0:1746143765.529733:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622086272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.529743:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.529755:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1600/0x87925e4cb73a658c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840969a expref: 40 pid: 9839 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.529765:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c1600/0x87925e4cb73a658c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840969a expref: 40 pid: 9839 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.529781:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1600/0x87925e4cb73a658c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840969a expref: 40 pid: 9839 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.530252:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.530255:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.530259:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a6603 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.530266:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a6603 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.530590:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.530619:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963622086272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 886us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.530625:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5005 00000100:00100000:0.0:1746143765.538867:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143765.540040:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800918b7400/0x87925e4cb73a65ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540047:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b7400/0x87925e4cb73a65ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540060:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7400/0x87925e4cb73a65ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540067:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7400/0x87925e4cb73a65ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540074:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800918b7400/0x87925e4cb73a65ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540094:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b7400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143765.540097:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918b7400/0x87925e4cb73a65ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540104:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918b7400/0x87925e4cb73a65ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540112:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.540113:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.540118:0:9839:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a660a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d2 expref: 19 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540124:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a660a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d2 expref: 19 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540130:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.540131:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.540134:0:9839:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a6611 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d9 expref: 37 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540139:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a6611 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d9 expref: 37 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.540162:0:9839:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a6611 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d9 expref: 37 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.540171:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626585216:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143765.540236:0:9839:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a660a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d2 expref: 19 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.540244:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626585344:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143765.540783:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.546131:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.547204:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.548529:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.558280:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.559047:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.559071:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.559532:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:1.0:1746143765.559670:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f800 with x1830963622086656 ext(2097152->3145727) 00002000:00010000:1.0:1746143765.559675:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457f800 00000100:00100000:0.0:1746143765.563415:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.563502:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622087936 00000100:00100000:1.0:1746143765.563510:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622087936 00000100:00100000:1.0:1746143765.563555:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12638 00000100:00100000:1.0:1746143765.563562:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31585:x1830963622087936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143765.563578:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.563592:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a6626 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484096ee expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.563631:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a6618 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143765.563638:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a6626 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096ee expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.563652:0:6587:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a6618 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143765.563661:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a6626 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096ee expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.563670:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143765.563672:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143765.563674:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a6626 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096ee expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.563680:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7cc00, rc 0) 00000100:00100000:1.0:1746143765.563714:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31585:x1830963622087936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 151us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.563723:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12638 00000100:00100000:0.0:1746143765.567526:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.567581:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622087808 00000100:00100000:0.0:1746143765.567585:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622087808 00000100:00100000:0.0:1746143765.567605:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10858 00000100:00100000:0.0:1746143765.567609:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:31587:x1830963622087808:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143765.567619:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.567628:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73a662d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484096e7 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.567644:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.567645:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.567650:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73a662d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096e7 expref: 40 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.567659:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73a662d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096e7 expref: 40 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.567672:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048a00, rc 0) 00000100:00100000:0.0:1746143765.567690:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:31587:x1830963622087808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 80us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.567694:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10858 00000100:00100000:0.0:1746143765.569323:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.569372:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.569421:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622088192 00000100:00100000:1.0:1746143765.569427:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622088192 00000100:00100000:1.0:1746143765.569460:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4552 00000100:00100000:1.0:1746143765.569466:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31585:x1830963622088192:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:1.0:1746143765.569553:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31585:x1830963622088192:12345-192.168.202.3@tcp:49:cat.0 Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.569558:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4552 00000100:00100000:0.0:1746143765.570735:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.575361:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626588160 00000100:00100000:1.0:1746143765.575367:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626588160 00000100:00100000:1.0:1746143765.575460:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1746143765.575467:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3774:x1830963626588160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1746143765.575497:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446088704 avail 1316626432 00000100:00100000:1.0:1746143765.575541:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3774:x1830963626588160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.575547:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1746143765.575939:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622088704 00000100:00100000:1.0:1746143765.575943:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622088704 00002000:00100000:1.0:1746143765.575966:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092b49180 x1830963622088704/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.575976:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49180 with x1830963622088704 ext(3145728->4194303) 00002000:00010000:1.0:1746143765.575980:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49180 00000100:00100000:1.0:1746143765.575994:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2867 00000100:00100000:1.0:1746143765.576000:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963622088704:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143765.580301:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622089472 00000100:00100000:1.0:1746143765.580305:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622089472 00000100:00100000:1.0:1746143765.580337:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 688 00000100:00100000:1.0:1746143765.580342:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31588:x1830963622089472:12345-192.168.202.3@tcp:103:mirror_io.0 00010000:00010000:1.0:1746143765.580352:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.580371:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a65cb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096c4 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.580388:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143765.580396:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.580435:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31588:x1830963622089472:12345-192.168.202.3@tcp:103:mirror_io.0 Request processed in 91us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.580441:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 688 00000100:00100000:1.0:1746143765.586007:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963622088704:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10005us (10218us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.586015:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2867 00002000:00100000:1.0:1746143765.586023:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092b49180 x1830963622088704/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.586040:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49180 with x1830963622088704 ext(3145728->4194303) 00002000:00010000:1.0:1746143765.586045:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49180 00000100:00100000:0.0:1746143765.597881:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.598653:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.598682:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.598710:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.598761:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622090496 00000100:00100000:0.0:1746143765.598763:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622090496 00000100:00100000:0.0:1746143765.598786:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10861 00000100:00100000:0.0:1746143765.598789:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622090368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143765.598795:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.598803:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a6649 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409711 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143765.598815:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a14, atime: 0x68140a14, ctime: 0x68140a14, blocks: 0x800 00010000:00010000:0.0:1746143765.598823:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.598824:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.598828:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a6649 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409711 expref: 23 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.598837:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a6649 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409711 expref: 23 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.598850:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2c00, rc 0) 00000100:00100000:0.0:1746143765.598861:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622090368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 71us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.598868:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10861 00000100:00100000:0.0:1746143765.605045:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.608077:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622091136 00000100:00100000:1.0:1746143765.608081:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622091136 00000100:00100000:0.0:1746143765.608131:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626588672 00000100:00100000:1.0:1746143765.608135:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10863 00000100:00100000:1.0:1746143765.608142:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622091264:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143765.608142:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626588672 00010000:00010000:1.0:1746143765.608154:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.608167:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a665e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409734 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.608184:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.608186:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.608193:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a665e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409734 expref: 42 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143765.608198:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00010000:00010000:1.0:1746143765.608206:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a665e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409734 expref: 42 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143765.608207:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963626588672:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1746143765.608213:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d600, rc 0) 00000100:00100000:1.0:1746143765.609009:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622091264:12345-192.168.202.3@tcp:101:cat.0 Request processed in 866us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.609016:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10863 00000100:00100000:1.0:1746143765.609053:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626588416:0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.609061:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963626588672:12345-0@lo:400:kworker.0 Request processed in 854us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.609068:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1746143765.609081:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746143765.609090:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746143765.609093:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746143765.609095:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143765.609100:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3772:1830963626588928:0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.609107:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1746143765.609113:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3773:x1830963626589056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143765.609116:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.609125:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3772:1830963626589440:0@lo:400:kworker.0 00000100:00100000:1.0:1746143765.609145:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.609145:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3773:x1830963626589056:12345-0@lo:400:kworker.0 Request processed in 33us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.609149:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1746143765.609157:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746143765.609158:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626588928 00000100:00100000:0.0:1746143765.609161:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626588928 00000100:00100000:1.0:1746143765.609163:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b99f1f93-ef24-4932-a1b4-452b64359da1:3772:1830963626588288:0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.609174:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626589440 00000100:00100000:0.0:1746143765.609176:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626589440 00000100:00100000:1.0:1746143765.609180:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.609197:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626588800:0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.609206:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:0.0:1746143765.609212:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3772:x1830963626589440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143765.609215:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.609228:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3772:1830963626589312:0@lo:400:kworker.0 00000100:00100000:1.0:1746143765.609246:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.609251:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3772:x1830963626589440:12345-0@lo:400:kworker.0 Request processed in 38us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.609256:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1746143765.609392:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3772:1830963626588928:0@lo:400:kworker.0 00000100:00100000:1.0:1746143765.609401:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3772:1830963626589440:0@lo:400:kworker.0 00000100:00100000:1.0:1746143765.609424:0:8213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626588288 00000100:00100000:1.0:1746143765.609426:0:8213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626588288 00000100:00100000:0.0:1746143765.609428:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626589312 00000100:00100000:0.0:1746143765.609431:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626589312 00000100:00100000:1.0:1746143765.609446:0:8213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1746143765.609449:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1746143765.609451:0:8213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3772:x1830963626588288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.609454:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3772:x1830963626589312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143765.609478:0:8213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3772:x1830963626588288:12345-0@lo:400:kworker.0 Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.609481:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3772:x1830963626589312:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.609484:0:8213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1746143765.609486:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00080000:0.0:1746143765.609495:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746143765.609497:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143765.609498:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143765.609504:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626588416 00000100:00100000:1.0:1746143765.609507:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626588416 00000100:00100000:1.0:1746143765.609523:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1746143765.609527:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3772:x1830963626588416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143765.609550:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3772:x1830963626588416:12345-0@lo:400:kworker.0 Request processed in 23us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.609554:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1746143765.609572:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b99f1f93-ef24-4932-a1b4-452b64359da1:3772:1830963626588288:0@lo:400:kworker.0 00000100:00100000:1.0:1746143765.609580:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3772:1830963626589312:0@lo:400:kworker.0 00000100:00100000:1.0:1746143765.609587:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626588416:0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.609598:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626588672:0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.609613:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3773:1830963626589184:0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.609624:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3773:1830963626588544:0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.609633:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3773:1830963626589056:0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.609731:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.610058:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626588800:0@lo:400:kworker.0 00000100:00100000:0.0:1746143765.617684:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.619850:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.622873:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.632817:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.648748:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.651661:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.652263:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.652377:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.652392:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622092928 00000100:00100000:1.0:1746143765.652398:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622092928 00010000:00010000:1.0:1746143765.652421:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a6634 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096f5 expref: 264 pid: 7244 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746143765.652454:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622093184 00000100:00100000:1.0:1746143765.652457:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622093184 00010000:00010000:1.0:1746143765.652464:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a66b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409742 expref: 265 pid: 10936 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746143765.652483:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5010 00000100:00100000:1.0:1746143765.652488:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:2011:x1830963622092928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.652499:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.652503:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a6634 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096f5 expref: 265 pid: 7244 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746143765.652511:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a6634 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096f5 expref: 265 pid: 7244 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746143765.652527:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a6634 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096f5 expref: 265 pid: 7244 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746143765.652546:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143765.652550:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73a66c7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143765.652556:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73a66c7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143765.652560:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.652590:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:2011:x1830963622092928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 101us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.652595:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5010 00000100:00100000:1.0:1746143765.652608:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5011 00000100:00100000:1.0:1746143765.652612:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2011:x1830963622093184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.652618:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.652621:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a66b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409742 expref: 263 pid: 10936 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746143765.652627:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a66b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409742 expref: 263 pid: 10936 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746143765.652635:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a66b2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409742 expref: 263 pid: 10936 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746143765.652642:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143765.652645:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73a66c7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143765.652648:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73a66c7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143765.652652:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.652662:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+262:2011:x1830963622093184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.652667:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5011 00000100:00100000:0.0:1746143765.654369:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.654415:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622093312 00000100:00100000:1.0:1746143765.654419:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622093312 00000100:00100000:1.0:1746143765.654543:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12644 00000100:00100000:1.0:1746143765.654548:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+262:31596:x1830963622093312:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.654564:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.654576:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73a66ce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409750 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.656214:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73a66c7 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143765.656224:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73a66ce lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409750 expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.656239:0:10936:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73a66c7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143765.656250:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73a66ce lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409750 expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.656259:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143765.656261:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143765.656264:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73a66ce lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409750 expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.656269:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7dc00, rc 0) 00000100:00100000:1.0:1746143765.656303:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:31596:x1830963622093312:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1754us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.656308:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12644 00000100:00100000:1.0:1746143765.658027:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626589952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143765.658075:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.658561:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626590080 00000100:00100000:0.0:1746143765.658569:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626590080 00000100:00100000:0.0:1746143765.658608:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626591104 00000100:00100000:0.0:1746143765.658611:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626591104 00000100:00100000:0.0:1746143765.659166:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626590976 00000100:00100000:0.0:1746143765.659170:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626590976 00000100:00100000:0.0:1746143765.659185:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626591488 00000100:00100000:0.0:1746143765.659187:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626591488 00000100:00100000:0.0:1746143765.659210:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10868 00000100:00100000:0.0:1746143765.659217:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3774:x1830963626590080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143765.659334:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143765.659337:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143761 -> 1746143761 00002000:00010000:0.0:1746143765.659338:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143761 -> 1746143761 00002000:00010000:0.0:1746143765.659340:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143761 -> 1746143761 00002000:00010000:0.0:1746143765.659342:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:0.0:1746143765.659392:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3774:x1830963626590080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (1026us total) trans 21474840153 rc 0/0 00000100:00100000:0.0:1746143765.659399:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10868 00000100:00100000:0.0:1746143765.659413:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10870 00000100:00100000:0.0:1746143765.659417:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3774:x1830963626591104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.659482:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3774:x1830963626591104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1069us total) trans 21474840155 rc 0/0 00000100:00100000:0.0:1746143765.659487:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10870 00000100:00100000:0.0:1746143765.659497:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10872 00000100:00100000:0.0:1746143765.659500:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3774:x1830963626590976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.659570:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3774:x1830963626590976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1093us total) trans 21474840156 rc 0/0 00000100:00100000:0.0:1746143765.659576:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10872 00000100:00100000:0.0:1746143765.659589:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10874 00000100:00100000:0.0:1746143765.659593:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3774:x1830963626591488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143765.659646:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143765.659648:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143765.659649:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143765.659651:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143765.659652:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746143765.659676:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3774:x1830963626591488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (1145us total) trans 17179872840 rc 0/0 00000100:00100000:0.0:1746143765.659682:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10874 00000004:00080000:0.0:1746143765.659731:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ef3800/2, rc 0, transno 17179872839 00000100:00100000:0.0:1746143765.659736:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626591616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143765.659745:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd9f80/2, rc 0, transno 17179872840 00000100:00100000:0.0:1746143765.659747:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626591488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143765.659755:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd8e00/2, rc 0, transno 17179872838 00000100:00100000:0.0:1746143765.659757:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626590464:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143765.659766:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093414a80/2, rc 0, transno 21474840156 00000100:00100000:0.0:1746143765.659787:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626590976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143765.659795:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093414700/2, rc 0, transno 21474840153 00000100:00100000:0.0:1746143765.659798:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626590080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143765.659805:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093417800/2, rc 0, transno 21474840154 00000100:00100000:0.0:1746143765.659814:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626590592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143765.659824:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457f100/2, rc 0, transno 21474840155 00000100:00100000:0.0:1746143765.659827:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626591104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.659836:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143765.659843:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626592000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.660551:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10877 00000100:00100000:1.0:1746143765.660558:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3771:x1830963626591232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143765.660601:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143765.660604:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143765.660606:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143765.660607:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00000100:00100000:0.0:1746143765.660608:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10879 00002000:00010000:1.0:1746143765.660609:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143765.660620:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3771:x1830963626590336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143765.660703:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143765.660707:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143765 -> 1746143765 00002000:00010000:0.0:1746143765.660709:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143763 -> 1746143763 00002000:00010000:0.0:1746143765.660711:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143765 -> 1746143765 00002000:00010000:0.0:1746143765.660713:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143765.660740:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3771:x1830963626591232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (486us total) trans 21474840158 rc 0/0 00000100:00100000:1.0:1746143765.660745:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10877 00000100:00100000:1.0:1746143765.660755:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10882 00000100:00100000:1.0:1746143765.660759:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3771:x1830963626591872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.661193:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3771:x1830963626590336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 576us (857us total) trans 17179872843 rc 0/0 00000100:00100000:1.0:1746143765.661282:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3771:x1830963626591872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 521us (885us total) trans 17179872844 rc 0/0 00000100:00100000:1.0:1746143765.661288:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10882 00000004:00080000:1.0:1746143765.661313:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fdbb80/2, rc 0, transno 17179872837 00000100:00100000:1.0:1746143765.661316:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626589952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.661333:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10879 00000100:00100000:0.0:1746143765.661367:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.661407:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626592000 00000100:00100000:0.0:1746143765.661412:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626592000 00000100:00100000:0.0:1746143765.661450:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10883 00000100:00100000:0.0:1746143765.661486:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3774:x1830963626592000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.661590:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3774:x1830963626592000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (223us total) trans 21474840161 rc 0/0 00000100:00100000:0.0:1746143765.661603:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10883 00000100:00100000:0.0:1746143765.665250:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.665595:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622093440 00000100:00100000:1.0:1746143765.665603:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622093440 00000100:00100000:1.0:1746143765.665649:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4557 00000100:00100000:1.0:1746143765.665656:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+261:31596:x1830963622093440:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:1.0:1746143765.665925:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+261:31596:x1830963622093440:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 253us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.665932:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4557 00000100:00100000:0.0:1746143765.670666:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.670786:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.671614:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622093568 00000100:00100000:1.0:1746143765.671625:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622093568 00000100:00100000:1.0:1746143765.672239:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10885 00000100:00100000:1.0:1746143765.672247:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:31593:x1830963622093568:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.672258:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.672269:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a66dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409757 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.672286:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a660a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d2 expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.672293:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a6611 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d9 expref: 39 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.672299:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.672300:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.672302:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a66dc lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3702784->4157439] (req 3702784->4157439) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409757 expref: 23 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.672323:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a6611 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d9 expref: 39 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.672331:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a6611 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d9 expref: 39 pid: 3134 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746143765.672339:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626592512:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143765.672372:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a660a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d2 expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.672379:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a660a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d2 expref: 23 pid: 12327 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746143765.672391:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626592640:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143765.672407:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800938546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.675601:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.675632:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.675694:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.676115:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626592512:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143765.676125:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626592640:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143765.676149:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a66dc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3702784->4157439] (req 3702784->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409757 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.676164:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c200, rc 0) 00000100:00100000:1.0:1746143765.676208:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:31593:x1830963622093568:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3962us (5554us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.676216:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10885 00000100:00100000:0.0:1746143765.676974:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5015 00000100:00100000:0.0:1746143765.676982:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622094080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.676991:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.677003:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a660a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d2 expref: 23 pid: 12327 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.677011:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a660a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d2 expref: 23 pid: 12327 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.677024:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a660a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484096d2 expref: 23 pid: 12327 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143765.677055:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.677071:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622094080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 91us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.677076:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5015 00000100:00100000:0.0:1746143765.677966:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.680671:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.682589:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.686282:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.686510:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.687623:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.690990:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.691344:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622095488 00000100:00100000:1.0:1746143765.691352:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622095488 00000100:00100000:1.0:1746143765.691947:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4558 00000100:00100000:1.0:1746143765.691956:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013735bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31593:x1830963622095488:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143765.691972:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.692229:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013735bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31593:x1830963622095488:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 274us (1244us total) trans 8589943309 rc 0/0 00000100:00100000:1.0:1746143765.692236:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4558 00000100:00100000:0.0:1746143765.694205:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.694330:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622095872 00000100:00100000:1.0:1746143765.694337:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622095872 00000100:00100000:1.0:1746143765.694429:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4559 00000100:00100000:1.0:1746143765.694436:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+261:31596:x1830963622095872:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143765.694599:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:31596:x1830963622095872:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 163us (401us total) trans 8589943310 rc 0/0 00000100:00100000:1.0:1746143765.694605:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4559 00000100:00100000:1.0:1746143765.735349:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143765.735371:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626593408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746143765.735450:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.737689:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626593408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143765.748208:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.758176:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.758570:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.759510:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.759568:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622096640 00000100:00100000:1.0:1746143765.759573:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622096640 00000100:00100000:1.0:1746143765.759650:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12646 00000100:00100000:1.0:1746143765.759657:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+262:31607:x1830963622096640:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143765.759671:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.759684:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a671b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409781 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.759762:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.759773:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.759784:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.759797:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6729 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.759802:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.759807:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760055:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a6730 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760064:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a6730 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760069:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a6730 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143765.760078:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143765.760152:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760158:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760163:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760169:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760174:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7c000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143765.760177:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760183:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760194:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143765.760197:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143765.760200:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760206:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a6722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760232:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760238:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6729 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760242:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760246:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143765.760248:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760251:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6729 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760257:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012b45f100) 00010000:00010000:1.0:1746143765.760258:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143765.760260:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6729 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760263:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6729 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.760297:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a671b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409781 expref: 265 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.760308:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a6730 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409781 expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.760314:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143765.760316:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143765.760319:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96800, rc 0) 00000100:00100000:1.0:1746143765.760685:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:31607:x1830963622096640:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1027us (1173us total) trans 8589943312 rc 0/0 00000100:00100000:1.0:1746143765.760692:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12646 00000100:00100000:1.0:1746143765.767330:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143765.767344:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626593920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143765.767394:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.767799:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626593920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143765.774480:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.774531:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.774621:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622097024 00000100:00100000:1.0:1746143765.774630:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622097024 00002000:00100000:1.0:1746143765.774680:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b38e00 x1830963622097024/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.774690:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b38e00 with x1830963622097024 ext(0->1048575) 00002000:00010000:1.0:1746143765.774695:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b38e00 00000100:00100000:1.0:1746143765.774728:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622097280 00000100:00100000:1.0:1746143765.774730:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622097280 00002000:00100000:1.0:1746143765.774743:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092b39500 x1830963622097280/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.774750:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b39500 with x1830963622097280 ext(1048576->2097151) 00002000:00010000:1.0:1746143765.774753:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b39500 00000100:00100000:1.0:1746143765.774774:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2877 00000100:00100000:1.0:1746143765.774780:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622097280:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143765.777162:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.782669:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.786763:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.786887:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622097792 00000100:00100000:1.0:1746143765.786898:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622097792 00002000:00100000:1.0:1746143765.786979:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b3a300 x1830963622097792/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.786994:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3a300 with x1830963622097792 ext(0->1048575) 00002000:00010000:1.0:1746143765.787000:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b3a300 00000100:00100000:1.0:1746143765.787040:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2879 00000100:00100000:1.0:1746143765.787047:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963622097792:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143765.790906:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143765.790944:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626594048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746143765.791010:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.791063:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626594048 00000100:00100000:1.0:1746143765.791071:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626594048 00000100:00100000:1.0:1746143765.791109:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1746143765.791116:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3771:x1830963626594048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746143765.791150:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445343232 avail 1315880960 00000100:00100000:1.0:1746143765.791184:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3771:x1830963626594048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.791189:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1746143765.791225:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626594048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143765.793622:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.795146:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.800415:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622097280:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25627us (25875us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.800425:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2877 00002000:00100000:1.0:1746143765.800435:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092b39500 x1830963622097280/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.800443:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b39500 with x1830963622097280 ext(1048576->2097151) 00002000:00010000:1.0:1746143765.800449:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b39500 00000100:00100000:1.0:1746143765.800605:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622097792:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13558us (17947us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.800610:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2879 00002000:00100000:1.0:1746143765.800616:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b3a300 x1830963622097792/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.800623:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3a300 with x1830963622097792 ext(0->1048575) 00002000:00010000:1.0:1746143765.800626:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b3a300 00000100:00100000:0.0:1746143765.824351:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.826242:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.832253:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.832353:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.832694:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622099200 00000100:00100000:1.0:1746143765.832701:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622099200 00000100:00100000:1.0:1746143765.832739:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12647 00000100:00100000:1.0:1746143765.832744:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:31609:x1830963622099200:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.832760:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.832774:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73a674c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840979d expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.832849:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6753 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.832861:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73a66ff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840976c expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.832868:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a6730 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409781 expref: 265 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.832874:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6753 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.832897:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a6730 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409781 expref: 265 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.832907:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a6730 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409781 expref: 265 pid: 10936 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746143765.832940:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626594304:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143765.833000:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73a66ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840976c expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.833008:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73a66ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840976c expref: 10 pid: 7244 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746143765.833015:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626594432:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143765.833046:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.836397:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.838483:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626594304:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143765.840525:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626594432:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143765.840548:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6753 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143765.841120:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.841154:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143765.841666:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6753 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.841673:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6753 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143765.841689:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143765.841783:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73a674c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840979d expref: 266 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.841802:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6753 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840979d expref: 265 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.841807:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143765.841809:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143765.841811:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97200, rc 0) 00000100:00100000:1.0:1746143765.841832:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:31609:x1830963622099200:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9088us (9479us total) trans 8589943313 rc 0/0 00000100:00100000:1.0:1746143765.841838:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12647 00000100:00100000:0.0:1746143765.844460:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.848233:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622100096 00000100:00100000:0.0:1746143765.848242:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622100096 00002000:00100000:0.0:1746143765.848289:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092145180 x1830963622100096/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143765.848312:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145180 with x1830963622100096 ext(1048576->2097151) 00002000:00010000:0.0:1746143765.848318:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092145180 00000100:00100000:0.0:1746143765.848961:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2884 00000100:00100000:0.0:1746143765.848971:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622100096:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143765.851761:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.856120:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622100096:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7151us (8024us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.856125:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2884 00002000:00100000:1.0:1746143765.856128:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092145180 x1830963622100096/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.856133:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145180 with x1830963622100096 ext(1048576->2097151) 00002000:00010000:1.0:1746143765.856135:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092145180 00000100:00100000:0.0:1746143765.859310:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.859450:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622100608 00000100:00100000:1.0:1746143765.859460:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622100608 00002000:00100000:1.0:1746143765.859509:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3117056->3121151) req@ffff880091bcad80 x1830963622100608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.859518:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcad80 with x1830963622100608 ext(3117056->3121151) 00002000:00010000:1.0:1746143765.859524:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bcad80 00000100:00100000:1.0:1746143765.859556:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2886 00000100:00100000:1.0:1746143765.859563:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622100608:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143765.859705:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622100608:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 142us (402us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143765.859711:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2886 00002000:00100000:1.0:1746143765.859716:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3117056->3121151) req@ffff880091bcad80 x1830963622100608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.859724:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcad80 with x1830963622100608 ext(3117056->3121151) 00002000:00010000:1.0:1746143765.859726:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bcad80 00000100:00100000:0.0:1746143765.872414:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.872473:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.872623:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622100736 00000100:00100000:1.0:1746143765.872628:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622100736 00000100:00100000:1.0:1746143765.872669:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10892 00000100:00100000:1.0:1746143765.872675:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31604:x1830963622100736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143765.872685:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.872703:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a6768 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484097a4 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.872727:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c528e00/0x87925e4cb73a66e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409765 expref: 44 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.872735:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.872737:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.872741:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a6768 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097a4 expref: 20 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.872772:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c528e00/0x87925e4cb73a66e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409765 expref: 44 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.872788:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c528e00/0x87925e4cb73a66e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409765 expref: 45 pid: 3134 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746143765.872800:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626594816:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143765.872885:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.876823:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.877208:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626594816:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143765.877237:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e523800/0x87925e4cb73a6768 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097a4 expref: 20 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.877256:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523800, rc 0) 00000100:00100000:1.0:1746143765.877300:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:31604:x1830963622100736:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4624us (4898us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.877309:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10892 00000100:00100000:0.0:1746143765.887624:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.891689:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.891752:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622101504 00000100:00100000:1.0:1746143765.891761:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622101504 00000100:00100000:1.0:1746143765.892125:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10893 00000100:00100000:1.0:1746143765.892133:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:31607:x1830963622101504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143765.892156:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.892175:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e523a00/0x87925e4cb73a676f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484097ab expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.892205:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a66dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409757 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.892217:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.892219:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.892225:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523a00/0x87925e4cb73a676f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097ab expref: 40 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.892257:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a66dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4157439) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409757 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.892268:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a66dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4157439) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409757 expref: 21 pid: 1947 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746143765.892280:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626594944:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143765.892703:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.893100:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.894856:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626594944:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143765.894882:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e523a00/0x87925e4cb73a676f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097ab expref: 40 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.894894:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523a00, rc 0) 00000100:00100000:1.0:1746143765.894950:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:31607:x1830963622101504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2817us (3262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.894958:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10893 00000100:00100000:0.0:1746143765.901045:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.912007:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.912063:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622102016 00000100:00100000:1.0:1746143765.912073:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622102016 00000100:00100000:1.0:1746143765.912136:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12648 00000100:00100000:1.0:1746143765.912144:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31612:x1830963622102016:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.912177:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.912198:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484097b2 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.912420:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912434:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912445:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912458:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a6784 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912463:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a6784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912469:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a6784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912556:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523400/0x87925e4cb73a678b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912566:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523400/0x87925e4cb73a678b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912571:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523400/0x87925e4cb73a678b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143765.912580:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143765.912632:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912642:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912648:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912654:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912659:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e523c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143765.912663:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912670:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912681:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143765.912684:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143765.912688:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912694:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a677d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912724:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a6784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912729:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a6784 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912734:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a6784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912738:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e522c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143765.912741:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a6784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912745:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a6784 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912754:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012b45fd00) 00010000:00010000:1.0:1746143765.912757:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143765.912759:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a6784 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912764:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a6784 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.912808:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b2 expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.912820:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523400/0x87925e4cb73a678b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b2 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.912826:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143765.912828:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143765.912829:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523400, rc 0) 00000100:00100000:1.0:1746143765.913237:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31612:x1830963622102016:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1093us (1239us total) trans 8589943314 rc 0/0 00000100:00100000:1.0:1746143765.913243:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12648 00000100:00100000:0.0:1746143765.915680:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.919190:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622102528 00000100:00100000:1.0:1746143765.919201:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622102528 00002000:00100000:1.0:1746143765.919247:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880092146a00 x1830963622102528/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 504/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.919263:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146a00 with x1830963622102528 ext(2097152->4194303) 00010000:00010000:1.0:1746143765.919274:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a66dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409757 expref: 24 pid: 1947 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746143765.919289:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a66dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409757 expref: 24 pid: 1947 timeout: 925 lvb_type: 0 00002000:00010000:1.0:1746143765.919295:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092146a00 00000100:00100000:1.0:1746143765.919331:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1281 00000100:00100000:1.0:1746143765.919340:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622102528:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143765.929693:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.929765:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622102656 00000100:00100000:1.0:1746143765.929775:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622102656 00000100:00100000:1.0:1746143765.929836:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10894 00000100:00100000:1.0:1746143765.929843:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:31612:x1830963622102656:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.929861:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.929879:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484097b9 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.930006:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a6650 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840970a expref: 27 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.930014:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73a6665 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409726 expref: 39 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.930020:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.930023:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.930038:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1728512->2039807] (req 1728512->2039807) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b9 expref: 27 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.930070:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73a6665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409726 expref: 39 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.930081:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73a6665 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409726 expref: 39 pid: 9587 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746143765.930094:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626595200:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143765.930203:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a6650 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840970a expref: 27 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.930212:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a6650 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840970a expref: 27 pid: 13436 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746143765.930220:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626595328:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143765.930282:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.932525:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.932672:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626595200:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143765.932683:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626595328:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143765.932710:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1728512->2039807] (req 1728512->2039807) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b9 expref: 27 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.932727:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32800, rc 0) 00000100:00100000:1.0:1746143765.932773:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:31612:x1830963622102656:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2930us (3090us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.932782:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10894 00000100:00100000:1.0:1746143765.932897:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622102528:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13559us (14147us total) trans 0 rc 1642496/1642496 00000100:00100000:1.0:1746143765.932904:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1281 00002000:00100000:1.0:1746143765.932935:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880092146a00 x1830963622102528/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 504/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 1642496/1642496 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.932944:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146a00 with x1830963622102528 ext(2097152->4194303) 00010000:00010000:1.0:1746143765.932950:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a66dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409757 expref: 25 pid: 1947 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746143765.932962:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a66dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409757 expref: 25 pid: 1947 timeout: 925 lvb_type: 0 00002000:00010000:1.0:1746143765.932968:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092146a00 00000100:00100000:0.0:1746143765.933134:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.933149:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622102912 00000100:00100000:0.0:1746143765.933152:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622102912 00010000:00010000:0.0:1746143765.933166:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a6650 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840970a expref: 25 pid: 13436 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143765.933185:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5024 00000100:00100000:0.0:1746143765.933191:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622102912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.933209:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.933218:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a6650 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840970a expref: 25 pid: 13436 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143765.933227:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a6650 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840970a expref: 25 pid: 13436 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143765.933240:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a6650 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840970a expref: 25 pid: 13436 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143765.933260:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.933261:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.933268:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2039807) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b9 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.933399:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2039807) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b9 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.933429:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2039807) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b9 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.933441:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bcb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626595456:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143765.933498:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.933511:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622103040 00000100:00100000:1.0:1746143765.933515:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622103040 00000100:00100000:0.0:1746143765.935507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.935589:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622103296 00000100:00100000:1.0:1746143765.935595:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622103296 00002000:00100000:1.0:1746143765.935633:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1728512->1732607) req@ffff880095c3b100 x1830963622103296/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.935643:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b100 with x1830963622103296 ext(1728512->1732607) 00002000:00010000:1.0:1746143765.935647:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3b100 00000100:00100000:1.0:1746143765.935676:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2889 00000100:00100000:1.0:1746143765.935683:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622103296:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143765.936292:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622103296:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 608us (792us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143765.936299:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2889 00002000:00100000:1.0:1746143765.936305:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1728512->1732607) req@ffff880095c3b100 x1830963622103296/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.936312:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b100 with x1830963622103296 ext(1728512->1732607) 00002000:00010000:1.0:1746143765.936314:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3b100 00000100:00100000:0.0:1746143765.937649:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.939788:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.941312:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.941845:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2891 00000100:00100000:1.0:1746143765.941855:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622103936:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143765.945650:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.945726:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.950018:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622103936:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8153us (8698us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.950045:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2891 00002000:00100000:1.0:1746143765.950057:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880095c39c00 x1830963622103936/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.950066:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39c00 with x1830963622103936 ext(2097152->3145727) 00002000:00010000:1.0:1746143765.950072:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c39c00 00000100:00100000:0.0:1746143765.959280:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.966631:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143765.966685:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.967144:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622105088 00000100:00100000:1.0:1746143765.967148:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622105088 00002000:00100000:1.0:1746143765.967186:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880095c39f80 x1830963622105088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.967195:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39f80 with x1830963622105088 ext(3145728->4194303) 00002000:00010000:1.0:1746143765.967200:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c39f80 00000100:00100000:1.0:1746143765.967236:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2893 00000100:00100000:1.0:1746143765.967243:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622105088:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143765.971015:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.974848:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622105088:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7592us (8150us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.974862:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2893 00002000:00100000:1.0:1746143765.974874:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880095c39f80 x1830963622105088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.974884:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39f80 with x1830963622105088 ext(3145728->4194303) 00002000:00010000:1.0:1746143765.974890:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c39f80 00000100:00100000:0.0:1746143765.987659:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143765.987755:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622105856 00000100:00100000:1.0:1746143765.987765:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622105856 00000100:00100000:0.0:1746143765.987816:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622105984 00000100:00100000:0.0:1746143765.987820:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622105984 00000100:00100000:0.0:1746143765.987880:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10897 00000100:00100000:1.0:1746143765.987883:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12649 00000100:00100000:1.0:1746143765.987888:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:31615:x1830963622105856:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:0.0:1746143765.987888:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622105984:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143765.987907:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.987907:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.987943:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a67b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484097ce expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.987944:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a67ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484097d5 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.987995:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626595840:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143765.988015:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988037:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988048:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988062:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988067:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988072:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143765.988082:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00010000:00010000:1.0:1746143765.988167:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a67ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988177:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a67ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988182:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a67ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143765.988191:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143765.988266:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988271:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988276:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988281:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988287:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb5a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143765.988291:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988297:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988308:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143765.988311:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143765.988315:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988323:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988337:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988342:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988346:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988349:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb4a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143765.988613:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988619:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988626:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012b45f100) 00010000:00010000:1.0:1746143765.988628:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143765.988630:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988635:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143765.988670:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a67b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097ce expref: 268 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.988685:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a67ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097ce expref: 267 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.988694:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143765.988696:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143765.988699:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb5600, rc 0) 00000100:00100000:1.0:1746143765.988885:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+267:31615:x1830963622105856:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 994us (1226us total) trans 8589943316 rc 0/0 00000100:00100000:1.0:1746143765.988892:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12649 00000100:00100000:1.0:1746143765.988933:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622105600 00000100:00100000:1.0:1746143765.988937:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622105600 00000100:00100000:1.0:1746143765.988971:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4561 00000100:00100000:1.0:1746143765.988977:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:31604:x1830963622105600:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143765.989084:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:31604:x1830963622105600:12345-192.168.202.3@tcp:35:cat.0 Request processed in 107us (1434us total) trans 8589943317 rc 0/0 00000100:00100000:1.0:1746143765.989090:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4561 00002000:00010000:0.0:1746143765.989689:0:3134:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime: 1746143763 -> 1746143766 00002000:00010000:0.0:1746143765.989692:0:3134:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143763 -> 1746143766 00002000:00010000:0.0:1746143765.989694:0:3134:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime: 1746143763 -> 1746143766 00000100:00100000:0.0:1746143765.989708:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626595840:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143765.989729:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a67ae lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097d5 expref: 40 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.989738:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a67ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097d5 expref: 40 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.989775:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f800, rc 0) 00000100:00100000:0.0:1746143765.989804:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622105984:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1916us (2045us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143765.989809:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10897 00000100:00100000:1.0:1746143765.990370:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622106240 00000100:00100000:1.0:1746143765.990375:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622106240 00000100:00100000:1.0:1746143765.991011:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4562 00000100:00100000:1.0:1746143765.991019:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+267:31615:x1830963622106240:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143765.991188:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:31615:x1830963622106240:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 170us (874us total) trans 8589943318 rc 0/0 00000100:00100000:1.0:1746143765.991195:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4562 00000100:00100000:0.0:1746143765.999073:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.017404:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.017460:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.020138:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622106624 00000100:00100000:1.0:1746143766.020153:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622106624 00000100:00100000:1.0:1746143766.020255:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12650 00000100:00100000:1.0:1746143766.020266:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:31617:x1830963622106624:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143766.020300:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.020321:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a67d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484097dc expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.020402:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.020415:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.020426:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.020440:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.020446:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.020452:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.020528:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec91400/0x87925e4cb73a67ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.020538:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6753 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840979d expref: 267 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.020545:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec91400/0x87925e4cb73a67ed lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.020580:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6753 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840979d expref: 267 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.020596:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a6753 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840979d expref: 267 pid: 10936 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746143766.020609:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626595968:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.020701:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854c00 going to sleep for 11 seconds 00000100:00080000:1.0:1746143766.020847:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143766.024314:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626595968:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.024329:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec91400/0x87925e4cb73a67ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024581:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec91400/0x87925e4cb73a67ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024587:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec91400/0x87925e4cb73a67ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143766.024646:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143766.024651:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143766.024669:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec91400/0x87925e4cb73a67ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024679:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec91400/0x87925e4cb73a67ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024690:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024695:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024701:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024705:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024720:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb4a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143766.024723:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024729:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024737:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143766.024740:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143766.024742:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024747:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a67df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024769:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024774:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024778:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024781:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb5a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143766.024783:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024787:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024792:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093ba5500) 00010000:00010000:0.0:1746143766.024794:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143766.024801:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024805:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a67e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.024835:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a67d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097dc expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.024845:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec91400/0x87925e4cb73a67ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097dc expref: 7 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.024851:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143766.024852:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143766.024854:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec91400, rc 0) 00000100:00100000:0.0:1746143766.025304:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31617:x1830963622106624:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 5040us (7911us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.025309:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12650 00000100:00100000:0.0:1746143766.036254:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.041568:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.041652:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.041666:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.042157:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.042599:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622107520 00000100:00100000:0.0:1746143766.042603:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622107520 00000100:00100000:0.0:1746143766.042628:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10900 00000100:00100000:0.0:1746143766.042636:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622107136:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143766.042657:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.042675:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28400/0x87925e4cb73a6802 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484097f1 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.042732:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626596224:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143766.042800:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.042830:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10901 00000100:00100000:0.0:1746143766.042836:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622107264:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143766.042842:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.042851:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a6809 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484097f8 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.042862:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.042864:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.042873:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a6809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097f8 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.042887:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a6809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097f8 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.042898:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28a00, rc 0) 00000100:00100000:0.0:1746143766.042938:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622107264:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 101us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.042944:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10901 00000100:00100000:0.0:1746143766.042963:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10902 00000100:00100000:0.0:1746143766.042968:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622107520:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143766.042974:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.042983:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a6810 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409806 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.042994:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.042995:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.043000:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a6810 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409806 expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.043016:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a6810 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409806 expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.043023:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e29a00, rc 0) 00000100:00100000:0.0:1746143766.043048:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622107520:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 80us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.043054:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10902 00000100:00100000:0.0:1746143766.044082:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.044499:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.049938:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.054570:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.055774:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143766.055863:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73a6833 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.055870:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73a6833 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143766.055891:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143766.060288:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73a682c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840981b expref: 9 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.060329:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73a6833 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840981b expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.060338:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143766.060341:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143766.060344:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24c00, rc 0) 00000100:00100000:1.0:1746143766.060415:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31617:x1830963622108032:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 10389us (10477us total) trans 8589943320 rc 0/0 00000100:00100000:1.0:1746143766.060423:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12651 00000100:00100000:0.0:1746143766.070725:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.070818:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622108672 00000100:00100000:1.0:1746143766.070827:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622108672 00000100:00100000:1.0:1746143766.070886:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12652 00000100:00100000:1.0:1746143766.070894:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31617:x1830963622108672:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143766.070945:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.070949:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143766.070981:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73a6833 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840981b expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.071013:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143766.071019:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143766.071039:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a6841 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409822 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.071148:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466800/0x87925e4cb73a6848 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.071161:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466800/0x87925e4cb73a6848 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.071171:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466800/0x87925e4cb73a6848 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.071182:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466800/0x87925e4cb73a6848 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.071187:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466800/0x87925e4cb73a6848 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.071193:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466800/0x87925e4cb73a6848 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.071203:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d466800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143766.071207:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466800/0x87925e4cb73a6848 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.071214:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466800/0x87925e4cb73a6848 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.071221:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143766.071223:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143766.071226:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466800/0x87925e4cb73a6848 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.071231:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466800/0x87925e4cb73a6848 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.071256:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a6841 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409822 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.071263:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a6841 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409822 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.071270:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466c00, rc 0) 00000100:00100000:1.0:1746143766.071322:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31617:x1830963622108672:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 429us (609us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.071329:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12652 00000100:00100000:0.0:1746143766.073429:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.078834:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:1.0:1746143766.080094:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143766.119338:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.119439:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.133543:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.133589:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.133663:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.134106:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622110080 00000100:00100000:1.0:1746143766.134110:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622110080 00002000:00100000:1.0:1746143766.134140:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8800939a7800 x1830963622110080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 504/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.134154:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7800 with x1830963622110080 ext(1048576->2097151) 00002000:00010000:1.0:1746143766.134158:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a7800 00000100:00100000:1.0:1746143766.134171:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2897 00000100:00100000:1.0:1746143766.134177:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622110080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143766.145743:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622110080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11550us (12063us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746143766.145756:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2897 00002000:00100000:1.0:1746143766.145830:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8800939a7800 x1830963622110080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 504/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.145839:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7800 with x1830963622110080 ext(1048576->2097151) 00002000:00010000:1.0:1746143766.145846:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a7800 00000100:00100000:0.0:1746143766.146077:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.149385:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622110464 00000100:00100000:1.0:1746143766.149401:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622110464 00002000:00100000:1.0:1746143766.149462:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2359296->2363391) req@ffff8800939a5180 x1830963622110464/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.149473:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5180 with x1830963622110464 ext(2359296->2363391) 00002000:00010000:1.0:1746143766.149479:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a5180 00000100:00100000:1.0:1746143766.149529:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2898 00000100:00100000:1.0:1746143766.149540:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622110464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143766.149751:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622110464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 210us (3671us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143766.149758:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2898 00002000:00100000:1.0:1746143766.149766:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2359296->2363391) req@ffff8800939a5180 x1830963622110464/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.149773:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5180 with x1830963622110464 ext(2359296->2363391) 00002000:00010000:1.0:1746143766.149776:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a5180 00000100:00100000:0.0:1746143766.162517:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.198562:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.198761:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622110976 00000100:00100000:1.0:1746143766.198772:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622110976 00000100:00100000:1.0:1746143766.198839:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4565 00000100:00100000:1.0:1746143766.198848:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:31619:x1830963622110976:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143766.199238:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31619:x1830963622110976:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 389us (686us total) trans 8589943324 rc 0/0 00000100:00100000:1.0:1746143766.199245:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4565 00000100:00100000:1.0:1746143766.204550:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.205511:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.211951:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.211993:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.213740:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.214869:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.214933:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622111872 00000100:00100000:0.0:1746143766.214936:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622111872 00010000:00010000:0.0:1746143766.214949:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a6642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409703 expref: 20 pid: 13436 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143766.214963:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5033 00000100:00100000:0.0:1746143766.214967:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622111872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.214973:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143766.214980:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a6642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409703 expref: 20 pid: 13436 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143766.214988:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a6642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409703 expref: 20 pid: 13436 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143766.214998:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a6642 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409703 expref: 20 pid: 13436 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143766.215008:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.215010:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.215016:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a688e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840983e expref: 44 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.215047:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a688e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840983e expref: 44 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.215079:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a688e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840983e expref: 44 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.215090:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626597504:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143766.215136:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.218633:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.218711:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.219060:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622112128 00000100:00100000:0.0:1746143766.219064:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622112128 00000100:00100000:0.0:1746143766.219091:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10909 00000100:00100000:1.0:1746143766.219314:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963622112128:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.219325:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.219340:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a689c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840984c expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.219395:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626597632:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143766.219479:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800938546c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143766.220566:0:12328:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime: 1746143761 -> 1746143766 00002000:00010000:1.0:1746143766.220570:0:12328:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime: 1746143761 -> 1746143766 00002000:00010000:1.0:1746143766.220572:0:12328:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime: 1746143761 -> 1746143766 00000100:00100000:1.0:1746143766.220584:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626597632:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143766.220604:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a689c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840984c expref: 20 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.220617:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a689c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840984c expref: 20 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.220679:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467400, rc 0) 00000100:00100000:1.0:1746143766.220798:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963622112128:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1700us (2170us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.220804:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10909 00000100:00100000:1.0:1746143766.227071:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622112384 00000100:00100000:1.0:1746143766.227081:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622112384 00000100:00100000:1.0:1746143766.227140:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10910 00000100:00100000:1.0:1746143766.227149:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+39:31615:x1830963622112384:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143766.227170:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.227187:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d467200/0x87925e4cb73a68a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409853 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.227218:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2039807) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b9 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.227226:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.227227:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.227231:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467200/0x87925e4cb73a68a3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->1347583] (req 1048576->1347583) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409853 expref: 40 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.227263:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2039807) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b9 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.227281:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2039807) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b9 expref: 23 pid: 3134 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746143766.227294:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626597760:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.227384:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800938546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.230005:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626597760:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.230048:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d467200/0x87925e4cb73a68a3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->1347583] (req 1048576->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409853 expref: 40 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.230065:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467200, rc 0) 00000100:00100000:1.0:1746143766.230378:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+40:31615:x1830963622112384:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3228us (3521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.230387:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10910 00000100:00100000:0.0:1746143766.230512:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.235525:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622112512:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4018us (5001us total) trans 17179872846 rc 0/0 00000100:00100000:0.0:1746143766.235540:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1282 00002000:00100000:0.0:1746143766.235551:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1728512->2039807) req@ffff880094195c00 x1830963622112512/t17179872846(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.235561:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195c00 with x1830963622112512 ext(1728512->2039807) 00010000:00010000:0.0:1746143766.235572:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2039807) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b9 expref: 26 pid: 3134 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143766.235588:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73a6799 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2039807) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097b9 expref: 26 pid: 3134 timeout: 925 lvb_type: 0 00002000:00010000:0.0:1746143766.235609:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094195c00 00000100:00100000:0.0:1746143766.239017:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.243386:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.247719:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.247843:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622113152 00000100:00100000:1.0:1746143766.247852:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622113152 00000100:00100000:1.0:1746143766.248487:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4566 00000100:00100000:1.0:1746143766.248496:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:31615:x1830963622113152:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143766.248722:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:31615:x1830963622113152:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 226us (1013us total) trans 8589943325 rc 0/0 00000100:00100000:1.0:1746143766.248729:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4566 00000100:00100000:0.0:1746143766.283247:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622113408 00000100:00100000:0.0:1746143766.283257:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622113408 00000100:00100000:0.0:1746143766.283307:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12655 00000100:00100000:0.0:1746143766.283315:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+269:31630:x1830963622113408:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143766.283341:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.283362:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73a68aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840985a expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.283445:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.283458:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143766.284153:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284211:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a68b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284220:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a68b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284228:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a68b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284351:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a68bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284361:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a68bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284368:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a68bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143766.284377:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143766.284461:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284466:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284472:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284478:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284483:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082048e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143766.284487:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284493:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284504:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143766.284507:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143766.284511:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284516:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a68b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284545:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a68b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284550:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a68b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284554:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a68b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284558:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d466c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143766.284559:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a68b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284563:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a68b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284569:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012b45fd00) 00010000:00010000:1.0:1746143766.284571:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143766.284573:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a68b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284577:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73a68b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143766.284622:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73a68aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840985a expref: 272 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.284638:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a68bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840985a expref: 271 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.284643:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143766.284645:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143766.284648:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467400, rc 0) 00000100:00100000:1.0:1746143766.284712:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+271:31630:x1830963622113408:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1396us (1652us total) trans 8589943326 rc 0/0 00000100:00100000:1.0:1746143766.284720:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12655 00000100:00100000:0.0:1746143766.289270:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.289369:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622113536 00000100:00100000:1.0:1746143766.289380:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622113536 00000100:00100000:1.0:1746143766.289518:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10911 00000100:00100000:1.0:1746143766.289528:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963622113536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.289547:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.289566:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec91400/0x87925e4cb73a68cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409861 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.289625:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626598016:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143766.289991:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800938549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.299971:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.300463:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.300654:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622113920 00000100:00100000:1.0:1746143766.300665:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622113920 00002000:00100000:1.0:1746143766.300719:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->380927) req@ffff88012b1d9180 x1830963622113920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.300730:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9180 with x1830963622113920 ext(0->380927) 00002000:00010000:1.0:1746143766.300736:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d9180 00000100:00100000:1.0:1746143766.300757:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622114048 00000100:00100000:1.0:1746143766.300760:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622114048 00002000:00100000:1.0:1746143766.300772:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1347584->2097151) req@ffff88012b1da300 x1830963622114048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.300778:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da300 with x1830963622114048 ext(1347584->2097151) 00002000:00010000:1.0:1746143766.300781:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1da300 00000100:00100000:1.0:1746143766.301191:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2903 00000100:00100000:1.0:1746143766.301200:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622113920:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143766.309907:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622113920:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8691us (9931us total) trans 0 rc 380928/380928 00000100:00100000:1.0:1746143766.309935:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2903 00002000:00100000:1.0:1746143766.309950:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->380927) req@ffff88012b1d9180 x1830963622113920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 380928/380928 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.309960:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9180 with x1830963622113920 ext(0->380927) 00002000:00010000:1.0:1746143766.309966:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d9180 00000100:00100000:0.0:1746143766.318603:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.323002:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.323091:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622114304 00000100:00100000:1.0:1746143766.323100:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622114304 00002000:00100000:1.0:1746143766.323244:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2359296->2781183) req@ffff88012b1d9500 x1830963622114304/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.323255:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9500 with x1830963622114304 ext(2359296->2781183) 00010000:00010000:1.0:1746143766.323264:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092b24600/0x87925e4cb73a6887 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409830 expref: 19 pid: 12328 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746143766.323277:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092b24600/0x87925e4cb73a6887 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409830 expref: 19 pid: 12328 timeout: 925 lvb_type: 0 00002000:00010000:1.0:1746143766.323288:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1d9500 00000100:00100000:1.0:1746143766.323321:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1283 00000100:00100000:1.0:1746143766.323329:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622114304:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143766.328053:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622114304:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4712us (5128us total) trans 21474840164 rc 0/0 00000100:00100000:1.0:1746143766.328066:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1283 00002000:00100000:1.0:1746143766.328078:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2359296->2781183) req@ffff88012b1d9500 x1830963622114304/t21474840164(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.328088:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9500 with x1830963622114304 ext(2359296->2781183) 00010000:00010000:1.0:1746143766.328100:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092b24600/0x87925e4cb73a6887 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409830 expref: 21 pid: 12328 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746143766.328116:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092b24600/0x87925e4cb73a6887 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409830 expref: 21 pid: 12328 timeout: 925 lvb_type: 0 00002000:00010000:1.0:1746143766.328123:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1d9500 00000100:00100000:0.0:1746143766.333323:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.342066:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.342191:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622114688 00000100:00100000:1.0:1746143766.342201:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622114688 00002000:00100000:1.0:1746143766.342252:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012b1d8a80 x1830963622114688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.342262:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8a80 with x1830963622114688 ext(2097152->4194303) 00002000:00010000:1.0:1746143766.342269:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d8a80 00000100:00100000:1.0:1746143766.342301:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2905 00000100:00100000:1.0:1746143766.342311:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622114688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143766.344681:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.360493:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.365560:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10916 00000100:00100000:0.0:1746143766.365586:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:31633:x1830963622115200:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143766.365610:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.365632:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a68f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409884 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.365663:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a688e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840983e expref: 45 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.365671:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143766.365672:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143766.365675:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a68f0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409884 expref: 22 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.365709:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a688e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840983e expref: 45 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.365722:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a688e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840983e expref: 45 pid: 12328 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746143766.365734:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626598656:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143766.366067:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.369820:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.372004:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.372806:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626598656:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.372841:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a68f0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409884 expref: 22 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.372861:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28c00, rc 0) 00000100:00100000:1.0:1746143766.372935:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:31633:x1830963622115200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7362us (12452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.372944:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10916 00000100:00100000:0.0:1746143766.375801:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622115840 00000100:00100000:0.0:1746143766.375817:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622115840 00000100:00100000:0.0:1746143766.375872:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12656 00000100:00100000:0.0:1746143766.375880:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+271:31635:x1830963622115840:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143766.375900:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.375939:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73a68f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840988b expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.376057:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a68fe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143766.376366:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a6864 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409829 expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.376374:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a68bf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840985a expref: 272 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.376382:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a68fe lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143766.376414:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a68bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840985a expref: 272 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.376424:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a68bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840985a expref: 272 pid: 10936 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746143766.376435:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626598784:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143766.376746:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a6864 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409829 expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.376753:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a6864 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409829 expref: 18 pid: 7244 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746143766.376768:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626598912:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143766.376789:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.380252:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.380276:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.380293:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622116096 00000100:00100000:0.0:1746143766.380300:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622116096 00010000:00010000:0.0:1746143766.380328:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a6864 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409829 expref: 19 pid: 7244 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746143766.380416:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626598784:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.380425:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626598912:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.380447:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a68fe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143766.380624:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622115968 00000100:00100000:0.0:1746143766.380628:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622115968 00010000:00010000:0.0:1746143766.380639:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a68bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840985a expref: 273 pid: 10936 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746143766.380661:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5036 00000100:00100000:0.0:1746143766.380667:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622116096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.380680:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143766.380685:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a6864 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409829 expref: 19 pid: 7244 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143766.380694:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a6864 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409829 expref: 19 pid: 7244 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143766.380988:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a6864 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409829 expref: 19 pid: 7244 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143766.381009:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143766.381020:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a68fe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143766.381039:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a68fe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143766.381045:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a68fe lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143766.381061:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143766.381083:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622116096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 416us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.381089:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5036 00010000:00010000:1.0:1746143766.381188:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a68fe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.381194:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a68fe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143766.381217:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143766.381360:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73a68f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840988b expref: 273 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.381377:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a68fe lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840988b expref: 272 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.381382:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143766.381386:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143766.381388:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28400, rc 0) 00000100:00100000:1.0:1746143766.381544:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:31635:x1830963622115840:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5665us (7672us total) trans 8589943327 rc 0/0 00000100:00100000:1.0:1746143766.381550:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12656 00000100:00100000:0.0:1746143766.385983:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.386348:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622116224 00000100:00100000:1.0:1746143766.386357:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622116224 00000100:00100000:1.0:1746143766.386394:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10917 00000100:00100000:1.0:1746143766.386401:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963622116224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.386416:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.386432:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d9c400/0x87925e4cb73a690c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409892 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.386623:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626599040:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143766.387266:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.388654:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626599040:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143766.388683:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d9c400/0x87925e4cb73a690c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409892 expref: 49 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.388695:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d9c400/0x87925e4cb73a690c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409892 expref: 49 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.388706:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9c400, rc 0) 00000100:00100000:1.0:1746143766.388750:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963622116224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2349us (2775us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.388758:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10917 00000100:00100000:0.0:1746143766.390349:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.392081:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622116480 00000100:00100000:1.0:1746143766.392086:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622116480 00000100:00100000:1.0:1746143766.392317:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10918 00000100:00100000:1.0:1746143766.392324:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963622116480:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.392337:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.392347:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466c00/0x87925e4cb73a6913 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409899 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.392361:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.392362:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.392368:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466c00/0x87925e4cb73a6913 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409899 expref: 49 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.392378:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466c00/0x87925e4cb73a6913 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409899 expref: 49 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.392386:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466c00, rc 0) 00000100:00100000:1.0:1746143766.392422:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+49:2009:x1830963622116480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 99us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.392427:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10918 00000100:00100000:0.0:1746143766.395484:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.412703:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.416248:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.423042:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.423398:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622117504 00000100:00100000:1.0:1746143766.423409:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622117504 00000100:00100000:1.0:1746143766.423479:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12657 00000100:00100000:1.0:1746143766.423488:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:31639:x1830963622117504:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143766.423514:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.423534:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73a6921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484098a7 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.423647:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a6928 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.423662:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a6928 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.423674:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a6928 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143766.423685:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143766.423779:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73a6921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098a7 expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.423802:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a6928 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098a7 expref: 20 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.423810:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143766.423813:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1746143766.423815:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143766.423816:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467400, rc 0) 00000100:00100000:1.0:1746143766.424438:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:31639:x1830963622117504:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 950us (1402us total) trans 8589943329 rc 0/0 00000100:00100000:1.0:1746143766.424445:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12657 00000100:00100000:0.0:1746143766.429293:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.460281:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.476567:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.477713:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.489834:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.489891:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.503948:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.504004:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.518620:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.518716:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.518739:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622119936 00000100:00100000:1.0:1746143766.518748:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622119936 00000100:00100000:1.0:1746143766.518796:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12658 00000100:00100000:1.0:1746143766.518803:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:31641:x1830963622119936:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143766.518832:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.518853:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a694b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484098c3 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.518950:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.518964:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.518975:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.518987:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6959 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.518993:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6959 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.518998:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6959 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519098:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c600/0x87925e4cb73a6960 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519109:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c600/0x87925e4cb73a6960 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519114:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c600/0x87925e4cb73a6960 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143766.519122:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143766.519189:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519198:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519204:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519210:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519215:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7de00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143766.519219:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519225:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519234:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143766.519236:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143766.519240:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519245:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73a6952 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519259:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6959 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519263:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6959 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519266:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6959 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519270:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7d400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143766.519272:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6959 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519276:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6959 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519281:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012b45f100) 00010000:00010000:1.0:1746143766.519283:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143766.519285:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6959 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519288:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6959 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.519320:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a694b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098c3 expref: 276 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.519329:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c600/0x87925e4cb73a6960 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098c3 expref: 275 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.519334:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143766.519336:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143766.519338:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c600, rc 0) 00000100:00100000:1.0:1746143766.519369:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:31641:x1830963622119936:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 566us (653us total) trans 8589943330 rc 0/0 00000100:00100000:1.0:1746143766.519374:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12658 00000100:00100000:0.0:1746143766.522264:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.522319:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.522398:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622120320 00000100:00100000:1.0:1746143766.522405:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622120320 00000100:00100000:1.0:1746143766.522447:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4568 00000100:00100000:1.0:1746143766.522454:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:31641:x1830963622120320:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143766.523447:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:31641:x1830963622120320:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 991us (1125us total) trans 8589943331 rc 0/0 00000100:00100000:1.0:1746143766.523454:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4568 00000100:00100000:0.0:1746143766.533430:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.537602:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.537847:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622120576 00000100:00100000:1.0:1746143766.537853:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622120576 00010000:00010000:1.0:1746143766.537880:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25000/0x87925e4cb73a6825 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409814 expref: 10 pid: 3135 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746143766.537934:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5043 00000100:00100000:1.0:1746143766.537941:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622120576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.537952:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.537971:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b25000/0x87925e4cb73a6825 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409814 expref: 10 pid: 3135 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746143766.537980:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b25000/0x87925e4cb73a6825 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409814 expref: 10 pid: 3135 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746143766.538000:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25000/0x87925e4cb73a6825 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409814 expref: 10 pid: 3135 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746143766.538016:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.538046:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622120576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.538052:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5043 00000100:00100000:0.0:1746143766.539275:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.539998:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.540034:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622120704 00000100:00100000:1.0:1746143766.540040:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622120704 00010000:00010000:1.0:1746143766.540068:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523a00/0x87925e4cb73a676f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097ab expref: 42 pid: 3134 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746143766.540089:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622120832 00000100:00100000:1.0:1746143766.540091:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622120832 00010000:00010000:1.0:1746143766.540100:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73a67a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097c0 expref: 26 pid: 12328 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746143766.540126:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5045 00000100:00100000:1.0:1746143766.540131:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622120832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.540138:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.540146:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73a67a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097c0 expref: 26 pid: 12328 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746143766.540158:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73a67a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097c0 expref: 26 pid: 12328 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746143766.540254:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73a67a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097c0 expref: 26 pid: 12328 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746143766.540290:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.540324:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622120832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 191us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.540330:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5045 00000100:00100000:0.0:1746143766.542299:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.548482:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.634047:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.634116:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622121600 00000100:00100000:1.0:1746143766.634126:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622121600 00000100:00100000:1.0:1746143766.634190:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12659 00000100:00100000:1.0:1746143766.634198:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:31647:x1830963622121600:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.634222:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.634241:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a6975 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484098d1 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.634315:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634327:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634337:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634349:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6983 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634355:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634361:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634451:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73a698a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634459:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73a698a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634464:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73a698a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143766.634472:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143766.634543:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634552:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634557:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634563:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634568:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7c800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143766.634572:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634578:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634589:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143766.634591:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143766.634594:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634599:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a697c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634630:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634634:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6983 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634638:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6983 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634642:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7d200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143766.634645:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6983 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634649:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6983 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634655:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093ba5500) 00010000:00010000:1.0:1746143766.634657:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143766.634660:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6983 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634664:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6983 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143766.634697:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a6975 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098d1 expref: 278 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.634709:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73a698a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098d1 expref: 277 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.634715:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143766.634717:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143766.634719:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ce00, rc 0) 00000100:00100000:1.0:1746143766.634776:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+277:31647:x1830963622121600:12345-192.168.202.3@tcp:101:cat.0 Request processed in 578us (754us total) trans 8589943332 rc 0/0 00000100:00100000:1.0:1746143766.634782:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12659 00000100:00100000:0.0:1746143766.636999:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.640497:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.640560:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.640999:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622121856 00000100:00100000:1.0:1746143766.641366:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622121856 00000100:00100000:1.0:1746143766.641391:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10925 00000100:00100000:1.0:1746143766.641396:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963622121856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.641407:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.641418:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7c400/0x87925e4cb73a699f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484098d8 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.641447:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626600960:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143766.641484:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800938546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.642899:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626600960:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143766.643345:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c400/0x87925e4cb73a699f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098d8 expref: 48 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.643355:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c400/0x87925e4cb73a699f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098d8 expref: 48 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.643557:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c400, rc 0) 00000100:00100000:1.0:1746143766.643811:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963622121856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2413us (3249us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.643817:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10925 00000100:00100000:0.0:1746143766.645734:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.645820:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.645972:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622122112 00000100:00100000:1.0:1746143766.645982:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622122112 00000100:00100000:1.0:1746143766.646468:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10926 00000100:00100000:1.0:1746143766.646477:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622122112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.646494:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.646511:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73a69a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484098e6 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.646563:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626601088:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143766.647687:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800938546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.652039:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626601216:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143766.652077:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097106600/0x87925e4cb73a69ad lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098ed expref: 48 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.652096:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106600, rc 0) 00002000:00010000:1.0:1746143766.652231:0:12328:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143766 -> 1746143767 00000100:00100000:1.0:1746143766.652251:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626601088:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143766.652251:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+48:31647:x1830963622122240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5752us (6429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.652261:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10927 00010000:00010000:1.0:1746143766.652273:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73a69a6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098e6 expref: 26 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.652284:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73a69a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098e6 expref: 26 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.652293:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7cc00, rc 0) 00000100:00100000:1.0:1746143766.652313:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622122112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5837us (6587us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.652318:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10926 00000100:00100000:0.0:1746143766.654693:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.654789:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622122496 00000100:00100000:1.0:1746143766.654799:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622122496 00000100:00100000:1.0:1746143766.654836:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10928 00000100:00100000:1.0:1746143766.654843:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:31650:x1830963622122496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.654858:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.654873:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73a69b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484098f4 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.654900:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.654905:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73a69b4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098f4 expref: 25 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.654936:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73a69b4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098f4 expref: 25 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.654951:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7de00, rc 0) 00000100:00100000:1.0:1746143766.654987:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:31650:x1830963622122496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 144us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.654993:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10928 00000100:00100000:0.0:1746143766.658745:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.664694:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.670470:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.670523:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.670624:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622123136 00000100:00100000:1.0:1746143766.670635:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622123136 00002000:00100000:1.0:1746143766.670685:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800919b9500 x1830963622123136/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.670694:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919b9500 with x1830963622123136 ext(0->1048575) 00002000:00010000:1.0:1746143766.670699:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919b9500 00000100:00100000:1.0:1746143766.670719:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622123392 00000100:00100000:1.0:1746143766.670722:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622123392 00002000:00100000:1.0:1746143766.670734:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1462272->2097151) req@ffff8800919b9880 x1830963622123392/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.670740:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919b9880 with x1830963622123392 ext(1462272->2097151) 00002000:00010000:1.0:1746143766.670744:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919b9880 00000100:00100000:1.0:1746143766.670771:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2916 00000100:00100000:1.0:1746143766.670778:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622123136:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143766.670849:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2917 00000100:00100000:0.0:1746143766.670855:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622123392:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143766.679720:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622123136:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8934us (9254us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.679729:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2916 00002000:00100000:1.0:1746143766.679738:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800919b9500 x1830963622123136/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.679752:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919b9500 with x1830963622123136 ext(0->1048575) 00002000:00010000:1.0:1746143766.679756:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919b9500 00000100:00100000:0.0:1746143766.684314:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.688612:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.688674:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622123648 00000100:00100000:1.0:1746143766.688681:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622123648 00002000:00100000:1.0:1746143766.688719:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1462271) req@ffff8800919b9f80 x1830963622123648/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.688729:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919b9f80 with x1830963622123648 ext(1048576->1462271) 00010000:00010000:1.0:1746143766.688735:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3800/0x87925e4cb73a693d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098b5 expref: 25 pid: 3134 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746143766.688747:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090fc3800/0x87925e4cb73a693d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098b5 expref: 25 pid: 3134 timeout: 925 lvb_type: 0 00002000:00010000:1.0:1746143766.688753:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919b9f80 00000100:00100000:1.0:1746143766.688782:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1287 00000100:00100000:1.0:1746143766.688788:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622123648:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143766.688941:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.697741:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.702768:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.706059:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.726543:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.726606:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.731114:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143766.739958:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872849 is committed 00000001:00080000:0.0:1746143766.739979:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872848 is committed 00000001:00080000:0.0:1746143766.739994:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872844 is committed 00000001:00080000:0.0:1746143766.740049:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872819 is committed 00000100:00100000:0.0:1746143766.752426:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.752524:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.761472:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.761488:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622125696 00000100:00100000:0.0:1746143766.761493:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622125696 00002000:00100000:0.0:1746143766.761518:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff88012b7e0380 x1830963622125696/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.761526:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e0380 with x1830963622125696 ext(3145728->4194303) 00002000:00010000:0.0:1746143766.761530:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e0380 00000100:00100000:0.0:1746143766.761541:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2921 00000100:00100000:0.0:1746143766.761546:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622125696:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143766.782496:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622125696:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20926us (21005us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.782510:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2921 00002000:00100000:1.0:1746143766.782524:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff88012b7e0380 x1830963622125696/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.782533:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e0380 with x1830963622125696 ext(3145728->4194303) 00002000:00010000:1.0:1746143766.782539:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e0380 00000100:00100000:0.0:1746143766.797717:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.797770:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.797785:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622126208 00000100:00100000:1.0:1746143766.797797:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622126208 00000100:00100000:1.0:1746143766.797859:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4569 00000100:00100000:1.0:1746143766.797867:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+278:31656:x1830963622126208:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143766.798147:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:31656:x1830963622126208:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 280us (443us total) trans 8589943334 rc 0/0 00000100:00100000:1.0:1746143766.798154:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4569 00000100:00100000:0.0:1746143766.807676:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.807821:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622126592 00000100:00100000:1.0:1746143766.807832:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622126592 00000100:00100000:1.0:1746143766.807892:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4570 00000100:00100000:1.0:1746143766.807899:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013735b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+278:31647:x1830963622126592:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143766.808099:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013735b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:31647:x1830963622126592:12345-192.168.202.3@tcp:35:cat.0 Request processed in 200us (435us total) trans 8589943335 rc 0/0 00000100:00100000:1.0:1746143766.808105:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4570 00000100:00100000:0.0:1746143766.811425:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.811548:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622126720 00000100:00100000:1.0:1746143766.811558:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622126720 00000100:00100000:1.0:1746143766.811619:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10933 00000100:00100000:1.0:1746143766.811627:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31654:x1830963622126720:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143766.811642:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.811656:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a69fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840991e expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.811680:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73a68d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409868 expref: 22 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.811688:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73a68e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840987d expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.811699:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.811701:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.811704:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a69fa lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840991e expref: 9 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.811732:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73a68e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840987d expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.811742:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73a68e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840987d expref: 9 pid: 1947 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746143766.811754:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626602240:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.814199:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73a68d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409868 expref: 22 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.814214:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73a68d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409868 expref: 22 pid: 12328 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746143766.814228:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626602368:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.815054:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.820391:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626602240:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.820405:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626602368:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.820432:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a69fa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840991e expref: 9 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.820452:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ba00, rc 0) 00000100:00100000:1.0:1746143766.822334:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31654:x1830963622126720:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10699us (10913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.822344:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10933 00000100:00100000:0.0:1746143766.822620:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.822831:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.822903:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5049 00000100:00100000:1.0:1746143766.822933:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622126848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.822970:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.822986:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73a68e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840987d expref: 9 pid: 1947 timeout: 926 lvb_type: 1 00010000:00010000:1.0:1746143766.822995:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73a68e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840987d expref: 9 pid: 1947 timeout: 926 lvb_type: 1 00010000:00010000:1.0:1746143766.823010:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73a68e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840987d expref: 9 pid: 1947 timeout: 926 lvb_type: 1 00010000:00010000:1.0:1746143766.823222:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.823304:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622126848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 394us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.823309:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5049 00000100:00100000:0.0:1746143766.825850:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.826236:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622127232 00000100:00100000:1.0:1746143766.826242:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622127232 00002000:00100000:1.0:1746143766.826276:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2895872->2899967) req@ffff88012b7e1880 x1830963622127232/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.826289:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e1880 with x1830963622127232 ext(2895872->2899967) 00002000:00010000:1.0:1746143766.826292:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7e1880 00000100:00100000:1.0:1746143766.826317:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2922 00000100:00100000:1.0:1746143766.826324:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622127232:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143766.826432:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622127232:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 108us (583us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143766.826437:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2922 00002000:00100000:1.0:1746143766.826442:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2895872->2899967) req@ffff88012b7e1880 x1830963622127232/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.826452:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e1880 with x1830963622127232 ext(2895872->2899967) 00002000:00010000:1.0:1746143766.826454:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7e1880 00000100:00100000:0.0:1746143766.830011:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.830166:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622127360 00000100:00100000:1.0:1746143766.830175:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622127360 00000100:00100000:1.0:1746143766.830306:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10934 00000100:00100000:1.0:1746143766.830316:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31654:x1830963622127360:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143766.830335:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.830351:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6a01 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409925 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.830378:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a69c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409909 expref: 9 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.830385:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73a69d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409910 expref: 23 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.830395:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.830397:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.830401:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6a01 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->2437119] (req 2097152->2437119) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409925 expref: 9 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.830432:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73a69d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409910 expref: 23 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.830444:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73a69d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409910 expref: 23 pid: 12328 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746143766.830455:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626602624:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.830875:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a69c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409909 expref: 9 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.830886:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a69c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409909 expref: 9 pid: 12328 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746143766.830895:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626602752:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.831445:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.835983:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.836122:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626602624:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.836133:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626602752:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.836166:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6a01 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->2437119] (req 2097152->2437119) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409925 expref: 9 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.836196:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8b000, rc 0) 00000100:00100000:1.0:1746143766.836251:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31654:x1830963622127360:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5936us (6247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.836261:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10934 00000100:00100000:1.0:1746143766.838796:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.844837:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.939345:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.944330:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622128256 00000100:00100000:1.0:1746143766.944336:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622128256 00000100:00100000:1.0:1746143766.944364:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10935 00000100:00100000:1.0:1746143766.944370:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+23:31656:x1830963622128256:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143766.944381:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.944392:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a6a2b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409933 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.944412:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409925 expref: 7 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.944418:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.944420:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.944422:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a6a2b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3850240->4194303] (req 3850240->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409933 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.944446:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6a01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409925 expref: 7 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.944454:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6a01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409925 expref: 7 pid: 3134 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746143766.944470:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626603008:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.944534:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.945824:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.946306:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.946507:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622128384 00000100:00100000:1.0:1746143766.946514:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622128384 00000100:00100000:1.0:1746143766.946552:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622128512 00000100:00100000:1.0:1746143766.946555:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622128512 00000100:00100000:1.0:1746143766.947001:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10936 00000100:00100000:1.0:1746143766.947009:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622128384:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.947030:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.947045:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a6a32 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840993a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.947462:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626603264:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143766.947499:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.947713:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.948108:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626603008:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.948124:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a6a2b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3850240->4194303] (req 3850240->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409933 expref: 26 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.948132:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ac00, rc 0) 00000100:00100000:1.0:1746143766.948160:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:31656:x1830963622128256:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3790us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.948166:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10935 00000100:00100000:0.0:1746143766.949905:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:1.0:1746143766.950294:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143766 -> 1746143767 00002000:00010000:1.0:1746143766.950296:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143766 -> 1746143767 00002000:00010000:1.0:1746143766.950298:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143766 -> 1746143767 00000100:00100000:1.0:1746143766.950308:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626603264:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143766.950323:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a6a32 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840993a expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.950338:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a6a32 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840993a expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.950348:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551200, rc 0) 00000100:00100000:1.0:1746143766.950363:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622128384:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3355us (4541us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.950368:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10936 00000100:00100000:0.0:1746143766.961212:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.962489:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622129024 00000100:00100000:1.0:1746143766.962494:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622129024 00000100:00100000:1.0:1746143766.962523:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622129152 00000100:00100000:1.0:1746143766.962525:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622129152 00000100:00100000:1.0:1746143766.962547:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10938 00000100:00100000:1.0:1746143766.962552:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622129024:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.962564:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.962575:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73a6a40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409948 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.962603:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626603520:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143766.962643:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.962747:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10939 00000100:00100000:0.0:1746143766.962754:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622129152:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143766.962762:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.962770:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7fa00/0x87925e4cb73a6a47 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840994f expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.962790:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626603648:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143766.962815:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.965803:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626603648:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143766.965821:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7fa00/0x87925e4cb73a6a47 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840994f expref: 25 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.965831:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7fa00/0x87925e4cb73a6a47 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840994f expref: 25 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143766.965956:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626603520:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143766.965970:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73a6a40 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409948 expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.965979:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73a6a40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409948 expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.965989:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550e00, rc 0) 00000100:00100000:1.0:1746143766.966152:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622129024:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3599us (4038us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.966158:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10938 00010000:00010000:0.0:1746143766.966282:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7fa00, rc 0) 00000100:00100000:1.0:1746143766.966994:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622129152:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4239us (4760us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.967001:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10939 00000100:00100000:0.0:1746143766.969613:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.969844:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622129536 00000100:00100000:1.0:1746143766.969850:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622129536 00000100:00100000:1.0:1746143766.969880:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10940 00000100:00100000:1.0:1746143766.969886:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+22:31663:x1830963622129536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143766.969896:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.969925:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a6a4e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409956 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.969948:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a69fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840991e expref: 7 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.969954:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.969956:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.969959:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a6a4e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409956 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.969987:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a69fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840991e expref: 7 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.969998:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a69fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840991e expref: 7 pid: 3134 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746143766.970013:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626603776:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.970069:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.972525:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.975075:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626603776:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.975101:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a6a4e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409956 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.975114:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550000, rc 0) 00000100:00100000:1.0:1746143766.975156:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+24:31663:x1830963622129536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5269us (5545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.975162:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10940 00000100:00100000:0.0:1746143766.976616:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.976800:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622129920 00000100:00100000:1.0:1746143766.976804:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622129920 00000100:00100000:1.0:1746143766.976841:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10942 00000100:00100000:1.0:1746143766.976847:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31665:x1830963622129920:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143766.976857:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.976870:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551400/0x87925e4cb73a6a5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409964 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.976892:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73a69bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484098fb expref: 23 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.976900:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012323a600/0x87925e4cb73a69c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409902 expref: 10 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.976905:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.976907:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.976937:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551400/0x87925e4cb73a6a5c lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [2056192->2097151] (req 2056192->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409964 expref: 10 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.976962:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012323a600/0x87925e4cb73a69c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409902 expref: 10 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.976981:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012323a600/0x87925e4cb73a69c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409902 expref: 10 pid: 12328 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746143766.976992:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626603904:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.977073:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73a69bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098fb expref: 23 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.977081:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73a69bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098fb expref: 23 pid: 12328 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746143766.977089:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626604032:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.977108:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.980434:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626603904:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143766.982152:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.982939:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626604032:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.982966:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551400/0x87925e4cb73a6a5c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [2056192->2097151] (req 2056192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409964 expref: 10 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.982979:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551400, rc 0) 00000100:00100000:1.0:1746143766.983012:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31665:x1830963622129920:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6165us (6397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.983032:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10942 00000100:00100000:0.0:1746143766.985028:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.994111:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.996200:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.997719:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143766.997754:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143766.997766:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622131072 00000100:00100000:1.0:1746143766.997771:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622131200 00000100:00100000:0.0:1746143766.997772:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622131072 00000100:00100000:1.0:1746143766.997774:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622131200 00002000:00100000:0.0:1746143766.997794:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3850239) req@ffff88012457c380 x1830963622131072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.997802:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c380 with x1830963622131072 ext(2097152->3850239) 00002000:00010000:0.0:1746143766.997806:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457c380 00000100:00100000:0.0:1746143766.997832:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2927 00000100:00100000:0.0:1746143766.997838:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622131072:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143766.997849:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10943 00000100:00100000:1.0:1746143766.997855:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31665:x1830963622131200:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143766.997865:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.997877:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840996b expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.997898:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a6649 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409711 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.997906:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a6809 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484097f8 expref: 7 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.997933:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a666c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840972d expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.997939:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.997940:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.997944:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840996b expref: 10 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.997965:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a666c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840972d expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.997974:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a666c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840972d expref: 23 pid: 9587 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746143766.997984:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626604544:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.998049:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a6809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097f8 expref: 7 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.998057:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a6809 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097f8 expref: 7 pid: 3135 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746143766.998063:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626604672:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143766.998084:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a6649 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409711 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.998094:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a6649 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409711 expref: 10 pid: 3134 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746143766.998100:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626604800:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143766.998113:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.002320:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626604544:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143767.002332:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626604672:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143767.002339:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626604800:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143767.002364:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840996b expref: 10 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.002380:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550a00, rc 0) 00000100:00100000:0.0:1746143767.003001:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31665:x1830963622131200:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5143us (5244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.003010:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10943 00000100:00100000:0.0:1746143767.004218:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.004250:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.004284:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:1.0:1746143767.004369:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143767.004399:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143767.004424:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5059 00000100:00100000:1.0:1746143767.004432:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963622131584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.004439:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.004470:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a666c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840972d expref: 25 pid: 9587 timeout: 926 lvb_type: 1 00010000:00010000:1.0:1746143767.004479:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a666c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840972d expref: 25 pid: 9587 timeout: 926 lvb_type: 1 00010000:00010000:1.0:1746143767.004493:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a666c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840972d expref: 25 pid: 9587 timeout: 926 lvb_type: 1 00010000:00010000:1.0:1746143767.004506:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.004523:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622131584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.004529:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5059 00000100:00100000:0.0:1746143767.019274:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.021350:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622131072:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23511us (23632us total) trans 0 rc 1753088/1753088 00000100:00100000:1.0:1746143767.021361:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2927 00002000:00100000:1.0:1746143767.021367:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3850239) req@ffff88012457c380 x1830963622131072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1753088/1753088 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.021374:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c380 with x1830963622131072 ext(2097152->3850239) 00002000:00010000:1.0:1746143767.021377:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457c380 00000100:00080000:1.0:1746143767.023488:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143767.035395:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.035432:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.035700:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.035762:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622132224 00000100:00100000:1.0:1746143767.035770:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622132224 00000100:00100000:1.0:1746143767.036027:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10946 00000100:00080000:1.0:1746143767.036039:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143767.036047:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622132352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143767.036065:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143767.036080:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a6a78 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409987 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.036118:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626605440:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143767.036729:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.043397:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.043433:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.043475:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622132736 00000100:00100000:1.0:1746143767.043481:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622132736 00002000:00100000:1.0:1746143767.043510:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2056191) req@ffff88012457c700 x1830963622132736/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.043517:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c700 with x1830963622132736 ext(1048576->2056191) 00002000:00010000:1.0:1746143767.043521:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457c700 00000100:00100000:0.0:1746143767.044287:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2930 00000100:00100000:0.0:1746143767.044293:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622132736:12345-192.168.202.3@tcp:3:cat.0 00002000:00010000:1.0:1746143767.049135:0:3134:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime: 1746143764 -> 1746143767 00002000:00010000:1.0:1746143767.049141:0:3134:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143764 -> 1746143767 00002000:00010000:1.0:1746143767.049144:0:3134:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime: 1746143764 -> 1746143767 00000100:00100000:1.0:1746143767.049160:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626605440:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143767.049187:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a6a78 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409987 expref: 25 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.049198:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a6a78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409987 expref: 25 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.049222:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551600, rc 0) 00000100:00100000:1.0:1746143767.049264:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+24:2011:x1830963622132352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 13228us (13829us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143767.049271:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10946 00000100:00100000:0.0:1746143767.056330:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.056364:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.056402:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.056509:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622133248 00000100:00100000:1.0:1746143767.056513:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622133248 00000100:00100000:1.0:1746143767.056544:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10949 00000100:00100000:1.0:1746143767.056551:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622133120:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143767.056566:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143767.056579:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082084c00/0x87925e4cb73a6a8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409995 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.056620:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626605696:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143767.056681:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.058630:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626605696:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143767.058645:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082084c00/0x87925e4cb73a6a8d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409995 expref: 24 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.058658:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084c00/0x87925e4cb73a6a8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409995 expref: 23 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.058667:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084c00, rc 0) 00000100:00100000:1.0:1746143767.058682:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963622133120:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2132us (2360us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143767.058686:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10949 00000100:00100000:0.0:1746143767.061034:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.061064:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.061089:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.061129:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.061194:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622133760 00000100:00100000:1.0:1746143767.061198:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622133760 00000100:00100000:1.0:1746143767.061223:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10952 00000100:00100000:1.0:1746143767.061230:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622133504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143767.061243:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143767.061258:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097369a00/0x87925e4cb73a6aa9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484099aa expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.061292:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626606208:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143767.061349:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.061672:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.061972:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622134016 00000100:00100000:0.0:1746143767.061976:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622134016 00000100:00100000:0.0:1746143767.061993:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10956 00000100:00100000:0.0:1746143767.061998:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622134016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143767.062005:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.062011:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7e200/0x87925e4cb73a6abe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484099c6 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.062050:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626606592:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143767.062100:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.064957:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626606208:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143767.064984:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097369a00/0x87925e4cb73a6aa9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484099aa expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.064996:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097369a00/0x87925e4cb73a6aa9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484099aa expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.065009:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369a00, rc 0) 00000100:00100000:1.0:1746143767.065052:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622133504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3821us (4023us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143767.065059:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10952 00000100:00100000:0.0:1746143767.066166:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626606592:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143767.066182:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e200/0x87925e4cb73a6abe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484099c6 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.066191:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e200/0x87925e4cb73a6abe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484099c6 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.066205:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e200, rc 0) 00000100:00100000:0.0:1746143767.066224:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622134016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4226us (4553us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143767.066230:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10956 00000100:00100000:0.0:1746143767.068296:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.069544:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:1.0:1746143767.069646:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143767.071940:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.084245:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.086962:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.097162:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.107049:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.107096:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.107301:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2933 00000100:00100000:1.0:1746143767.107306:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622135552:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143767.110444:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.112092:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626606976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746143767.112132:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746143767.113465:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143767.113844:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626606976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746143767.118852:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622135552:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11538us (11747us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143767.118863:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2933 00002000:00100000:0.0:1746143767.118873:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880136ac8e00 x1830963622135552/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.118880:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8e00 with x1830963622135552 ext(3145728->4194303) 00002000:00010000:0.0:1746143767.118884:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac8e00 00000100:00100000:0.0:1746143767.122286:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.122330:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.134000:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.140665:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.148559:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.163494:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.167787:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.277054:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.280410:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.285290:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622137216:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4704us (4873us total) trans 17179872852 rc 0/0 00000100:00100000:0.0:1746143767.285302:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1294 00002000:00100000:0.0:1746143767.285311:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (2056192->2097151) req@ffff8800938df800 x1830963622137216/t17179872852(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.285320:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938df800 with x1830963622137216 ext(2056192->2097151) 00010000:00010000:0.0:1746143767.285329:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d551400/0x87925e4cb73a6a5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409964 expref: 12 pid: 3134 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143767.285355:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d551400/0x87925e4cb73a6a5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409964 expref: 12 pid: 3134 timeout: 926 lvb_type: 0 00002000:00010000:0.0:1746143767.285362:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938df800 00000100:00100000:0.0:1746143767.289026:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.293003:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.293043:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.293098:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622137600 00000100:00100000:1.0:1746143767.293103:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622137600 00002000:00100000:1.0:1746143767.293142:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1732608->1736703) req@ffff880082ed4700 x1830963622137600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.293151:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed4700 with x1830963622137600 ext(1732608->1736703) 00002000:00010000:1.0:1746143767.293155:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed4700 00000100:00100000:1.0:1746143767.293170:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2935 00000100:00100000:1.0:1746143767.293174:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622137600:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143767.293271:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622137600:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 95us (269us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143767.293276:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2935 00002000:00100000:1.0:1746143767.293280:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1732608->1736703) req@ffff880082ed4700 x1830963622137600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.293286:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed4700 with x1830963622137600 ext(1732608->1736703) 00002000:00010000:1.0:1746143767.293289:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed4700 00000100:00100000:1.0:1746143767.296673:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.298228:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.298253:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.298272:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.298402:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622138112 00000100:00100000:1.0:1746143767.298407:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622138112 00000100:00100000:0.0:1746143767.298421:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:1.0:1746143767.298426:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746143767.298529:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a6810 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409806 expref: 7 pid: 3135 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746143767.298548:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622138368 00000100:00100000:1.0:1746143767.298550:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622138368 00010000:00010000:1.0:1746143767.298892:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73a675a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409796 expref: 26 pid: 12328 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746143767.298906:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5065 00000100:00100000:1.0:1746143767.298930:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622138368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.298937:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.298944:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73a675a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409796 expref: 26 pid: 12328 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.298950:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73a675a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409796 expref: 26 pid: 12328 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.298960:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73a675a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409796 expref: 26 pid: 12328 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.298971:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.298972:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.298976:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.298993:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.299010:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.299032:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626608256:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143767.299072:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.301693:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.302301:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.302320:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.302344:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.302356:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.302380:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.302689:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626608256:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143767.302704:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.302721:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622138368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3810us (4447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.302726:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5065 00000100:00100000:1.0:1746143767.302748:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10967 00000100:00100000:1.0:1746143767.302753:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622139392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143767.302760:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143767.302767:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a6b51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409a21 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.302778:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.302779:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.302784:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a6b51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a21 expref: 29 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.302798:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a6b51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a21 expref: 29 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.302805:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00000100:00100000:1.0:1746143767.302820:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622139392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 66us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.302824:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10967 00000100:00100000:1.0:1746143767.302842:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622139136 00000100:00100000:1.0:1746143767.302845:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622139136 00002000:00100000:1.0:1746143767.302864:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8801373b9180 x1830963622139136/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 504/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.302871:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9180 with x1830963622139136 ext(1048576->2097151) 00010000:00010000:1.0:1746143767.302876:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840996b expref: 11 pid: 3134 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.302885:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840996b expref: 11 pid: 3134 timeout: 926 lvb_type: 0 00002000:00010000:1.0:1746143767.302891:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801373b9180 00000100:00100000:1.0:1746143767.303344:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1295 00000100:00100000:1.0:1746143767.303351:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622139136:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143767.303403:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.303418:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622139520 00000100:00100000:0.0:1746143767.303420:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622139520 00002000:00100000:0.0:1746143767.303435:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1097728->1101823) req@ffff88009719ce00 x1830963622139520/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.303442:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ce00 with x1830963622139520 ext(1097728->1101823) 00002000:00010000:0.0:1746143767.303445:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719ce00 00000100:00100000:0.0:1746143767.303469:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2936 00000100:00100000:0.0:1746143767.303475:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622139520:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143767.303576:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622139520:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 101us (173us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143767.303582:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2936 00002000:00100000:0.0:1746143767.303587:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1097728->1101823) req@ffff88009719ce00 x1830963622139520/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.303594:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ce00 with x1830963622139520 ext(1097728->1101823) 00002000:00010000:0.0:1746143767.303597:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719ce00 00000100:00100000:0.0:1746143767.312170:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622139136:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8807us (9811us total) trans 17179872853 rc 0/0 00000100:00100000:0.0:1746143767.312186:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1295 00002000:00100000:0.0:1746143767.312199:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8801373b9180 x1830963622139136/t17179872853(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 504/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.312208:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9180 with x1830963622139136 ext(1048576->2097151) 00010000:00010000:0.0:1746143767.312218:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840996b expref: 13 pid: 3134 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143767.312232:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840996b expref: 13 pid: 3134 timeout: 926 lvb_type: 0 00002000:00010000:0.0:1746143767.312239:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801373b9180 00000100:00100000:0.0:1746143767.316253:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.317976:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.319089:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622139904 00000100:00100000:1.0:1746143767.319098:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622139904 00010000:00010000:1.0:1746143767.319136:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840996b expref: 13 pid: 3134 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746143767.319177:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5066 00000100:00100000:1.0:1746143767.319184:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622139904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.319199:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.319217:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840996b expref: 13 pid: 3134 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.319549:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840996b expref: 13 pid: 3134 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.319574:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a6a63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840996b expref: 13 pid: 3134 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.319593:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.319595:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.319603:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a6b35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a05 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.319611:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a6b35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a05 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.319648:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a6b35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a05 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.319661:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626608640:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143767.319761:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.324568:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626608640:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143767.324591:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.324643:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622139904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5458us (6668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.324655:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5066 00000100:00100000:0.0:1746143767.330533:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.340690:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.341068:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622140416 00000100:00100000:1.0:1746143767.341079:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622140416 00002000:00100000:1.0:1746143767.341127:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1642496->2097151) req@ffff88009391d500 x1830963622140416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.341137:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d500 with x1830963622140416 ext(1642496->2097151) 00002000:00010000:1.0:1746143767.341143:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391d500 00000100:00100000:1.0:1746143767.341180:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2939 00000100:00100000:1.0:1746143767.341189:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622140416:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143767.345663:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622140416:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4462us (4973us total) trans 0 rc 454656/454656 00000100:00100000:1.0:1746143767.345679:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2939 00002000:00100000:1.0:1746143767.345692:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1642496->2097151) req@ffff88009391d500 x1830963622140416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 454656/454656 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.345701:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d500 with x1830963622140416 ext(1642496->2097151) 00002000:00010000:1.0:1746143767.345708:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391d500 00000100:00100000:0.0:1746143767.351545:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.357694:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.358270:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622140672 00000100:00100000:1.0:1746143767.358277:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622140672 00002000:00100000:1.0:1746143767.359160:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1101823) req@ffff880093724700 x1830963622140672/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.359170:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724700 with x1830963622140672 ext(1048576->1101823) 00010000:00010000:1.0:1746143767.359178:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 11 pid: 9586 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.359201:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 11 pid: 9586 timeout: 926 lvb_type: 0 00002000:00010000:1.0:1746143767.359207:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093724700 00000100:00100000:1.0:1746143767.359237:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1296 00000100:00100000:1.0:1746143767.359245:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622140672:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143767.362545:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622140672:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3291us (4854us total) trans 21474840170 rc 0/0 00000100:00100000:0.0:1746143767.362556:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1296 00002000:00100000:0.0:1746143767.362565:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1101823) req@ffff880093724700 x1830963622140672/t21474840170(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.362573:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724700 with x1830963622140672 ext(1048576->1101823) 00010000:00010000:0.0:1746143767.362582:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 13 pid: 9586 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143767.362594:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 13 pid: 9586 timeout: 926 lvb_type: 0 00002000:00010000:0.0:1746143767.362600:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093724700 00000100:00100000:0.0:1746143767.364444:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.364575:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622140800 00000100:00100000:1.0:1746143767.364583:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622140800 00010000:00010000:1.0:1746143767.364610:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 13 pid: 9586 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746143767.364644:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5067 00000100:00100000:1.0:1746143767.364651:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622140800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.364662:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.364676:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 13 pid: 9586 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.364685:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 13 pid: 9586 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.364702:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73a6b0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f7 expref: 13 pid: 9586 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.364733:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.364735:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.364741:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049200/0x87925e4cb73a6b58 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a28 expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.364748:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049200/0x87925e4cb73a6b58 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a28 expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.364784:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082049200/0x87925e4cb73a6b58 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a28 expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.364794:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626608896:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143767.364858:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.369332:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626608896:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143767.369352:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.369404:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622140800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4753us (4965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.369414:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5067 00000100:00100000:0.0:1746143767.370719:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.395373:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.411209:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.411224:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.411253:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.422682:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.424953:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622142080 00000100:00100000:0.0:1746143767.424960:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622142080 00000100:00100000:0.0:1746143767.425007:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10972 00000100:00100000:0.0:1746143767.425025:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31684:x1830963622142080:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143767.425038:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.425057:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e513400/0x87925e4cb73a6b74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409a44 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.425080:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a6b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f0 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.425087:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143767.425088:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143767.425092:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e513400/0x87925e4cb73a6b74 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a44 expref: 13 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.425115:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a6b04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f0 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.425125:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a6b04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f0 expref: 25 pid: 9586 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143767.425140:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626609280:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143767.425209:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.429112:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.432690:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.434810:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963622142208:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5506us (5689us total) trans 17179872854 rc 0/0 00000100:00100000:0.0:1746143767.434822:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1297 00002000:00100000:0.0:1746143767.434833:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1732608->2097151) req@ffff8800919b8e00 x1830963622142208/t17179872854(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.434842:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919b8e00 with x1830963622142208 ext(1732608->2097151) 00010000:00010000:0.0:1746143767.434863:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a6b04 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f0 expref: 30 pid: 9586 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143767.434879:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a6b04 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099f0 expref: 30 pid: 9586 timeout: 926 lvb_type: 0 00002000:00010000:0.0:1746143767.434886:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919b8e00 00000100:00100000:0.0:1746143767.442540:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.442859:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.469376:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.473294:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.474169:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.474529:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4574 00000100:00100000:0.0:1746143767.474541:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+288:31688:x1830963622143616:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143767.474698:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+288:31688:x1830963622143616:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 161us (531us total) trans 8589943343 rc 0/0 00000100:00100000:0.0:1746143767.474704:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4574 00000100:00100000:0.0:1746143767.479717:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.481389:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.491577:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.493982:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.494141:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.496983:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.500771:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.503667:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.506276:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.510331:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622144640:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5748us (6660us total) trans 17179872855 rc 0/0 00000100:00100000:0.0:1746143767.510342:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1298 00002000:00100000:0.0:1746143767.510355:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1642495) req@ffff88009c4d4380 x1830963622144640/t17179872855(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.510364:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4380 with x1830963622144640 ext(1048576->1642495) 00010000:00010000:0.0:1746143767.510374:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a6b35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a05 expref: 30 pid: 9839 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143767.510389:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a6b35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a05 expref: 30 pid: 9839 timeout: 926 lvb_type: 0 00002000:00010000:0.0:1746143767.510395:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d4380 00000100:00100000:0.0:1746143767.510967:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.520103:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.529323:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.529482:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.529651:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2946 00000100:00100000:0.0:1746143767.529661:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622145664:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143767.549462:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622145664:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 19793us (20139us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.549475:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2946 00002000:00100000:1.0:1746143767.549487:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880094194a80 x1830963622145664/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.549497:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194a80 with x1830963622145664 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.549504:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094194a80 00000100:00100000:0.0:1746143767.566311:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.566400:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622146048 00000100:00100000:1.0:1746143767.566410:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622146048 00002000:00100000:1.0:1746143767.566456:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880093416680 x1830963622146048/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 504/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.566466:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416680 with x1830963622146048 ext(2097152->4194303) 00002000:00010000:1.0:1746143767.566472:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093416680 00000100:00100000:1.0:1746143767.566493:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2948 00000100:00100000:1.0:1746143767.566500:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622146048:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143767.579675:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.580645:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622146048:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14144us (14343us total) trans 0 rc 1736704/1736704 00000100:00100000:1.0:1746143767.580656:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2948 00002000:00100000:1.0:1746143767.580665:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880093416680 x1830963622146048/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 504/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1736704/1736704 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.580674:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416680 with x1830963622146048 ext(2097152->4194303) 00002000:00010000:1.0:1746143767.580678:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093416680 00000100:00100000:0.0:1746143767.587561:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.587611:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.587988:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bcaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626610560:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143767.587998:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75a00/0x87925e4cb73a6acc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484099d4 expref: 14 pid: 9586 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143767.588035:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626610688:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143767.588059:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a6bba lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3485696->4161535] (req 3485696->4161535) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a6e expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.588067:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3a00, rc 0) 00000100:00100000:0.0:1746143767.588098:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:31688:x1830963622146176:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8264us (8434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.588104:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10977 00000100:00100000:1.0:1746143767.594878:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622146816 00000100:00100000:1.0:1746143767.594888:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622146816 00002000:00100000:1.0:1746143767.594947:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880091bc8000 x1830963622146816/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.594957:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc8000 with x1830963622146816 ext(2097152->3145727) 00002000:00010000:1.0:1746143767.594962:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc8000 00000100:00100000:1.0:1746143767.594983:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2949 00000100:00100000:1.0:1746143767.594991:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622146816:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143767.595819:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622146560 00000100:00100000:0.0:1746143767.595826:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622146560 00010000:00010000:0.0:1746143767.595849:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a6b51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a21 expref: 30 pid: 3134 timeout: 926 lvb_type: 1 00000100:00100000:0.0:1746143767.595872:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5075 00000100:00100000:0.0:1746143767.595877:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622146560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.595888:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.595901:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a6b51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a21 expref: 30 pid: 3134 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746143767.595936:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a6b51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a21 expref: 30 pid: 3134 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746143767.595959:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a6b51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a21 expref: 30 pid: 3134 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746143767.595978:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.595980:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.595987:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a6bba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3485696->18446744073709551615] (req 3485696->4161535) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a6e expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.595996:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a6bba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3485696->18446744073709551615] (req 3485696->4161535) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a6e expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.596065:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a6bba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3485696->18446744073709551615] (req 3485696->4161535) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a6e expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.596078:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626610816:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143767.596143:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.604604:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626610816:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143767.604624:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.604644:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622146560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8766us (10741us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.604651:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5075 00000100:00100000:1.0:1746143767.606677:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622146816:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11678us (11946us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.606688:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2949 00002000:00100000:1.0:1746143767.606697:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880091bc8000 x1830963622146816/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.606705:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc8000 with x1830963622146816 ext(2097152->3145727) 00002000:00010000:1.0:1746143767.606711:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc8000 00000100:00100000:0.0:1746143767.615054:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.615159:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622147328 00000100:00100000:1.0:1746143767.615170:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622147328 00002000:00100000:1.0:1746143767.615219:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (4157440->4161535) req@ffff88012b1d8e00 x1830963622147328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.615229:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8e00 with x1830963622147328 ext(4157440->4161535) 00002000:00010000:1.0:1746143767.615234:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d8e00 00000100:00100000:1.0:1746143767.615274:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2951 00000100:00100000:1.0:1746143767.615283:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622147328:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143767.615438:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622147328:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 155us (394us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143767.615445:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2951 00002000:00100000:1.0:1746143767.615451:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (4157440->4161535) req@ffff88012b1d8e00 x1830963622147328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.615458:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8e00 with x1830963622147328 ext(4157440->4161535) 00002000:00010000:1.0:1746143767.615460:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d8e00 00000100:00100000:0.0:1746143767.616684:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.619237:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.620638:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1299 00000100:00100000:1.0:1746143767.620649:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622147712:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143767.635558:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622147712:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 14900us (16314us total) trans 17179872856 rc 0/0 00000100:00100000:1.0:1746143767.635572:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1299 00002000:00100000:1.0:1746143767.635585:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3485696->4161535) req@ffff88012d841c00 x1830963622147712/t17179872856(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.635595:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841c00 with x1830963622147712 ext(3485696->4161535) 00010000:00010000:1.0:1746143767.635606:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a6bba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3485696->18446744073709551615] (req 3485696->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a6e expref: 31 pid: 13436 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.635623:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a6bba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3485696->18446744073709551615] (req 3485696->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a6e expref: 31 pid: 13436 timeout: 926 lvb_type: 0 00002000:00010000:1.0:1746143767.635630:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d841c00 00000100:00100000:0.0:1746143767.638820:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.648269:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.650680:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622148096 00000100:00100000:1.0:1746143767.650698:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622148096 00002000:00100000:1.0:1746143767.650768:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880129e7b100 x1830963622148096/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.650779:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e7b100 with x1830963622148096 ext(3145728->4194303) 00002000:00010000:1.0:1746143767.650786:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e7b100 00000100:00100000:1.0:1746143767.650848:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2952 00000100:00100000:1.0:1746143767.650861:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622148096:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143767.660216:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622148096:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9344us (11942us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.660235:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2952 00002000:00100000:1.0:1746143767.660251:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880129e7b100 x1830963622148096/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.660263:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e7b100 with x1830963622148096 ext(3145728->4194303) 00002000:00010000:1.0:1746143767.660269:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e7b100 00000100:00100000:0.0:1746143767.669442:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.669557:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622148352 00000100:00100000:1.0:1746143767.669571:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622148352 00002000:00100000:1.0:1746143767.669623:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4775935) req@ffff880094194700 x1830963622148352/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.669633:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194700 with x1830963622148352 ext(4194304->4775935) 00002000:00010000:1.0:1746143767.669638:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094194700 00000100:00100000:1.0:1746143767.669673:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2953 00000100:00100000:1.0:1746143767.669680:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622148352:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143767.675620:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622148352:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5926us (6181us total) trans 0 rc 581632/581632 00000100:00100000:1.0:1746143767.675634:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2953 00002000:00100000:1.0:1746143767.675647:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4775935) req@ffff880094194700 x1830963622148352/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 581632/581632 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.675657:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194700 with x1830963622148352 ext(4194304->4775935) 00002000:00010000:1.0:1746143767.675663:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094194700 00000100:00100000:0.0:1746143767.691492:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.696629:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.701480:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.709182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.715500:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.720247:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.720289:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.720330:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.722345:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143767.724401:0:12327:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143767 -> 1746143768 00002000:00010000:0.0:1746143767.724406:0:12327:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143767 -> 1746143768 00002000:00010000:0.0:1746143767.724408:0:12327:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143767 -> 1746143768 00000100:00100000:0.0:1746143767.724425:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626611584:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143767.724451:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d75a00/0x87925e4cb73a6c00 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a98 expref: 26 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.724462:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d75a00/0x87925e4cb73a6c00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a98 expref: 26 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.724474:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75a00, rc 0) 00000100:00100000:0.0:1746143767.724519:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e0d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622149632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3872us (4228us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143767.724526:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10982 00000100:00100000:0.0:1746143767.733202:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.748515:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.751582:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.760645:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.761474:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5078 00000100:00100000:1.0:1746143767.761486:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622150528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.761503:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.761528:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b25000/0x87925e4cb73a6bcf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1286144->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a83 expref: 17 pid: 13436 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.761542:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b25000/0x87925e4cb73a6bcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1286144->1851391) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a83 expref: 17 pid: 13436 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.761569:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25000/0x87925e4cb73a6bcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1286144->1851391) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a83 expref: 17 pid: 13436 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746143767.761798:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.761800:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.761809:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a6c0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aa6 expref: 31 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.761818:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a6c0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aa6 expref: 31 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.761857:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a6c0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aa6 expref: 31 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.761869:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626611840:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143767.761978:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.763950:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626611840:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143767.763971:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.764020:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622150528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2526us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.764031:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5078 00000100:00100000:0.0:1746143767.766098:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.782566:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.786358:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.800425:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.800466:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.800573:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.800610:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10987 00000100:00100000:0.0:1746143767.800617:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622151296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143767.800626:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.800642:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a6c1c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409abb expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.800695:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626612096:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143767.800778:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622151424 00000100:00100000:1.0:1746143767.800782:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622151424 00010000:00010000:1.0:1746143767.800806:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e24c600/0x87925e4cb73a6bac lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3768320->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a60 expref: 16 pid: 13436 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.800826:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5079 00000100:00100000:1.0:1746143767.800832:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622151424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.800841:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.800862:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e24c600/0x87925e4cb73a6bac lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3768320->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a60 expref: 16 pid: 13436 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.800873:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e24c600/0x87925e4cb73a6bac lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3768320->4128767) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a60 expref: 16 pid: 13436 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.800890:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.800892:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.800897:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a6c15 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aad expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.800904:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a6c15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aad expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.801121:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666840 going to sleep for 11 seconds 00010000:00010000:1.0:1746143767.801174:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a6c15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aad expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.801184:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626612224:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143767.801208:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.808537:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626612224:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143767.808560:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.808655:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622151424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7820us (8079us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.808659:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.808666:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5079 00000100:00100000:0.0:1746143767.812188:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.831813:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.851567:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.852783:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.857650:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.858052:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622153088 00000100:00100000:1.0:1746143767.858057:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622153088 00002000:00100000:1.0:1746143767.858083:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091bcb100 x1830963622153088/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.858091:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcb100 with x1830963622153088 ext(2097152->4194303) 00002000:00010000:1.0:1746143767.858096:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bcb100 00000100:00100000:1.0:1746143767.858122:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2962 00000100:00100000:1.0:1746143767.858128:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622153088:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143767.860557:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.860638:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.860834:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622153472 00000100:00100000:1.0:1746143767.860839:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622153472 00000100:00100000:1.0:1746143767.860992:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 697 00000100:00100000:1.0:1746143767.860998:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+292:2011:x1830963622153472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.861020:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.861038:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73a6c46 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ac9 expref: 292 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.861273:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143767.861278:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.861298:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+290:2011:x1830963622153472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 300us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.861303:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 697 00000100:00100000:0.0:1746143767.867143:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.868341:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622153088:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10210us (10774us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143767.868350:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2962 00002000:00100000:0.0:1746143767.868359:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091bcb100 x1830963622153088/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.868368:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcb100 with x1830963622153088 ext(2097152->4194303) 00002000:00010000:0.0:1746143767.868374:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bcb100 00000100:00100000:0.0:1746143767.876828:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.897519:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.900396:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.900612:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622154240 00000100:00100000:1.0:1746143767.900621:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622154240 00010000:00010000:1.0:1746143767.900651:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73a69b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098f4 expref: 14 pid: 3134 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.900684:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5080 00000100:00100000:1.0:1746143767.900691:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622154240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.900705:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.900725:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73a69b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098f4 expref: 14 pid: 3134 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.900734:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73a69b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098f4 expref: 14 pid: 3134 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.900755:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73a69b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098f4 expref: 14 pid: 3134 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.900783:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.900815:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622154240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 124us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.900824:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5080 00000100:00100000:0.0:1746143767.901104:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.903641:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.908136:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.921224:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.924587:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.924690:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.924869:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622155264 00000100:00100000:0.0:1746143767.924877:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622155264 00000100:00100000:0.0:1746143767.924936:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622155520 00000100:00100000:0.0:1746143767.924939:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622155520 00000100:00100000:0.0:1746143767.924955:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4577 00000100:00100000:0.0:1746143767.924962:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:8585:x1830963622155264:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143767.925187:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:8585:x1830963622155264:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 225us (602us total) trans 8589943348 rc 0/0 00000100:00100000:0.0:1746143767.925194:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4577 00000100:00100000:0.0:1746143767.926392:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.926421:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.926471:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622155648 00000100:00100000:1.0:1746143767.926477:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622155648 00010000:00010000:1.0:1746143767.926502:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a6928 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098a7 expref: 21 pid: 7244 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.926536:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622155776 00000100:00100000:1.0:1746143767.926539:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622155776 00010000:00010000:1.0:1746143767.926549:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a68fe lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840988b expref: 292 pid: 7244 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.926565:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5082 00000100:00100000:1.0:1746143767.926571:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622155648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.926582:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.926587:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a6928 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098a7 expref: 21 pid: 7244 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.926598:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a6928 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098a7 expref: 21 pid: 7244 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.926631:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73a6928 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484098a7 expref: 21 pid: 7244 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.926660:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143767.926665:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6c70 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143767.926679:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6c70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143767.926686:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6c70 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143767.926716:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.926735:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622155648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 164us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.926741:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5082 00000100:00100000:0.0:1746143767.930615:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.930648:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.930667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.930689:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.930713:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.931219:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10994 00000100:00100000:1.0:1746143767.931229:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622156416:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143767.931237:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143767.931245:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73a6c93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409afa expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.931257:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.931259:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.931264:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73a6c93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409afa expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.931274:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73a6c93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409afa expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.931281:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2600, rc 0) 00000100:00100000:1.0:1746143767.931300:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622156416:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 73us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.931306:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10994 00000100:00100000:0.0:1746143767.932220:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622156544 00000100:00100000:0.0:1746143767.932226:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622156544 00000100:00100000:0.0:1746143767.932292:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10995 00000100:00100000:0.0:1746143767.932298:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622156544:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143767.932306:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.932314:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a6c9a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b01 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.932331:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.932332:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.932338:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a6c9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b01 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.932348:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a6c9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b01 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.932355:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523000, rc 0) 00000100:00100000:0.0:1746143767.932494:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622156544:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 195us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.932500:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10995 00000100:00100000:0.0:1746143767.935551:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.937707:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.937764:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622156928 00000100:00100000:1.0:1746143767.937772:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622156928 00010000:00010000:1.0:1746143767.937807:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6c70 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ad7 expref: 11 pid: 10936 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.937842:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5084 00000100:00100000:1.0:1746143767.937849:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622156928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.937862:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.937867:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6c70 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ad7 expref: 11 pid: 10936 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.938472:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6c70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ad7 expref: 11 pid: 10936 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.938500:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a6c70 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ad7 expref: 11 pid: 10936 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.938587:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143767.938592:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a6ca8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143767.938602:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a6ca8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143767.938608:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a6ca8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143767.938636:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.938766:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622156928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 915us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.938777:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5084 00000100:00100000:0.0:1746143767.945439:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.949151:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.952144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.952463:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.952532:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622157568 00000100:00100000:1.0:1746143767.952539:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622157568 00000100:00100000:1.0:1746143767.952578:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10996 00000100:00100000:1.0:1746143767.952586:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622157568:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143767.952632:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.952650:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e513400/0x87925e4cb73a6b74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a44 expref: 16 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.952658:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940f6600/0x87925e4cb73a6c7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ae5 expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.952665:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73a6b82 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a52 expref: 31 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.952672:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.952673:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.952676:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.952711:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73a6b82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a52 expref: 31 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.952723:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73a6b82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a52 expref: 31 pid: 13436 timeout: 927 lvb_type: 1 00000100:00100000:1.0:1746143767.952742:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626613248:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143767.952847:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800940f6600/0x87925e4cb73a6c7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ae5 expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.952856:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800940f6600/0x87925e4cb73a6c7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ae5 expref: 10 pid: 12328 timeout: 927 lvb_type: 1 00000100:00100000:1.0:1746143767.952863:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626613504:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143767.952891:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e513400/0x87925e4cb73a6b74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a44 expref: 16 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.952898:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e513400/0x87925e4cb73a6b74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a44 expref: 16 pid: 9839 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.952906:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626613632:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143767.952958:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b471d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.953152:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.953168:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622157696 00000100:00100000:0.0:1746143767.953171:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622157696 00000100:00100000:0.0:1746143767.953191:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10998 00000100:00100000:0.0:1746143767.953197:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622157696:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143767.953214:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.953224:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a6c0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aa6 expref: 31 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.953232:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a6c85 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aec expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.953239:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73a6c23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ab4 expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.953245:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.953247:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.953249:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.953264:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73a6c23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ab4 expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.953273:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73a6c23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ab4 expref: 16 pid: 12327 timeout: 927 lvb_type: 1 00000100:00100000:0.0:1746143767.953280:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626613760:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143767.953314:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a6c85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aec expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.953321:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a6c85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aec expref: 11 pid: 13436 timeout: 927 lvb_type: 1 00000100:00100000:0.0:1746143767.953329:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626613888:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143767.953354:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a6c0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aa6 expref: 31 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.953438:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a6c0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aa6 expref: 31 pid: 12327 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143767.953446:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626614016:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143767.953467:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.953491:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.953751:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.953791:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.954287:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11001 00000100:00100000:0.0:1746143767.954293:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622158080:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143767.954690:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.954703:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082048a00/0x87925e4cb73a6bc1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a75 expref: 16 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.954710:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a6bc8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a7c expref: 16 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.954716:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a6c9a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b01 expref: 12 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.954722:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a6c07 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a9f expref: 31 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.954733:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143767.954734:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143767.954736:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 7/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.954752:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a6c07 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a9f expref: 31 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.954882:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a6c07 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a9f expref: 31 pid: 12328 timeout: 927 lvb_type: 1 00000100:00100000:0.0:1746143767.954891:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626614912:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143767.954946:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a6c9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b01 expref: 12 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.954953:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a6c9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b01 expref: 12 pid: 3134 timeout: 927 lvb_type: 1 00000100:00100000:0.0:1746143767.954960:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626615040:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143767.954984:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a6bc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a7c expref: 16 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.954991:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a6bc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a7c expref: 16 pid: 13436 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143767.955003:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626615168:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143767.955040:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082048a00/0x87925e4cb73a6bc1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a75 expref: 16 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.955048:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082048a00/0x87925e4cb73a6bc1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a75 expref: 16 pid: 9839 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143767.955055:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626615296:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143767.955068:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.956423:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626613248:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143767.956435:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626613504:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143767.956442:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626613632:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143767.956465:0:3134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.963779:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.963813:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.963845:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.963862:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.963881:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.963908:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622158336 00000100:00100000:0.0:1746143767.963943:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622158336 00000100:00100000:1.0:1746143767.963972:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622158592 00000100:00100000:1.0:1746143767.963977:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622158592 00010000:00010000:0.0:1746143767.963982:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800940f6600/0x87925e4cb73a6c7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ae5 expref: 13 pid: 12328 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.963994:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a6c85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aec expref: 14 pid: 13436 timeout: 927 lvb_type: 1 00000100:00100000:0.0:1746143767.964005:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622158848 00000100:00100000:1.0:1746143767.964016:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622159360 00000100:00100000:1.0:1746143767.964018:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622159360 00000100:00100000:0.0:1746143767.964020:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622158848 00010000:00010000:1.0:1746143767.964026:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a6c9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b01 expref: 15 pid: 3134 timeout: 927 lvb_type: 1 00010000:00010000:0.0:1746143767.964031:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73a6c23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ab4 expref: 17 pid: 12327 timeout: 927 lvb_type: 1 00000100:00100000:1.0:1746143767.964035:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622159744 00000100:00100000:1.0:1746143767.964037:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622159744 00000100:00100000:0.0:1746143767.964043:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5085 00010000:00010000:1.0:1746143767.964044:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082048a00/0x87925e4cb73a6bc1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a75 expref: 18 pid: 9839 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143767.964050:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2008:x1830963622158336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143767.964054:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5086 00000100:00100000:1.0:1746143767.964058:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2008:x1830963622158592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.964063:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.964066:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.964082:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a6c85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aec expref: 15 pid: 13436 timeout: 927 lvb_type: 1 00010000:00010000:0.0:1746143767.964082:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800940f6600/0x87925e4cb73a6c7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ae5 expref: 15 pid: 12328 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.964092:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a6c85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aec expref: 15 pid: 13436 timeout: 927 lvb_type: 1 00010000:00010000:0.0:1746143767.964092:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800940f6600/0x87925e4cb73a6c7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ae5 expref: 15 pid: 12328 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.964114:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a6c85 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aec expref: 15 pid: 13436 timeout: 927 lvb_type: 1 00010000:00010000:0.0:1746143767.964114:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940f6600/0x87925e4cb73a6c7e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ae5 expref: 15 pid: 12328 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.964134:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143767.964134:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.964172:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622158592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 114us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.964179:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5086 00000100:00100000:1.0:1746143767.964192:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5087 00000100:00100000:1.0:1746143767.964196:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622159360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.964202:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.964209:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a6c9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b01 expref: 12 pid: 3134 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.964216:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a6c9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b01 expref: 12 pid: 3134 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.964225:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a6c9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b01 expref: 12 pid: 3134 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.964232:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.965163:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622158336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1111us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.965167:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622159360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 968us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.965170:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5085 00000100:00100000:1.0:1746143767.965174:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5087 00000100:00100000:0.0:1746143767.965347:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.965500:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.965702:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622159104 00000100:00100000:0.0:1746143767.965705:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622159104 00010000:00010000:0.0:1746143767.965716:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a6b6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a3d expref: 13 pid: 3135 timeout: 927 lvb_type: 1 00000100:00100000:0.0:1746143767.965739:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5091 00000100:00100000:0.0:1746143767.965744:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622159104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.965751:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.965764:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a6b6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a3d expref: 13 pid: 3135 timeout: 927 lvb_type: 1 00010000:00010000:0.0:1746143767.965861:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a6b6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a3d expref: 13 pid: 3135 timeout: 927 lvb_type: 1 00010000:00010000:0.0:1746143767.965873:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a6b6d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a3d expref: 13 pid: 3135 timeout: 927 lvb_type: 1 00010000:00010000:0.0:1746143767.965880:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.965894:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622159104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.965899:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5091 00000100:00100000:1.0:1746143767.966685:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5093 00000100:00100000:1.0:1746143767.966692:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622158208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.966699:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.966706:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73a6b82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a52 expref: 32 pid: 13436 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.966716:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73a6b82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a52 expref: 32 pid: 13436 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.966726:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73a6b82 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a52 expref: 32 pid: 13436 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.966738:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.966740:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.966745:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.966753:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.966771:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.967395:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622158208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 702us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.967401:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5093 00000100:00100000:1.0:1746143767.967412:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622158720 00000100:00100000:1.0:1746143767.967415:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622158720 00010000:00010000:1.0:1746143767.967426:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a6c0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aa6 expref: 30 pid: 12327 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.967446:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622158976 00000100:00100000:1.0:1746143767.967448:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622158976 00010000:00010000:1.0:1746143767.967458:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73a6c93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409afa expref: 11 pid: 1947 timeout: 927 lvb_type: 1 00000100:00100000:1.0:1746143767.967474:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5094 00000100:00100000:1.0:1746143767.967478:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622158720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.967487:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.967495:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a6c0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aa6 expref: 30 pid: 12327 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.967503:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a6c0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aa6 expref: 30 pid: 12327 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.967514:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a6c0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409aa6 expref: 30 pid: 12327 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.967524:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.967526:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.967528:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967534:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967548:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.967563:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622158720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 84us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.967569:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5094 00000100:00100000:1.0:1746143767.967597:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5095 00000100:00100000:1.0:1746143767.967602:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622158976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.967610:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.967618:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73a6c93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409afa expref: 11 pid: 1947 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.967625:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73a6c93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409afa expref: 11 pid: 1947 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.967638:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73a6c93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409afa expref: 11 pid: 1947 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746143767.967647:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.967665:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622158976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 62us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.967670:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5095 00010000:00010000:1.0:1746143767.967688:0:3134:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967696:0:3134:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967714:0:3134:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967722:0:3134:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967729:0:3134:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967737:0:3134:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801331d2c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143767.967740:0:3134:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967748:0:3134:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967757:0:3134:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967763:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2c00/0x87925e4cb73a6cd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.967805:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622157568:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 15219us (15342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.967813:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10996 00010000:00010000:1.0:1746143767.967835:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967842:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967853:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967858:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967864:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967869:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e522000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143767.967871:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967876:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967884:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.967890:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e522000/0x87925e4cb73a6ce0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.967938:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622157696:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 14740us (14785us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.967943:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10998 00000100:00100000:0.0:1746143767.968049:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.968064:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.968100:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.968116:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622159872 00000100:00100000:0.0:1746143767.968119:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622159872 00010000:00010000:0.0:1746143767.968134:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a6bc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a7c expref: 14 pid: 13436 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143767.968599:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5099 00000100:00100000:0.0:1746143767.968607:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2010:x1830963622159872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.968615:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.968626:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a6bc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a7c expref: 14 pid: 13436 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143767.968635:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a6bc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a7c expref: 14 pid: 13436 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143767.968648:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a6bc8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409a7c expref: 14 pid: 13436 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143767.968658:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.968659:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.968661:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.968668:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.968683:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.968699:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622159872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 93us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.968706:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5099 00010000:00010000:0.0:1746143767.968722:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.968729:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.968739:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.968745:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.968756:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.968761:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec91400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143767.968764:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.968770:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.968778:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.968783:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73a6cf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.968812:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622158080:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 14519us (15020us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.968817:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11001 00000100:00100000:0.0:1746143767.981551:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.982848:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622160384 00000100:00100000:1.0:1746143767.982860:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622160384 00010000:00010000:1.0:1746143767.982899:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73a6c54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 118784->589823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ad0 expref: 26 pid: 12327 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.982969:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5101 00000100:00100000:1.0:1746143767.982978:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622160384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.982996:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.983025:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73a6c54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 118784->589823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ad0 expref: 26 pid: 12327 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.983038:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73a6c54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 118784->589823) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ad0 expref: 26 pid: 12327 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.983061:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73a6c54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 118784->589823) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ad0 expref: 26 pid: 12327 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.983445:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.983447:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.983453:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73a6cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.983462:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73a6cd9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.983501:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.983718:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963622160384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 740us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.983725:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5101 00000100:00100000:0.0:1746143767.989730:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.992848:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.992885:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.993083:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.993166:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622161024 00000100:00100000:1.0:1746143767.993171:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622161024 00010000:00010000:1.0:1746143767.993189:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73a66c7 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409749 expref: 22 pid: 7244 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.993215:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622161152 00000100:00100000:1.0:1746143767.993218:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622161152 00010000:00010000:1.0:1746143767.993227:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73a66ce lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409750 expref: 291 pid: 10936 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.993241:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5102 00000100:00100000:1.0:1746143767.993245:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2010:x1830963622161024:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.993254:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.993259:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73a66c7 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409749 expref: 21 pid: 7244 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.993268:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73a66c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409749 expref: 21 pid: 7244 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.993287:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143767.993292:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c600/0x87925e4cb73a6cfc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143767.993300:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.993316:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2010:x1830963622161024:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 70us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.993321:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5102 00000100:00100000:1.0:1746143767.993330:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5103 00000100:00100000:1.0:1746143767.993334:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+291:2008:x1830963622161152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.993341:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.993344:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73a66ce lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409750 expref: 291 pid: 10936 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.993351:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73a66ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409750 expref: 291 pid: 10936 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.993362:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143767.993364:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c600/0x87925e4cb73a6cfc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143767.993369:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.993381:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+291:2008:x1830963622161152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.993386:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5103 00000100:00100000:0.0:1746143767.996238:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143767.996502:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143767.996564:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622161280 00000100:00100000:1.0:1746143767.996574:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622161280 00010000:00010000:1.0:1746143767.996607:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a67ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097ce expref: 290 pid: 10936 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746143767.997451:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5105 00000100:00100000:1.0:1746143767.997458:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+290:2008:x1830963622161280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.997467:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.997471:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a67ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097ce expref: 290 pid: 10936 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.997479:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a67ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097ce expref: 290 pid: 10936 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.997489:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a67ca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484097ce expref: 290 pid: 10936 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746143767.997502:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143767.997506:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c600/0x87925e4cb73a6cfc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143767.997512:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.997535:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+289:2008:x1830963622161280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.997540:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5105 00000100:00100000:0.0:1746143767.997866:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143768.005204:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143768.005219:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626616064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.005271:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.005697:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626616320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.005724:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.005740:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626616832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.005752:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.005762:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626617344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.005775:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.005785:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626617856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.005799:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.005812:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746143768.005815:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626616192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.005829:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.005839:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626616704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.005851:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.005861:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626617216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.005873:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.005883:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626617728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.005893:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.005934:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626616064 00000100:00100000:1.0:1746143768.005941:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626616064 00000100:00100000:1.0:1746143768.005978:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626616320 00000100:00100000:1.0:1746143768.005981:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626616320 00000100:00100000:1.0:1746143768.005993:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626616832 00000100:00100000:1.0:1746143768.005995:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626616832 00000100:00100000:1.0:1746143768.006004:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626617344 00000100:00100000:1.0:1746143768.006023:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626617344 00000100:00100000:1.0:1746143768.006033:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626617856 00000100:00100000:1.0:1746143768.006035:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626617856 00000100:00100000:1.0:1746143768.006041:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626616192 00000100:00100000:1.0:1746143768.006043:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626616192 00000100:00100000:1.0:1746143768.006049:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626616704 00000100:00100000:1.0:1746143768.006051:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626616704 00000100:00100000:1.0:1746143768.006055:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626617216 00000100:00100000:1.0:1746143768.006057:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626617216 00000100:00100000:1.0:1746143768.006061:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626617728 00000100:00100000:1.0:1746143768.006063:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626617728 00000100:00100000:1.0:1746143768.006072:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11002 00000100:00100000:1.0:1746143768.006078:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3773:x1830963626616064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.006221:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3773:x1830963626616064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (949us total) trans 21474840173 rc 0/0 00000100:00100000:1.0:1746143768.006226:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11002 00000100:00100000:1.0:1746143768.006237:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11003 00000100:00100000:1.0:1746143768.006241:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626616320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.006308:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963626616320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (583us total) trans 17179872858 rc 0/0 00000100:00100000:1.0:1746143768.006313:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11003 00000100:00100000:1.0:1746143768.006322:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11004 00000100:00100000:1.0:1746143768.006326:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963626616832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.006375:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626616832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (621us total) trans 21474840174 rc 0/0 00000100:00100000:1.0:1746143768.006383:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11004 00000100:00100000:1.0:1746143768.006391:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11005 00000100:00100000:1.0:1746143768.006396:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626617344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.006443:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963626617344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (666us total) trans 17179872859 rc 0/0 00000100:00100000:1.0:1746143768.006448:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11005 00000100:00100000:1.0:1746143768.006457:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11006 00000100:00100000:1.0:1746143768.006461:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626617856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.006509:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963626617856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (709us total) trans 17179872860 rc 0/0 00000100:00100000:1.0:1746143768.006514:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11006 00000100:00100000:1.0:1746143768.006522:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11007 00000100:00100000:1.0:1746143768.006526:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963626616192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.006572:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626616192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (741us total) trans 21474840175 rc 0/0 00000100:00100000:1.0:1746143768.006576:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11007 00000100:00100000:1.0:1746143768.006585:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11008 00000100:00100000:1.0:1746143768.006588:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963626616704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.006636:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626616704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (783us total) trans 21474840176 rc 0/0 00000100:00100000:1.0:1746143768.006641:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11008 00000100:00100000:1.0:1746143768.006648:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11009 00000100:00100000:1.0:1746143768.006652:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626617216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.006697:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963626617216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (823us total) trans 17179872861 rc 0/0 00000100:00100000:1.0:1746143768.006703:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11009 00000100:00100000:1.0:1746143768.006710:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11010 00000100:00100000:1.0:1746143768.006714:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626617728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.006760:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963626617728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (866us total) trans 17179872862 rc 0/0 00000100:00100000:1.0:1746143768.006765:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11010 00000100:00080000:1.0:1746143768.006780:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143768.006783:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143768.006812:0:3772:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840161 gen 2 00000004:00080000:1.0:1746143768.006817:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391ca80, transno 21474840092 00000004:00080000:1.0:1746143768.006825:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391c380, transno 21474840093 00000004:00080000:1.0:1746143768.006828:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb4000, transno 21474840094 00000004:00080000:1.0:1746143768.006830:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb5500, transno 21474840095 00000004:00080000:1.0:1746143768.006833:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391f480, transno 21474840096 00000004:00080000:1.0:1746143768.006835:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb4a80, transno 21474840097 00000004:00080000:1.0:1746143768.006837:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391c700, transno 21474840098 00000004:00080000:1.0:1746143768.006840:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb6680, transno 21474840099 00000004:00080000:1.0:1746143768.006842:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009719ca80, transno 21474840100 00000004:00080000:1.0:1746143768.006845:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093726d80, transno 21474840101 00000004:00080000:1.0:1746143768.006847:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093724a80, transno 21474840102 00000004:00080000:1.0:1746143768.006849:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093727800, transno 21474840103 00000004:00080000:1.0:1746143768.006851:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093724380, transno 21474840104 00000004:00080000:1.0:1746143768.006852:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093726300, transno 21474840105 00000004:00080000:1.0:1746143768.006854:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093725c00, transno 21474840106 00000004:00080000:1.0:1746143768.006856:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093727480, transno 21474840107 00000004:00080000:1.0:1746143768.006858:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093727100, transno 21474840108 00000004:00080000:1.0:1746143768.006860:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef0000, transno 21474840109 00000004:00080000:1.0:1746143768.006863:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938dc700, transno 21474840123 00000004:00080000:1.0:1746143768.006865:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938dfb80, transno 21474840124 00000004:00080000:1.0:1746143768.006868:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373bbb80, transno 21474840125 00000004:00080000:1.0:1746143768.006871:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938de680, transno 21474840126 00000004:00080000:1.0:1746143768.006873:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938dce00, transno 21474840127 00000004:00080000:1.0:1746143768.006876:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938dc000, transno 21474840128 00000004:00080000:1.0:1746143768.006878:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938de300, transno 21474840129 00000004:00080000:1.0:1746143768.006881:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938df100, transno 21474840130 00000004:00080000:1.0:1746143768.006884:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f648e00, transno 21474840131 00000004:00080000:1.0:1746143768.006886:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e79880, transno 21474840133 00000004:00080000:1.0:1746143768.006888:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c30e00, transno 21474840134 00000004:00080000:1.0:1746143768.006891:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c31180, transno 21474840135 00000004:00080000:1.0:1746143768.006893:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c30a80, transno 21474840136 00000004:00080000:1.0:1746143768.006895:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e7a300, transno 21474840137 00000004:00080000:1.0:1746143768.006897:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e79500, transno 21474840138 00000004:00080000:1.0:1746143768.006899:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e7aa00, transno 21474840139 00000004:00080000:1.0:1746143768.006901:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c32680, transno 21474840140 00000004:00080000:1.0:1746143768.006903:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093417480, transno 21474840141 00000004:00080000:1.0:1746143768.006906:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921ce300, transno 21474840144 00000004:00080000:1.0:1746143768.006908:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cc000, transno 21474840145 00000004:00080000:1.0:1746143768.006935:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e358700, transno 21474840146 00000004:00080000:1.0:1746143768.006938:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cdc00, transno 21474840147 00000004:00080000:1.0:1746143768.006940:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35b100, transno 21474840148 00000004:00080000:1.0:1746143768.006942:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c33b80, transno 21474840149 00000004:00080000:1.0:1746143768.006944:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cca80, transno 21474840150 00000004:00080000:1.0:1746143768.006946:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cd880, transno 21474840151 00000004:00080000:1.0:1746143768.006948:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972ea680, transno 21474840152 00000004:00080000:1.0:1746143768.006950:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093414700, transno 21474840153 00000004:00080000:1.0:1746143768.006953:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093417800, transno 21474840154 00000004:00080000:1.0:1746143768.006955:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457f100, transno 21474840155 00000004:00080000:1.0:1746143768.006958:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093414a80, transno 21474840156 00000004:00080000:1.0:1746143768.006960:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093417100, transno 21474840157 00000004:00080000:1.0:1746143768.006963:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457d500, transno 21474840158 00000004:00080000:1.0:1746143768.006965:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093416300, transno 21474840159 00000004:00080000:1.0:1746143768.006967:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457e300, transno 21474840160 00000004:00080000:1.0:1746143768.006969:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b63480, transno 21474840161 00000100:00100000:1.0:1746143768.006976:0:3772:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880091bc8a80 x1830963626616192/t21474840175(21474840175) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143784 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746143768.006986:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bc8a80/2, rc 0, transno 21474840175 00000100:00100000:1.0:1746143768.006991:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626616192:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.007002:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bc9c00/2, rc 0, transno 21474840176 00000100:00100000:1.0:1746143768.007004:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626616704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.007027:0:3772:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872844 gen 2 00000004:00080000:1.0:1746143768.007030:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e27480, transno 17179872783 00000004:00080000:1.0:1746143768.007036:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e25f80, transno 17179872784 00000004:00080000:1.0:1746143768.007038:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e26680, transno 17179872785 00000004:00080000:1.0:1746143768.007040:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e25c00, transno 17179872786 00000004:00080000:1.0:1746143768.007042:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e27100, transno 17179872787 00000004:00080000:1.0:1746143768.007045:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e25880, transno 17179872788 00000004:00080000:1.0:1746143768.007048:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e27800, transno 17179872789 00000004:00080000:1.0:1746143768.007050:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e26d80, transno 17179872790 00000004:00080000:1.0:1746143768.007052:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7a9c00, transno 17179872791 00000004:00080000:1.0:1746143768.007054:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb5c00, transno 17179872792 00000004:00080000:1.0:1746143768.007057:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb5880, transno 17179872793 00000004:00080000:1.0:1746143768.007059:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7a8380, transno 17179872794 00000004:00080000:1.0:1746143768.007061:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7abb80, transno 17179872795 00000004:00080000:1.0:1746143768.007064:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7aaa00, transno 17179872796 00000004:00080000:1.0:1746143768.007066:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb5f80, transno 17179872797 00000004:00080000:1.0:1746143768.007069:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7ab800, transno 17179872798 00000004:00080000:1.0:1746143768.007071:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33b80, transno 17179872811 00000004:00080000:1.0:1746143768.007073:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30e00, transno 17179872812 00000004:00080000:1.0:1746143768.007075:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30000, transno 17179872813 00000004:00080000:1.0:1746143768.007078:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32a00, transno 17179872814 00000004:00080000:1.0:1746143768.007080:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093726680, transno 17179872815 00000004:00080000:1.0:1746143768.007082:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32d80, transno 17179872816 00000004:00080000:1.0:1746143768.007085:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e31f80, transno 17179872817 00000004:00080000:1.0:1746143768.007087:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093725f80, transno 17179872818 00000004:00080000:1.0:1746143768.007090:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a52300, transno 17179872820 00000004:00080000:1.0:1746143768.007093:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880082ed6680, transno 17179872821 00000004:00080000:1.0:1746143768.007095:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cea00, transno 17179872822 00000004:00080000:1.0:1746143768.007097:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092a52d80, transno 17179872823 00000004:00080000:1.0:1746143768.007099:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f64ad80, transno 17179872824 00000004:00080000:1.0:1746143768.007102:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cf100, transno 17179872825 00000004:00080000:1.0:1746143768.007103:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cc700, transno 17179872826 00000004:00080000:1.0:1746143768.007106:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cf480, transno 17179872827 00000004:00080000:1.0:1746143768.007108:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093072300, transno 17179872829 00000004:00080000:1.0:1746143768.007111:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880082ed7480, transno 17179872830 00000004:00080000:1.0:1746143768.007113:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136aca300, transno 17179872831 00000004:00080000:1.0:1746143768.007116:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880082ed4000, transno 17179872832 00000004:00080000:1.0:1746143768.007118:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093071f80, transno 17179872833 00000004:00080000:1.0:1746143768.007120:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b48000, transno 17179872834 00000004:00080000:1.0:1746143768.007122:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880082ed6300, transno 17179872835 00000004:00080000:1.0:1746143768.007124:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b49880, transno 17179872836 00000004:00080000:1.0:1746143768.007127:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fdbb80, transno 17179872837 00000004:00080000:1.0:1746143768.007129:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fd8e00, transno 17179872838 00000004:00080000:1.0:1746143768.007131:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef3800, transno 17179872839 00000004:00080000:1.0:1746143768.007133:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fd9f80, transno 17179872840 00000004:00080000:1.0:1746143768.007135:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fda680, transno 17179872841 00000004:00080000:1.0:1746143768.007138:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef1c00, transno 17179872842 00000004:00080000:1.0:1746143768.007140:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fdb100, transno 17179872843 00000004:00080000:1.0:1746143768.007142:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef3100, transno 17179872844 00000100:00100000:1.0:1746143768.007145:0:3772:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880095e33800 x1830963626617216/t17179872861(17179872861) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143784 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746143768.007152:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33800/2, rc 0, transno 17179872861 00000100:00100000:1.0:1746143768.007154:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626617216:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.007163:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c38700/2, rc 0, transno 17179872862 00000100:00100000:1.0:1746143768.007165:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626617728:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.007171:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30a80/2, rc 0, transno 17179872858 00000100:00100000:1.0:1746143768.007173:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626616320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.007178:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bcb480/2, rc 0, transno 21474840174 00000100:00100000:1.0:1746143768.007181:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626616832:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.007186:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30700/2, rc 0, transno 17179872859 00000100:00100000:1.0:1746143768.007188:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626617344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.007193:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c38000/2, rc 0, transno 17179872860 00000100:00100000:1.0:1746143768.007195:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626617856:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.007449:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 3 in flight, 48 done 00000100:00100000:0.0:1746143768.007571:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626616448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.007606:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.007623:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626616960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.007636:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.007645:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626617472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.007657:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.007665:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626617984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.007677:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143768.007692:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bcb800/2, rc 0, transno 21474840173 00000100:00100000:0.0:1746143768.007695:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626616064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.007702:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746143768.007707:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626616576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.007720:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.007728:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626617088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.007738:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.007745:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626617600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.007754:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.007772:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626616448 00000100:00100000:0.0:1746143768.007777:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626616448 00000100:00100000:0.0:1746143768.007797:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626616960 00000100:00100000:0.0:1746143768.007799:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626616960 00000100:00100000:0.0:1746143768.007805:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626617472 00000100:00100000:0.0:1746143768.007807:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626617472 00000100:00100000:0.0:1746143768.007813:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626617984 00000100:00100000:0.0:1746143768.007815:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626617984 00000100:00100000:0.0:1746143768.007820:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626616576 00000100:00100000:0.0:1746143768.007821:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626616576 00000100:00100000:0.0:1746143768.007827:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626617088 00000100:00100000:0.0:1746143768.007828:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626617088 00000100:00100000:0.0:1746143768.007834:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626617600 00000100:00100000:0.0:1746143768.007835:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626617600 00000100:00100000:0.0:1746143768.007843:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11011 00000100:00100000:0.0:1746143768.007848:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626616448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.007944:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626616448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (337us total) trans 21474840177 rc 0/0 00000100:00100000:0.0:1746143768.007950:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11011 00000100:00100000:0.0:1746143768.007961:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11012 00000100:00100000:0.0:1746143768.007966:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626616960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143768.008020:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143768.008023:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143768.008025:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143768.008027:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143768.008029:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143768.008047:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626616960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (410us total) trans 21474840178 rc 0/0 00000100:00100000:0.0:1746143768.008052:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11012 00000100:00100000:0.0:1746143768.008061:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11013 00000100:00100000:0.0:1746143768.008065:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626617472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143768.008106:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143768.008108:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143768.008111:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:0.0:1746143768.008112:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143768.008114:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143768.008131:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626617472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (472us total) trans 17179872863 rc 0/0 00000100:00100000:0.0:1746143768.008135:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11013 00000100:00100000:0.0:1746143768.008144:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11014 00000100:00100000:0.0:1746143768.008147:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626617984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.008197:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626617984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (519us total) trans 17179872864 rc 0/0 00000100:00100000:0.0:1746143768.008202:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11014 00000100:00100000:0.0:1746143768.008210:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11015 00000100:00100000:0.0:1746143768.008213:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626616576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.008259:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626616576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (537us total) trans 21474840179 rc 0/0 00000100:00100000:0.0:1746143768.008263:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11015 00000100:00100000:0.0:1746143768.008273:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11016 00000100:00100000:0.0:1746143768.008277:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626617088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.008319:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626617088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (580us total) trans 21474840180 rc 0/0 00000100:00100000:0.0:1746143768.008324:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11016 00000100:00100000:0.0:1746143768.008331:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11017 00000100:00100000:0.0:1746143768.008335:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626617600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143768.008367:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143768.008370:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143768.008372:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143768.008374:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143768.008375:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746143768.008389:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626617600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (634us total) trans 17179872865 rc 0/0 00000100:00100000:0.0:1746143768.008393:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11017 00000004:00080000:0.0:1746143768.008410:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bca680/2, rc 0, transno 21474840179 00000100:00100000:0.0:1746143768.008413:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626616576:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143768.008418:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5b100/2, rc 0, transno 21474840180 00000100:00100000:0.0:1746143768.008420:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626617088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143768.008425:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c39880/2, rc 0, transno 17179872865 00000100:00100000:0.0:1746143768.008428:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626617600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143768.008433:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bcaa00/2, rc 0, transno 21474840177 00000100:00100000:0.0:1746143768.008435:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626616448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143768.008439:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e59180/2, rc 0, transno 21474840178 00000100:00100000:0.0:1746143768.008442:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626616960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143768.008446:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33480/2, rc 0, transno 17179872863 00000100:00100000:0.0:1746143768.008448:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626617472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143768.008453:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c39180/2, rc 0, transno 17179872864 00000100:00100000:0.0:1746143768.008455:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626617984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.016576:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143768.023556:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143768.023840:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143768.024188:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143768.024594:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622161920 00000100:00100000:1.0:1746143768.024605:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622161920 00000100:00100000:0.0:1746143768.024621:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143768.024636:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143768.024650:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622162048 00000100:00100000:1.0:1746143768.024653:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622162048 00000100:00100000:0.0:1746143768.024663:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143768.024664:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622162176 00000100:00100000:1.0:1746143768.024665:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622162176 00000100:00100000:1.0:1746143768.024674:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622162304 00000100:00100000:1.0:1746143768.024676:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622162304 00000100:00100000:1.0:1746143768.024693:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622162432 00000100:00100000:1.0:1746143768.024695:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622162432 00000100:00100000:0.0:1746143768.024698:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622162560 00000100:00100000:0.0:1746143768.024701:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622162560 00000100:00100000:1.0:1746143768.024768:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11019 00000100:00100000:1.0:1746143768.024777:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622161920:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143768.024796:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.024814:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73a6d1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b2b expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143768.024836:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a18, atime: 0x68140a16, ctime: 0x68140a18, blocks: 0x7d8 00010000:00010000:1.0:1746143768.024854:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.024856:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.024865:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73a6d1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b2b expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.024879:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73a6d1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b2b expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.024889:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551800, rc 0) 00000100:00100000:1.0:1746143768.024951:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622161920:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 174us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.024957:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11019 00000100:00100000:1.0:1746143768.024973:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11021 00000100:00100000:1.0:1746143768.024976:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622162176:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143768.024982:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.024990:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a6d26 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b39 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143768.025003:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a18, atime: 0x68140a17, ctime: 0x68140a18, blocks: 0x800 00010000:00010000:1.0:1746143768.025022:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.025023:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.025026:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a6d26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b39 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.025034:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a6d26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b39 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.025041:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551e00, rc 0) 00000100:00100000:1.0:1746143768.025054:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622162176:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 77us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.025059:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11021 00000100:00100000:1.0:1746143768.025067:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11022 00000100:00100000:1.0:1746143768.025071:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622162304:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143768.025077:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.025084:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a6d2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b40 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143768.025092:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a17, atime: 0x68140a14, ctime: 0x68140a17, blocks: 0x808 00010000:00010000:1.0:1746143768.025100:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.025101:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.025104:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a6d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b40 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.025116:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a6d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b40 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.025122:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550000, rc 0) 00000100:00100000:1.0:1746143768.025136:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622162304:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 64us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.025141:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11022 00000100:00100000:1.0:1746143768.025150:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11023 00000100:00100000:1.0:1746143768.025154:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622162432:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143768.025160:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.025167:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a6d34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b47 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143768.025175:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4773792, mtime: 0x68140a18, atime: 0x68140a18, ctime: 0x68140a17, blocks: 0x1478 00010000:00010000:1.0:1746143768.025182:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.025184:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.025188:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a6d34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b47 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143768.025193:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11024 00010000:00010000:1.0:1746143768.025196:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a6d34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b47 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143768.025199:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622162560:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143768.025202:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551200, rc 0) 00010000:00010000:0.0:1746143768.025204:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.025212:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73a6d3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b4e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.025216:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622162432:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 61us (579us total) trans 0 rc 0/0 00002000:00010000:0.0:1746143768.025222:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a18, atime: 0x68140a17, ctime: 0x68140a18, blocks: 0x1008 00000100:00100000:1.0:1746143768.025223:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11023 00010000:00010000:0.0:1746143768.025229:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.025230:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.025234:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73a6d3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b4e expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.025241:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73a6d3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b4e expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.025247:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3000, rc 0) 00000100:00100000:0.0:1746143768.025259:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622162560:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 61us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.025264:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11024 00000100:00100000:0.0:1746143768.391199:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143768.391222:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626618240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143768.391306:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.392081:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626618240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143769.030707:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.030753:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.030789:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.030803:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.030815:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.031112:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.031374:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622163328 00000100:00100000:1.0:1746143769.031377:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622163328 00000100:00100000:0.0:1746143769.031405:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622163200 00000100:00100000:0.0:1746143769.031407:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622163200 00000100:00100000:1.0:1746143769.031555:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11027 00000100:00100000:1.0:1746143769.031561:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622162816:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143769.031609:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11029 00000100:00100000:0.0:1746143769.031615:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622163328:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143769.034432:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622163328:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 2807us (3605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.034444:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11029 00000100:00100000:1.0:1746143769.034575:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622162816:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 3013us (3819us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.034581:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11027 00000100:00100000:0.0:1746143769.037988:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.041427:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.041481:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622163584 00000100:00100000:1.0:1746143769.041491:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622163584 00000100:00100000:1.0:1746143769.041551:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11031 00000100:00100000:1.0:1746143769.041559:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622163584:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:1.0:1746143769.041688:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622163584:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 130us (3721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.041695:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11031 00000100:00100000:0.0:1746143769.041991:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.042021:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.042102:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.042130:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.042506:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622163712 00000100:00100000:0.0:1746143769.042508:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622163712 00000100:00100000:0.0:1746143769.042532:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11033 00000100:00100000:0.0:1746143769.042536:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622164096:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143769.042583:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622164096:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 46us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.042591:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11033 00000100:00100000:0.0:1746143769.042599:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11034 00000100:00100000:0.0:1746143769.042603:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622163456:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143769.042629:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622163456:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.042633:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11034 00000100:00100000:0.0:1746143769.042641:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11036 00000100:00100000:0.0:1746143769.042644:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622163712:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143769.042669:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622163712:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.042674:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11036 00000100:00100000:0.0:1746143769.047825:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.050848:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.050906:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622164352 00000100:00100000:1.0:1746143769.050934:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622164352 00000100:00100000:1.0:1746143769.050983:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11038 00000100:00100000:1.0:1746143769.050990:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622164352:12345-192.168.202.3@tcp:22:mirror_io.0 00002000:00010000:1.0:1746143769.051191:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143769.051194:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143769.051197:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143769.051199:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143769.051201:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143769.051240:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622164352:12345-192.168.202.3@tcp:22:mirror_io.0 Request processed in 250us (399us total) trans 21474840182 rc 0/0 00000100:00100000:1.0:1746143769.051247:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11038 00000100:00100000:0.0:1746143769.057219:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.057745:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.057786:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.057814:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622164992 00000100:00100000:0.0:1746143769.057817:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622164992 00000100:00100000:0.0:1746143769.057840:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622164864 00000100:00100000:0.0:1746143769.057842:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622164864 00000100:00100000:0.0:1746143769.057854:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2967 00000100:00100000:0.0:1746143769.057860:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622164992:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143769.058386:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73a6d49 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.058396:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.058398:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.058401:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73a6d49 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.058416:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73a6d49 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.061160:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622165888 00000100:00100000:0.0:1746143769.061164:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622165888 00000100:00100000:0.0:1746143769.061189:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2970 00000100:00100000:0.0:1746143769.061195:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622165632:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143769.061210:0:20385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a6d5e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.061218:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.061220:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.061223:0:20385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a6d5e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.061232:0:20385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a6d5e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.063891:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.064335:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.064352:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622166400 00000100:00100000:0.0:1746143769.064355:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622166400 00000100:00100000:0.0:1746143769.064396:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2973 00000100:00100000:0.0:1746143769.064401:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2010:x1830963622166400:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143769.064417:0:20387:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a6d73 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.064429:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.064431:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.064434:0:20387:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a6d73 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.064443:0:20387:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a6d73 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.086012:0:20385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a6d5e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.086031:0:20385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a6d5e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.086040:0:20385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a6d5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.086047:0:20385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b27a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143769.086051:0:20385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a6d5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.086058:0:20385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a6d5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.086076:0:20385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a6d5e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.086081:0:20385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73a6d5e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.086415:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622165632:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 25214us (25352us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.086429:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2970 00000100:00100000:0.0:1746143769.104242:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.110301:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.112748:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.127778:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.128632:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143769.129728:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143769.132451:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.133589:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.133626:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.133666:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622168192 00000100:00100000:1.0:1746143769.133670:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622168192 00000100:00100000:0.0:1746143769.133693:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143769.133708:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143769.133712:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143769.133734:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622168448 00000100:00100000:1.0:1746143769.133737:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622168448 00000100:00100000:0.0:1746143769.134008:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11041 00000100:00100000:0.0:1746143769.134016:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622168448:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143769.134024:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.134032:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a6ddc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b86 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.134044:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.134046:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.134050:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a6ddc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b86 expref: 14 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.134060:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a6ddc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b86 expref: 13 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.134066:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6600, rc 0) 00000100:00100000:0.0:1746143769.134351:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622168448:12345-192.168.202.3@tcp:101:cat.0 Request processed in 335us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.134357:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11041 00000100:00100000:1.0:1746143769.134686:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.134709:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.134758:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.134758:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622168064 00000100:00100000:0.0:1746143769.134763:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622168064 00000100:00100000:0.0:1746143769.134785:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622168320 00000100:00100000:0.0:1746143769.134788:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622168320 00000100:00100000:0.0:1746143769.134798:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622168576 00000100:00100000:0.0:1746143769.134800:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622168576 00000100:00100000:0.0:1746143769.134845:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11043 00000100:00100000:0.0:1746143769.134851:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622168320:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143769.134859:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.134866:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b7400/0x87925e4cb73a6de3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b7f expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.134877:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.134879:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.134883:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b7400/0x87925e4cb73a6de3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b7f expref: 14 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.134892:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b7400/0x87925e4cb73a6de3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b7f expref: 14 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.134900:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7400, rc 0) 00000100:00100000:0.0:1746143769.134941:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622168320:12345-192.168.202.3@tcp:101:cat.0 Request processed in 89us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.134947:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11043 00000100:00100000:0.0:1746143769.134958:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11044 00000100:00100000:0.0:1746143769.134963:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622168576:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143769.134969:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.134976:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a6dea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b8d expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.134986:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.134988:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.134992:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a6dea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b8d expref: 16 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.135012:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a6dea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b8d expref: 16 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.135019:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7a00, rc 0) 00000100:00100000:0.0:1746143769.135033:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622168576:12345-192.168.202.3@tcp:101:cat.0 Request processed in 71us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.135038:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11044 00000100:00100000:0.0:1746143769.136231:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.136306:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622168832 00000100:00100000:1.0:1746143769.136312:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622168832 00000100:00100000:1.0:1746143769.136352:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12677 00000100:00100000:1.0:1746143769.136359:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:31722:x1830963622168832:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143769.136372:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.136381:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a6df8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b94 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.136445:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73a6dff lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.136454:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73a6dff lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.136462:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73a6dff lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143769.136469:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:0.0:1746143769.136780:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.136833:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.136851:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622169088 00000100:00100000:0.0:1746143769.136856:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622169088 00010000:00010000:0.0:1746143769.136877:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a6d8f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b55 expref: 11 pid: 10936 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746143769.136896:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622168960 00000100:00100000:0.0:1746143769.136898:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622168960 00010000:00010000:0.0:1746143769.136906:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73a6db2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b5c expref: 265 pid: 10936 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746143769.136938:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5107 00000100:00100000:0.0:1746143769.136944:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622169088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143769.136956:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.136961:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a6d8f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b55 expref: 11 pid: 10936 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143769.136971:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a6d8f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b55 expref: 11 pid: 10936 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143769.136988:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a6d8f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b55 expref: 11 pid: 10936 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143769.137015:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143769.137020:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a6dc7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143769.137028:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a6dc7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143769.137034:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143769.137499:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622169088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 554us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.137506:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5107 00010000:00010000:1.0:1746143769.137568:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a6df8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b94 expref: 266 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.137589:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73a6dff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b94 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.137631:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.137633:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143769.137636:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a6dc7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143769.137642:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a6dc7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143769.137646:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523200, rc 0) 00000100:00100000:1.0:1746143769.137675:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:31722:x1830963622168832:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1316us (1445us total) trans 8589943358 rc 0/0 00000100:00100000:1.0:1746143769.137680:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12677 00000100:00100000:0.0:1746143769.143029:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.143130:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622169216 00000100:00100000:1.0:1746143769.143141:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622169216 00000100:00100000:1.0:1746143769.143206:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12678 00000100:00100000:1.0:1746143769.143213:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:31716:x1830963622169216:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.143231:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.143247:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523a00/0x87925e4cb73a6e0d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409b9b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.143296:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523a00/0x87925e4cb73a6e0d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b9b expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.143308:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523a00/0x87925e4cb73a6e0d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b9b expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.143324:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.143327:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143769.143330:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523a00, rc 0) 00000100:00100000:1.0:1746143769.143388:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:31716:x1830963622169216:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 175us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.143394:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12678 00000100:00100000:1.0:1746143769.144169:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622169600 00000100:00100000:1.0:1746143769.144173:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622169600 00010000:00010000:1.0:1746143769.144189:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53800/0x87925e4cb73a6d11 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b24 expref: 10 pid: 7244 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746143769.144218:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5109 00000100:00100000:1.0:1746143769.144224:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622169600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.144232:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.144237:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53800/0x87925e4cb73a6d11 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b24 expref: 10 pid: 7244 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.144246:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53800/0x87925e4cb73a6d11 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b24 expref: 10 pid: 7244 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.144259:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53800/0x87925e4cb73a6d11 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b24 expref: 10 pid: 7244 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.144287:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.144291:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a6dc7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143769.144297:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a6dc7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143769.144302:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a6dc7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143769.144308:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143769.144312:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143769.144317:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143769.144336:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.144355:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622169600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 132us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.144361:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5109 00000100:00100000:0.0:1746143769.152397:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.152428:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.152491:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.152524:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.152633:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12681 00000100:00100000:1.0:1746143769.152641:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+267:31716:x1830963622169984:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.152655:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.152657:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143769.152667:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73a6dff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b94 expref: 267 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.152990:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.152994:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143769.153010:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143769.153015:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143769.153022:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143769.153032:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73a6e30 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409bb0 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.153066:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.153075:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a6d03 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b1d expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.153082:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a6e1b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ba9 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.153087:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143769.153091:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746143769.153093:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143769.153103:0:7243:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143769.153119:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a6e1b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ba9 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.153128:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a6e1b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ba9 expref: 10 pid: 14991 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746143769.153138:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626618752:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143769.153187:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a6d03 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b1d expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.153194:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a6d03 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b1d expref: 8 pid: 10936 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746143769.153200:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626618880:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143769.153215:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.153230:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622170752 00000100:00100000:1.0:1746143769.153233:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622170752 00002000:00100000:1.0:1746143769.153248:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012d841f80 x1830963622170752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.153255:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841f80 with x1830963622170752 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.153258:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d841f80 00000100:00100000:1.0:1746143769.153271:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2976 00000100:00100000:1.0:1746143769.153275:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622170752:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143769.153308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.159447:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.159514:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626618752:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143769.159546:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626618880:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143769.159564:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:1.0:1746143769.159605:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.166902:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.171353:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622170752:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18064us (18253us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.171365:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2976 00002000:00100000:1.0:1746143769.171378:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012d841f80 x1830963622170752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.171387:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841f80 with x1830963622170752 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.171393:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d841f80 00000100:00100000:0.0:1746143769.179112:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.179702:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.179893:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.179933:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622171776 00000100:00100000:0.0:1746143769.179938:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622171776 00010000:00010000:0.0:1746143769.179961:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ba2 expref: 266 pid: 7244 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746143769.179984:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5113 00000100:00100000:0.0:1746143769.179989:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+266:2009:x1830963622171776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143769.180010:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.180018:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ba2 expref: 266 pid: 7244 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143769.180028:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ba2 expref: 266 pid: 7244 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143769.180048:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a6e22 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ba2 expref: 266 pid: 7244 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143769.180065:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143769.180068:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.180075:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.180081:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.180088:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6e3e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb7 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.180102:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143769.180118:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+266:2009:x1830963622171776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.180124:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5113 00010000:00010000:1.0:1746143769.180233:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.180244:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00000040:00080000:1.0:1746143769.180524:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2572, 88 off214048 00000004:00080000:1.0:1746143769.180533:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828404619678ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143769.180569:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2544, 88 off211928 00000004:00080000:1.0:1746143769.180574:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828404662016ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143769.180597:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2545, 88 off212016 00000004:00080000:1.0:1746143769.180601:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828404688360ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143769.180609:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2573, 88 off214136 00000004:00080000:1.0:1746143769.180612:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828404699609ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143769.180619:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2574, 88 off214224 00000004:00080000:1.0:1746143769.180622:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828404709716ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143769.180732:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2546, 88 off212104 00000004:00080000:1.0:1746143769.180736:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828404824189ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143769.180749:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2547, 88 off212192 00000004:00080000:1.0:1746143769.180752:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828404839426ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143769.180760:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2548, 88 off212280 00000004:00080000:1.0:1746143769.180763:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828404850769ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143769.180772:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2575, 88 off214312 00000004:00080000:1.0:1746143769.180774:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828404862280ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143769.180846:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2549, 88 off212368 00000004:00080000:1.0:1746143769.180850:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828404937416ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143769.180867:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2576, 88 off214400 00000004:00080000:1.0:1746143769.180873:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828404961166ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143769.180883:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2550, 88 off212456 00000004:00080000:1.0:1746143769.180885:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828404973028ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143769.180894:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2577, 88 off214488 00000004:00080000:1.0:1746143769.180897:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828404984709ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143769.180904:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2578, 88 off214576 00000004:00080000:1.0:1746143769.180906:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828404994308ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143769.180931:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2579, 88 off214664 00000004:00080000:1.0:1746143769.180934:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828405022166ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143769.180943:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2580, 88 off214752 00000004:00080000:1.0:1746143769.180946:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828405033448ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143769.180954:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2551, 88 off212544 00000004:00080000:1.0:1746143769.180957:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828405044603ns, next at 770855090093ns, rc = 0 00000100:00100000:1.0:1746143769.182707:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626619008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.182716:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626619264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.182738:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.182771:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626619520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.182771:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.182785:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.182785:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626619648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.182806:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626619520 00000100:00100000:1.0:1746143769.182807:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626620032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.182809:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626619520 00000100:00100000:1.0:1746143769.182820:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.182829:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626620032 00000100:00100000:0.0:1746143769.182830:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626620032 00000100:00100000:1.0:1746143769.182838:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626620544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.182844:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11047 00000100:00100000:0.0:1746143769.182849:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3772:x1830963626619520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.182851:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.182872:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626620544 00000100:00100000:1.0:1746143769.182875:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626620544 00000100:00100000:1.0:1746143769.182892:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11048 00000100:00100000:1.0:1746143769.182896:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626619264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.182905:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.182937:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626620416:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143769.182943:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4773792 -> 4773792 00002000:00010000:0.0:1746143769.182946:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.182948:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.182950:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143767 -> 1746143767 00002000:00010000:0.0:1746143769.182952:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5240 -> 5240 00000100:00100000:1.0:1746143769.182953:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.182960:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626620928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.182977:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.182977:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963626619520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (192us total) trans 21474840184 rc 0/0 00000100:00100000:0.0:1746143769.182984:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11047 00000100:00100000:0.0:1746143769.183008:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626619904 00000100:00100000:0.0:1746143769.183011:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626619904 00000100:00100000:0.0:1746143769.183020:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626620928 00000100:00100000:0.0:1746143769.183021:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626620928 00000100:00100000:0.0:1746143769.183030:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11050 00000100:00100000:0.0:1746143769.183034:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963626620544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143769.183041:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143769.183043:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.183045:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00002000:00010000:1.0:1746143769.183047:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.183048:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746143769.183068:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3773:x1830963626619264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (295us total) trans 17179872869 rc 0/0 00000100:00100000:1.0:1746143769.183073:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11048 00000100:00100000:0.0:1746143769.183080:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963626620544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (228us total) trans 17179872870 rc 0/0 00000100:00100000:1.0:1746143769.183084:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11053 00000100:00100000:0.0:1746143769.183086:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11050 00000100:00100000:1.0:1746143769.183088:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626620928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.183103:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143769.183114:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac8000/2, rc 0, transno 17179872870 00000100:00100000:0.0:1746143769.183114:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626620160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.183118:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626620544:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143769.183125:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4c700/2, rc 0, transno 17179872867 00000100:00100000:1.0:1746143769.183128:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626619008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.183132:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143769.183134:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e2300/2, rc 0, transno 21474840184 00000100:00100000:1.0:1746143769.183139:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626619520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.183142:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626620672:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143769.183145:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac9c00/2, rc 0, transno 17179872868 00000100:00100000:1.0:1746143769.183148:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626620032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.183155:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143769.183160:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e59880/2, rc 0, transno 21474840183 00000100:00100000:1.0:1746143769.183163:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626619392:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143769.183169:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e2a00/2, rc 0, transno 21474840185 00000004:00080000:0.0:1746143769.183169:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4f480/2, rc 0, transno 17179872869 00000100:00100000:1.0:1746143769.183171:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626619904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.183172:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626619264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.183176:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746143769.183180:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626619776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.183192:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143769.183194:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.183197:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626621056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.183201:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626620288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.183217:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.183227:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.183233:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626620800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.183245:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143769.183255:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136aca300/2, rc 0, transno 17179872871 00000100:00100000:0.0:1746143769.183257:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626619648:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746143769.183262:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb0 expref: 263 pid: 7243 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746143769.183263:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e2680/2, rc 0, transno 21474840187 00000100:00100000:0.0:1746143769.183265:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626620160:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746143769.183272:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.183275:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746143769.183279:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6e3e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb7 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.183279:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11058 00000100:00100000:0.0:1746143769.183284:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3771:x1830963626621056:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746143769.183288:0:7243:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6e3e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb7 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.183295:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6e3e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb7 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.183301:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a6e45 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bbe expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.183308:0:7243:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a6e45 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bbe expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.183318:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a6e45 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bbe expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.183340:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3771:x1830963626621056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (123us total) trans 21474840189 rc 0/0 00010000:00010000:1.0:1746143769.183341:0:7243:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a6e45 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bbe expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.183345:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11058 00000100:00100000:1.0:1746143769.183350:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626621184:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143769.183355:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11060 00000100:00100000:0.0:1746143769.183359:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3773:x1830963626620800:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746143769.183400:0:7243:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6e3e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb7 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.183407:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626621312:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143769.183407:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963626620800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (161us total) trans 17179872874 rc 0/0 00000100:00100000:0.0:1746143769.183413:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11060 00000100:00100000:1.0:1746143769.183422:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000004:00080000:0.0:1746143769.183433:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac8700/2, rc 0, transno 17179872872 00000100:00100000:0.0:1746143769.183437:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626619776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143769.183443:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136acb800/2, rc 0, transno 17179872873 00000100:00100000:0.0:1746143769.183445:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626620288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143769.183450:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129dc0380/2, rc 0, transno 17179872874 00000100:00100000:0.0:1746143769.183453:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626620800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143769.183460:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e3800/2, rc 0, transno 21474840188 00000100:00100000:0.0:1746143769.183462:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626620672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.183474:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11061 00000100:00100000:1.0:1746143769.183477:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626620928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 389us (499us total) trans 21474840190 rc 0/0 00000100:00100000:0.0:1746143769.183479:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3774:x1830963626619136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.183482:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11053 00000004:00080000:1.0:1746143769.183499:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e32d80/2, rc 0, transno 21474840189 00000100:00100000:1.0:1746143769.183502:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626621056:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143769.183508:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e3b80/2, rc 0, transno 21474840186 00000100:00100000:1.0:1746143769.183510:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626620416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143769.183515:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e0e00/2, rc 0, transno 21474840190 00000100:00100000:1.0:1746143769.183518:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626620928:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143769.183518:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143769.183520:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.183522:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143766 -> 1746143766 00002000:00010000:0.0:1746143769.183523:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.183525:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:0.0:1746143769.183544:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3774:x1830963626619136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (113us total) trans 21474840191 rc 0/0 00000100:00100000:0.0:1746143769.183549:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11061 00000100:00100000:0.0:1746143769.185369:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.185404:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.185454:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.185737:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622172160 00000100:00100000:1.0:1746143769.185741:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622172160 00000100:00100000:1.0:1746143769.185766:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12684 00000100:00100000:1.0:1746143769.185772:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31717:x1830963622172160:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.185783:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.185799:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73a6e4c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409bc5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.185837:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73a6e4c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bc5 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.185850:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73a6e4c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bc5 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.185866:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.185868:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143769.185871:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523200, rc 0) 00000100:00100000:1.0:1746143769.185905:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31717:x1830963622172160:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 133us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.186129:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12684 00000100:00100000:1.0:1746143769.186166:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626621184:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143769.186174:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626621312:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143769.186199:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73a6e30 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb0 expref: 263 pid: 7243 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746143769.186215:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb0 expref: 262 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.186228:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523000, rc 0) 00000100:00100000:1.0:1746143769.186263:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:31716:x1830963622169984:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 33623us (33873us total) trans 8589943360 rc 0/0 00000100:00100000:1.0:1746143769.186272:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12681 00000100:00100000:0.0:1746143769.187517:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.187550:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.187580:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.187605:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622172416 00000100:00100000:0.0:1746143769.187611:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622172416 00000100:00100000:1.0:1746143769.187629:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622172544 00000100:00100000:1.0:1746143769.187633:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622172544 00000100:00100000:0.0:1746143769.187657:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 700 00000100:00100000:0.0:1746143769.187663:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622172416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143769.187668:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11063 00000100:00100000:1.0:1746143769.187674:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622172544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143769.187674:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.187681:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.187689:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73a6e4c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bc5 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.187691:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e523400/0x87925e4cb73a6e5a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409bd3 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.187707:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.187708:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.187709:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.187714:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143769.187716:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523400/0x87925e4cb73a6e5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bd3 expref: 30 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.187729:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e523400/0x87925e4cb73a6e5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bd3 expref: 30 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.187736:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523400, rc 0) 00000100:00100000:0.0:1746143769.187737:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622172416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 74us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.187743:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 700 00000100:00100000:1.0:1746143769.187756:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622172544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.187761:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11063 00000100:00100000:0.0:1746143769.187779:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.188218:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.188376:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.188397:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.188410:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.188450:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622172800 00000100:00100000:1.0:1746143769.188453:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622172800 00000100:00100000:1.0:1746143769.188594:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622172928 00000100:00100000:1.0:1746143769.188596:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622172928 00000100:00100000:0.0:1746143769.188978:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11068 00000100:00100000:0.0:1746143769.188983:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622173184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143769.188989:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.188995:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73a6e7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409bf6 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.189017:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.189019:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.189023:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73a6e7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bf6 expref: 32 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.189031:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73a6e7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bf6 expref: 32 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.189036:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53400, rc 0) 00000100:00100000:0.0:1746143769.189048:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963622173184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 66us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.189052:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11068 00000100:00100000:0.0:1746143769.191037:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.191089:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.191104:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622173312 00000100:00100000:0.0:1746143769.191108:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622173312 00010000:00010000:0.0:1746143769.191121:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73a6e68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409be1 expref: 29 pid: 13436 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746143769.191266:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.191402:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5114 00000100:00100000:1.0:1746143769.191408:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5115 00000100:00100000:0.0:1746143769.191410:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622173440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143769.191421:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622173312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143769.191422:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.191429:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.191442:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a6d2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b40 expref: 10 pid: 3134 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.191443:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73a6e68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409be1 expref: 29 pid: 13436 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143769.191452:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a6d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b40 expref: 10 pid: 3134 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.191461:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73a6e68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409be1 expref: 29 pid: 13436 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143769.191479:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a6d2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b40 expref: 10 pid: 3134 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.191484:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73a6e68 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409be1 expref: 29 pid: 13436 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143769.191491:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143769.191494:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143769.191509:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622173440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 101us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.191511:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622173312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 92us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.191515:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5114 00000100:00100000:1.0:1746143769.191518:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5115 00000100:00100000:0.0:1746143769.192559:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.193892:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.194594:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.194644:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.194680:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.194964:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5119 00000100:00100000:0.0:1746143769.194972:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622174080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143769.194980:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.194989:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73a6d3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b4e expref: 11 pid: 9586 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143769.195009:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73a6d3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b4e expref: 11 pid: 9586 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143769.195022:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73a6d3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b4e expref: 11 pid: 9586 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143769.195033:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.195035:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.195041:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73a6e84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bfd expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.195049:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73a6e84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bfd expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.195075:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73a6e84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bfd expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.195086:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b38000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626622336:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143769.195348:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.196316:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.196337:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.196375:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622174592 00000100:00100000:1.0:1746143769.196379:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622174592 00002000:00100000:1.0:1746143769.196399:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092b38700 x1830963622174592/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.196406:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b38700 with x1830963622174592 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.196409:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b38700 00000100:00100000:1.0:1746143769.196426:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622174848 00000100:00100000:1.0:1746143769.196429:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622174848 00002000:00100000:1.0:1746143769.196439:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092b3a680 x1830963622174848/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.196445:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3a680 with x1830963622174848 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.196449:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b3a680 00000100:00100000:1.0:1746143769.196460:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2980 00000100:00100000:1.0:1746143769.196465:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622174848:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143769.197479:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b38000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626622336:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143769.197501:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143769.197523:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622174080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2552us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.197531:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5119 00000100:00100000:1.0:1746143769.198095:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2982 00000100:00100000:1.0:1746143769.198103:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622175360:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143769.198167:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622175360:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 65us (575us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143769.198178:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2982 00002000:00100000:1.0:1746143769.198183:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3096576->3100671) req@ffff88012b7e3480 x1830963622175360/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.198190:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e3480 with x1830963622175360 ext(3096576->3100671) 00002000:00010000:1.0:1746143769.198193:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e3480 00000100:00100000:1.0:1746143769.198234:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.198245:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622175872 00000100:00100000:1.0:1746143769.198247:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622175872 00002000:00100000:1.0:1746143769.198261:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092145500 x1830963622175872/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.198268:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145500 with x1830963622175872 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.198271:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092145500 00000100:00100000:1.0:1746143769.198282:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2984 00000100:00100000:1.0:1746143769.198286:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622175872:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143769.204459:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622174848:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7979us (8106us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.204478:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2980 00002000:00100000:1.0:1746143769.204491:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092b3a680 x1830963622174848/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.204502:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3a680 with x1830963622174848 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.204510:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b3a680 00000100:00100000:0.0:1746143769.210318:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.213958:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.214032:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.214055:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.216390:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.216510:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622176640 00000100:00100000:1.0:1746143769.216517:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622176640 00010000:00010000:1.0:1746143769.216544:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a6d34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b47 expref: 9 pid: 3134 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746143769.216577:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5120 00000100:00100000:1.0:1746143769.216584:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622176640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.216596:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.216613:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a6d34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b47 expref: 9 pid: 3134 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.216622:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a6d34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b47 expref: 9 pid: 3134 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.216866:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a6d34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b47 expref: 9 pid: 3134 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.217121:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.217588:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622176640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1002us (3553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.217598:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5120 00000100:00100000:1.0:1746143769.219839:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622175872:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21552us (21603us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.219845:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2984 00002000:00100000:1.0:1746143769.219850:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092145500 x1830963622175872/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.219856:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145500 with x1830963622175872 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.219859:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092145500 00000100:00100000:0.0:1746143769.223721:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.224298:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.226063:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.226599:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622177536 00000100:00100000:1.0:1746143769.226608:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622177536 00002000:00100000:1.0:1746143769.226642:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3559424->3563519) req@ffff880092b3ce00 x1830963622177536/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.226651:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3ce00 with x1830963622177536 ext(3559424->3563519) 00002000:00010000:1.0:1746143769.226656:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b3ce00 00000100:00100000:1.0:1746143769.226877:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2986 00000100:00100000:1.0:1746143769.226885:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622177536:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143769.227044:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622177536:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 160us (987us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143769.227050:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2986 00002000:00100000:1.0:1746143769.227055:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3559424->3563519) req@ffff880092b3ce00 x1830963622177536/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.227061:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3ce00 with x1830963622177536 ext(3559424->3563519) 00002000:00010000:1.0:1746143769.227064:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b3ce00 00000100:00100000:1.0:1746143769.230368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.230631:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.233352:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.240166:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.242362:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.254515:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.254585:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.263080:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.263122:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.263295:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.264468:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2990 00000100:00100000:0.0:1746143769.264479:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622179456:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143769.270136:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626623616:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143769.270267:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33800/0x87925e4cb73a6eae lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c27 expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.270286:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33800, rc 0) 00000100:00100000:0.0:1746143769.270347:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+30:31722:x1830963622178944:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5325us (7274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.270356:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11075 00000100:00100000:0.0:1746143769.284667:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622179456:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20177us (21358us total) trans 0 rc 2048000/2048000 00000100:00100000:0.0:1746143769.285165:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2990 00002000:00100000:0.0:1746143769.285180:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880092b48000 x1830963622179456/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 504/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 2048000/2048000 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143769.285190:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48000 with x1830963622179456 ext(2097152->4194303) 00002000:00010000:0.0:1746143769.285197:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48000 00000100:00100000:0.0:1746143769.291794:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.291863:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.295883:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.299955:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.308992:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.313625:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.314823:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.320659:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.323748:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.331799:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.333833:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.333873:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.346642:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.346757:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622182144 00000100:00100000:1.0:1746143769.346766:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622182144 00000100:00100000:1.0:1746143769.346802:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12685 00000100:00100000:1.0:1746143769.346808:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+263:31727:x1830963622182144:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.346827:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.346842:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a6eca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409c43 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.346930:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.346941:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.346951:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.346962:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6ed8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.346967:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.346973:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347069:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6400/0x87925e4cb73a6edf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347077:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6400/0x87925e4cb73a6edf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347082:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6400/0x87925e4cb73a6edf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143769.347090:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143769.347147:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347152:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347157:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347161:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347168:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913b6000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.347171:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347176:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347185:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143769.347188:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.347191:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347195:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347209:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347214:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347222:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347225:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913b7200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.347227:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347231:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347235:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880082e65500) 00010000:00010000:1.0:1746143769.347237:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.347238:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6ed8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347242:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6ed8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.347273:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a6eca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c43 expref: 266 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.347282:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6400/0x87925e4cb73a6edf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c43 expref: 265 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.347287:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.347289:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143769.347291:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6400, rc 0) 00000100:00100000:1.0:1746143769.347321:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+265:31727:x1830963622182144:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 513us (682us total) trans 8589943364 rc 0/0 00000100:00100000:1.0:1746143769.347327:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12685 00000100:00100000:1.0:1746143769.360661:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622182528 00000100:00100000:1.0:1746143769.360672:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622182528 00000100:00100000:1.0:1746143769.360721:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12686 00000100:00100000:1.0:1746143769.360728:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31730:x1830963622182528:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.360762:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.360781:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6eed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409c4a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.360863:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.360876:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.360886:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.360898:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6c00/0x87925e4cb73a6efb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.360903:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6c00/0x87925e4cb73a6efb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.360907:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6c00/0x87925e4cb73a6efb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361038:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7800/0x87925e4cb73a6f02 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361046:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7800/0x87925e4cb73a6f02 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361052:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7800/0x87925e4cb73a6f02 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143769.361064:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143769.361141:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361147:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361153:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361158:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361163:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913b6000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.361167:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361172:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361182:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143769.361184:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.361188:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361193:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6000/0x87925e4cb73a6ef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361207:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6c00/0x87925e4cb73a6efb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361212:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6c00/0x87925e4cb73a6efb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361220:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6c00/0x87925e4cb73a6efb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361224:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913b6c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.361226:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6c00/0x87925e4cb73a6efb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361230:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6c00/0x87925e4cb73a6efb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361234:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880082e65500) 00010000:00010000:1.0:1746143769.361237:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.361238:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6c00/0x87925e4cb73a6efb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361243:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6c00/0x87925e4cb73a6efb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.361278:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7200/0x87925e4cb73a6eed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c4a expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.361288:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7800/0x87925e4cb73a6f02 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c4a expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.361293:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.361295:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143769.361297:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7800, rc 0) 00000100:00100000:1.0:1746143769.361345:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31730:x1830963622182528:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 617us (877us total) trans 8589943365 rc 0/0 00000100:00100000:1.0:1746143769.361353:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12686 00000100:00100000:0.0:1746143769.383688:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.431060:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.433489:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.436906:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.436960:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.436982:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.436989:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622183296 00000100:00100000:1.0:1746143769.437010:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622183296 00010000:00010000:1.0:1746143769.437049:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73a6df1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b71 expref: 18 pid: 13430 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746143769.437372:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622183424 00000100:00100000:1.0:1746143769.437375:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622183424 00010000:00010000:1.0:1746143769.437715:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523400/0x87925e4cb73a6e5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bd3 expref: 33 pid: 9587 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746143769.437738:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5128 00000100:00100000:1.0:1746143769.437743:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622183424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.437750:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.437757:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e523400/0x87925e4cb73a6e5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bd3 expref: 33 pid: 9587 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.437765:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e523400/0x87925e4cb73a6e5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bd3 expref: 33 pid: 9587 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.437778:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e523400/0x87925e4cb73a6e5a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bd3 expref: 33 pid: 9587 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.437792:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.437794:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.437801:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e512800/0x87925e4cb73a6f2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1908735) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c58 expref: 32 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.437814:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512800/0x87925e4cb73a6f2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1908735) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c58 expref: 32 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.437843:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e512800/0x87925e4cb73a6f2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c58 expref: 32 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.437855:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626624640:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143769.437904:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.438420:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.438667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.438688:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.438703:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622183680 00000100:00100000:0.0:1746143769.438706:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622183680 00000100:00100000:0.0:1746143769.438724:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622183936 00000100:00100000:0.0:1746143769.438726:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622183936 00000100:00100000:0.0:1746143769.438743:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622183808 00000100:00100000:0.0:1746143769.438745:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622183808 00000100:00100000:0.0:1746143769.438756:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11080 00000100:00100000:0.0:1746143769.438760:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622183680:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143769.438773:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.438783:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a6f33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409c5f expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.438810:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626624768:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143769.439187:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11082 00000100:00100000:1.0:1746143769.439194:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622183808:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143769.439200:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.439206:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097106600/0x87925e4cb73a6f41 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409c66 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.439215:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.439216:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.439221:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106600/0x87925e4cb73a6f41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c66 expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.439230:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097106600/0x87925e4cb73a6f41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c66 expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.439235:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106600, rc 0) 00000100:00100000:0.0:1746143769.439309:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.439725:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622183808:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 532us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.439734:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11082 00000100:00100000:1.0:1746143769.439952:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622184064 00000100:00100000:1.0:1746143769.439957:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622184064 00000100:00100000:1.0:1746143769.439982:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11083 00000100:00100000:1.0:1746143769.439987:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622184064:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143769.440001:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.440010:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x87925e4cb73a6f48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409c74 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.440020:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.440021:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.440025:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x87925e4cb73a6f48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c74 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.440034:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x87925e4cb73a6f48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c74 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.440040:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107a00, rc 0) 00000100:00100000:1.0:1746143769.440070:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622184064:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 82us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.440075:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11083 00000100:00100000:0.0:1746143769.445059:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.445152:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626624640:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143769.445167:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.445201:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622183424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7457us (8240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.445212:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5128 00000100:00100000:0.0:1746143769.447265:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.453595:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626624896:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143769.453607:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b38000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626625024:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143769.453614:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963626625152:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143769.454022:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5130 00000100:00100000:1.0:1746143769.454031:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622184832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.454039:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.454044:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a6f25 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c51 expref: 9 pid: 7243 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143769.454729:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2200/0x87925e4cb73a6f56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746143769.454804:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143769.455526:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a6f25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c51 expref: 9 pid: 7243 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.456064:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a6f25 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c51 expref: 9 pid: 7243 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.456276:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.456280:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2200/0x87925e4cb73a6f56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.456286:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2200/0x87925e4cb73a6f56 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.456292:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2200/0x87925e4cb73a6f56 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143769.456315:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.456332:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622184832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2303us (3100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.456337:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5130 00000100:00100000:0.0:1746143769.464325:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622185472 00000100:00100000:0.0:1746143769.464343:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622185472 00000100:00100000:0.0:1746143769.464402:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622185728 00000100:00100000:0.0:1746143769.464407:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622185728 00000100:00100000:0.0:1746143769.464438:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12689 00000100:00100000:0.0:1746143769.464451:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31732:x1830963622185472:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143769.464483:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.464487:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143769.464521:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2200/0x87925e4cb73a6f56 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c7b expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.464549:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143769.464555:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143769.464583:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73a6f64 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409c82 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.464688:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a6f79 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.464699:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a6f79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.464707:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a6f79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.464721:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a6f79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.464727:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a6f79 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.464733:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a6f79 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.464739:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d848600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143769.464743:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a6f79 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.464749:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a6f79 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.464757:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143769.464760:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143769.464762:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a6f79 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.464767:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a6f79 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143769.464791:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73a6f64 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c82 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.464797:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73a6f64 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c82 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.464805:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849400, rc 0) 00000100:00100000:0.0:1746143769.464879:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31732:x1830963622185472:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 429us (4044us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143769.464887:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12689 00000100:00100000:0.0:1746143769.465588:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622185984 00000100:00100000:0.0:1746143769.465594:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622185984 00000100:00100000:0.0:1746143769.465619:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4588 00000100:00100000:0.0:1746143769.465625:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013735a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:31727:x1830963622185984:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143769.465729:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013735a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:31727:x1830963622185984:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 104us (435us total) trans 8589943369 rc 0/0 00000100:00100000:0.0:1746143769.465735:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4588 00000100:00100000:0.0:1746143769.470032:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.471350:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622186368 00000100:00100000:0.0:1746143769.471354:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622186368 00000100:00100000:0.0:1746143769.471383:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11084 00000100:00100000:0.0:1746143769.471389:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622186368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143769.471402:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.471417:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73a6f95 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409c90 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.471467:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626625280:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143769.473021:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.485564:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.502720:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.503612:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.504845:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622186880 00000100:00100000:0.0:1746143769.504852:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622186880 00000100:00100000:0.0:1746143769.504893:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11086 00000100:00100000:0.0:1746143769.504900:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31730:x1830963622186880:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143769.504926:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.504941:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73a6fa3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409c9e expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.504965:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a6d26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b39 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.504973:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6e61 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bda expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.504980:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0200/0x87925e4cb73a6dce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b78 expref: 20 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.504986:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.504987:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.504990:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73a6fa3 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c9e expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.505023:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c0200/0x87925e4cb73a6dce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b78 expref: 20 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.505032:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0200/0x87925e4cb73a6dce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b78 expref: 20 pid: 13436 timeout: 928 lvb_type: 1 00000100:00100000:0.0:1746143769.505041:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626625536:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143769.505117:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6e61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bda expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.505130:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6e61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bda expref: 31 pid: 9585 timeout: 928 lvb_type: 1 00000100:00100000:0.0:1746143769.505142:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626625664:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143769.505165:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a6d26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b39 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.505173:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a6d26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b39 expref: 9 pid: 3134 timeout: 928 lvb_type: 1 00000100:00100000:0.0:1746143769.505180:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626625792:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143769.505194:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.512071:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.512108:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.512137:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.512169:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.512240:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622187136 00000100:00100000:1.0:1746143769.512251:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622187136 00010000:00010000:1.0:1746143769.512289:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a6d26 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b39 expref: 10 pid: 3134 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746143769.512314:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622187264 00000100:00100000:1.0:1746143769.512316:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622187264 00010000:00010000:1.0:1746143769.512325:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6e61 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bda expref: 32 pid: 9585 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746143769.512336:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622187392 00000100:00100000:1.0:1746143769.512338:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622187392 00010000:00010000:1.0:1746143769.512346:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0200/0x87925e4cb73a6dce lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b78 expref: 20 pid: 13436 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746143769.512359:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5132 00000100:00100000:1.0:1746143769.512366:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622187136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.512381:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.512401:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a6d26 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b39 expref: 10 pid: 3134 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.512412:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a6d26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b39 expref: 10 pid: 3134 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.512440:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.512483:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622187136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 117us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.512489:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5132 00000100:00100000:1.0:1746143769.512503:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5133 00000100:00100000:1.0:1746143769.512507:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622187264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.512516:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.512522:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6e61 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bda expref: 32 pid: 9585 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.512529:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a6e61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bda expref: 32 pid: 9585 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.512540:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.512552:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622187264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.512558:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5133 00000100:00100000:1.0:1746143769.512601:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5134 00000100:00100000:1.0:1746143769.512606:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622187392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.512612:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.512617:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c0200/0x87925e4cb73a6dce lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b78 expref: 20 pid: 13436 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.512625:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c0200/0x87925e4cb73a6dce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b78 expref: 20 pid: 13436 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746143769.512636:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.512638:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.512645:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73a6fa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c9e expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.512653:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73a6fa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c9e expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.512687:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73a6fa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c9e expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.512700:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626625920:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143769.513488:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.517512:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.521074:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.521135:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.528287:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.530003:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.530070:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.530122:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622188160 00000100:00100000:1.0:1746143769.530126:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622188160 00000100:00100000:0.0:1746143769.530128:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143769.530143:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a6e99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c12 expref: 30 pid: 3135 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746143769.530163:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5138 00000100:00100000:1.0:1746143769.530168:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622188160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.530175:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.530185:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a6e99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c12 expref: 30 pid: 3135 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.530269:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a6e99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c12 expref: 30 pid: 3135 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.530295:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a6e99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c12 expref: 30 pid: 3135 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.530333:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.530362:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622188160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 193us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.530372:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5138 00000100:00100000:0.0:1746143769.530528:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.544891:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.545890:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.557944:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.558849:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.559174:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622190080 00000100:00100000:1.0:1746143769.559179:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622190080 00002000:00100000:1.0:1746143769.559202:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800972e8a80 x1830963622190080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.559210:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8a80 with x1830963622190080 ext(2097152->4194303) 00002000:00010000:1.0:1746143769.559214:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e8a80 00000100:00100000:1.0:1746143769.559238:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3006 00000100:00100000:1.0:1746143769.559244:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963622190080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143769.588534:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.602902:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.604065:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622190592 00000100:00100000:1.0:1746143769.604074:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622190592 00000100:00100000:1.0:1746143769.604121:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12691 00000100:00100000:1.0:1746143769.604127:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+266:31742:x1830963622190592:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143769.604146:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.604160:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a6fb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409cac expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.604217:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604226:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604235:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604245:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a6fbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604250:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a6fbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604255:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a6fbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604322:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73a6fc6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604328:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73a6fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604333:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73a6fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143769.604339:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143769.604388:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604392:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604397:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604401:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604405:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55da00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.604408:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604412:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604423:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143769.604425:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.604428:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604432:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a6fb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604455:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a6fbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604459:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a6fbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604462:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a6fbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604466:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55cc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.604467:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a6fbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604471:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a6fbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604476:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880082e65600) 00010000:00010000:1.0:1746143769.604477:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.604479:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a6fbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604482:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a6fbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.604509:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a6fb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cac expref: 269 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.604519:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73a6fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cac expref: 268 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.604523:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.604525:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143769.604527:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d800, rc 0) 00000100:00100000:1.0:1746143769.604559:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+268:31742:x1830963622190592:12345-192.168.202.3@tcp:101:cat.0 Request processed in 432us (1664us total) trans 8589943373 rc 0/0 00000100:00100000:1.0:1746143769.604564:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12691 00000100:00100000:0.0:1746143769.607586:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.607622:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.608461:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.608812:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11090 00000100:00100000:1.0:1746143769.608821:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622190976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143769.608829:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.608838:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a6fe2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409cc1 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.608861:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626626816:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143769.609035:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f3c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143769.611636:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime: 1746143764 -> 1746143770 00000100:00100000:1.0:1746143769.611648:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626626816:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143769.611665:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a6fe2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cc1 expref: 30 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.611677:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a6fe2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cc1 expref: 30 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.611692:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c000, rc 0) 00000100:00100000:1.0:1746143769.611736:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622190976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2916us (3275us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143769.611741:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11090 00000100:00100000:0.0:1746143769.619478:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.632707:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.632814:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622191360 00000100:00100000:1.0:1746143769.632826:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622191360 00000100:00100000:1.0:1746143769.633532:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11091 00000100:00100000:1.0:1746143769.633543:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:31742:x1830963622191360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143769.633562:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.633579:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a6fe9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409cc8 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.633610:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73a6fa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c9e expref: 17 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.633617:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143769.633619:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143769.633622:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a6fe9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cc8 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.633650:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73a6fa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c9e expref: 17 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.633660:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73a6fa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c9e expref: 17 pid: 3135 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746143769.633677:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626626944:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143769.633766:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.636977:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.637085:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626626944:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143769.637116:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a6fe9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cc8 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.637139:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d400, rc 0) 00000100:00100000:1.0:1746143769.637196:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:31742:x1830963622191360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3653us (4498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.637203:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11091 00000100:00100000:0.0:1746143769.646747:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.654279:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.664429:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.664498:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622192000 00000100:00100000:1.0:1746143769.664509:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622192000 00000100:00100000:1.0:1746143769.664889:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11092 00000100:00100000:1.0:1746143769.664899:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:31742:x1830963622192000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143769.664950:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.664974:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ee77000/0x87925e4cb73a6ff0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409ccf expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.665018:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e512200/0x87925e4cb73a6faa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ca5 expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.665026:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143769.665028:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143769.665032:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee77000/0x87925e4cb73a6ff0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ccf expref: 30 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.665069:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e512200/0x87925e4cb73a6faa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ca5 expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.665081:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e512200/0x87925e4cb73a6faa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ca5 expref: 15 pid: 3135 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746143769.665094:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626627200:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143769.665674:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.669060:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.669243:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626627200:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143769.669274:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ee77000/0x87925e4cb73a6ff0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ccf expref: 30 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.669294:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee77000, rc 0) 00000100:00100000:1.0:1746143769.669349:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:31742:x1830963622192000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4451us (4931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.669359:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11092 00000100:00100000:0.0:1746143769.677381:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622192128:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7930us (8323us total) trans 21474840194 rc 0/0 00000100:00100000:0.0:1746143769.677393:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1308 00002000:00100000:0.0:1746143769.677403:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1757183) req@ffff880096fda680 x1830963622192128/t21474840194(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143769.677411:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fda680 with x1830963622192128 ext(1048576->1757183) 00010000:00010000:0.0:1746143769.677420:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e512200/0x87925e4cb73a6faa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ca5 expref: 18 pid: 3135 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143769.677434:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e512200/0x87925e4cb73a6faa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ca5 expref: 18 pid: 3135 timeout: 928 lvb_type: 0 00002000:00010000:0.0:1746143769.677444:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fda680 00000100:00100000:0.0:1746143769.688453:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.692186:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.692843:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.692895:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622192768 00000100:00100000:1.0:1746143769.692898:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622192768 00002000:00100000:1.0:1746143769.692941:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880096fdad80 x1830963622192768/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.692951:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fdad80 with x1830963622192768 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.692956:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fdad80 00000100:00100000:1.0:1746143769.692968:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3009 00000100:00100000:1.0:1746143769.692973:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622192768:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143769.700235:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.700269:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.700959:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5141 00000100:00100000:1.0:1746143769.700971:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622192896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.700984:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.700999:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73a6f87 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c89 expref: 15 pid: 14991 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.701020:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73a6f87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c89 expref: 15 pid: 14991 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.701096:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73a6f87 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c89 expref: 15 pid: 14991 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746143769.701174:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.701178:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a6ffe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143769.701185:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a6ffe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143769.701192:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a6ffe lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143769.701365:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.701387:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622192896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 419us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.701393:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5141 00000100:00100000:1.0:1746143769.701472:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622192768:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8498us (8630us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.701480:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3009 00002000:00100000:1.0:1746143769.701490:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880096fdad80 x1830963622192768/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.701499:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fdad80 with x1830963622192768 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.701503:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fdad80 00000100:00100000:0.0:1746143769.717892:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.721085:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.722829:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.723283:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.723519:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622193664 00000100:00100000:1.0:1746143769.723527:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622193664 00000100:00100000:1.0:1746143769.723570:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622193792 00000100:00100000:1.0:1746143769.723573:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622193792 00000100:00100000:1.0:1746143769.723590:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11093 00000100:00100000:1.0:1746143769.723596:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963622193664:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143769.723610:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.723628:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73a702f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409ce4 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.723651:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.723653:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.723663:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73a702f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ce4 expref: 20 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.723680:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73a702f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ce4 expref: 20 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.723692:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee76e00, rc 0) 00000100:00100000:1.0:1746143769.723726:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2010:x1830963622193664:12345-192.168.202.3@tcp:101:cat.0 Request processed in 130us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.723732:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11093 00000100:00100000:1.0:1746143769.723745:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11094 00000100:00100000:1.0:1746143769.723751:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2010:x1830963622193792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143769.723758:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.723767:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a7036 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409ceb expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.723778:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.723779:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.723783:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a7036 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ceb expref: 18 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.723794:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a7036 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ceb expref: 18 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.723801:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee76600, rc 0) 00000100:00100000:1.0:1746143769.723817:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622193792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 66us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.723822:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11094 00000100:00100000:0.0:1746143769.728705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.728753:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.728895:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.728951:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.729025:0:8215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622193920 00000100:00100000:1.0:1746143769.729031:0:8215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622193920 00000100:00100000:0.0:1746143769.729107:0:8213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 186 00000100:00100000:0.0:1746143769.729113:0:8213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2011:x1830963622193920:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143769.729173:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1072 00000100:00100000:1.0:1746143769.729178:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2011:x1830963622194304:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143769.729240:0:8213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2011:x1830963622193920:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 127us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.729246:0:8213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 186 00000100:00100000:1.0:1746143769.729376:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2011:x1830963622194304:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 197us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.729381:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1072 00000100:00100000:0.0:1746143769.736035:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.736103:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622194560 00000100:00100000:1.0:1746143769.736113:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622194560 00002000:00100000:1.0:1746143769.736164:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880090e27100 x1830963622194560/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.736175:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e27100 with x1830963622194560 ext(1048576->2097151) 00000100:00100000:0.0:1746143769.736176:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:1.0:1746143769.736180:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e27100 00000100:00100000:1.0:1746143769.736502:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622194816 00000100:00100000:1.0:1746143769.736506:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622194816 00002000:00100000:1.0:1746143769.736522:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880090e25880 x1830963622194816/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.736529:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25880 with x1830963622194816 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.736533:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e25880 00000100:00100000:1.0:1746143769.736554:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3011 00000100:00100000:1.0:1746143769.736559:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963622194816:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143769.744178:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963622194816:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7609us (7993us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.744189:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3011 00002000:00100000:1.0:1746143769.744199:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880090e25880 x1830963622194816/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.744207:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25880 with x1830963622194816 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.744212:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e25880 00000100:00100000:0.0:1746143769.760781:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.773678:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.774360:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622195328 00000100:00100000:1.0:1746143769.774370:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622195328 00000100:00100000:1.0:1746143769.774434:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12694 00000100:00100000:1.0:1746143769.774443:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:31751:x1830963622195328:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.774473:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.774494:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a703d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409cf2 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.774576:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774590:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774600:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774613:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a704b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774618:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a704b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774623:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a704b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774726:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a7052 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774735:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a7052 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774741:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a7052 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143769.774749:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143769.774824:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774830:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774838:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774843:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774848:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.774851:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774857:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774868:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143769.774871:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.774876:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.774880:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7044 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.775150:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a704b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.775156:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a704b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.775161:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a704b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.775165:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.775167:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a704b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.775175:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a704b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.775181:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880082e65000) 00010000:00010000:1.0:1746143769.775183:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.775185:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a704b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.775189:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a704b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.775227:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a703d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf2 expref: 20 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.775238:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a7052 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf2 expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.775244:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.775246:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143769.775248:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d000, rc 0) 00000100:00100000:1.0:1746143769.775536:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31751:x1830963622195328:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1092us (1995us total) trans 8589943378 rc 0/0 00000100:00100000:1.0:1746143769.775543:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12694 00000100:00100000:0.0:1746143769.779064:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.779145:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622195456 00000100:00100000:1.0:1746143769.779154:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622195456 00000100:00100000:1.0:1746143769.779213:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 701 00000100:00100000:1.0:1746143769.779220:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622195456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.779236:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.779262:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a7052 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf2 expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.779276:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.779280:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.779326:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963622195456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.779331:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 701 00000100:00100000:0.0:1746143769.793832:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.799770:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.799801:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.800817:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622195712 00000100:00100000:0.0:1746143769.800822:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622195712 00010000:00010000:0.0:1746143769.800840:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x87925e4cb73a6f48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c74 expref: 9 pid: 9587 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746143769.803510:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5143 00000100:00100000:1.0:1746143769.803525:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.803527:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622195712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143769.803552:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.803580:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x87925e4cb73a6f48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c74 expref: 9 pid: 9587 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143769.803597:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x87925e4cb73a6f48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c74 expref: 9 pid: 9587 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143769.803623:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x87925e4cb73a6f48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c74 expref: 9 pid: 9587 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143769.803651:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143769.803691:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622195712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 170us (3930us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.803697:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5143 00000100:00100000:0.0:1746143769.803799:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622195968 00000100:00100000:0.0:1746143769.803805:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622195968 00010000:00010000:0.0:1746143769.803820:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512a00/0x87925e4cb73a6ec3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c3c expref: 20 pid: 12328 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746143769.803842:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5144 00000100:00100000:0.0:1746143769.803846:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622195968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143769.803853:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.803859:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e512a00/0x87925e4cb73a6ec3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c3c expref: 20 pid: 12328 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143769.803867:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e512a00/0x87925e4cb73a6ec3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c3c expref: 20 pid: 12328 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143769.803879:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e512a00/0x87925e4cb73a6ec3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c3c expref: 20 pid: 12328 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143769.803887:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143769.803901:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622195968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 54us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.803906:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5144 00000100:00100000:0.0:1746143769.806199:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.806230:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.806244:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.806278:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.806290:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622196480 00000100:00100000:1.0:1746143769.806293:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622196480 00000100:00100000:0.0:1746143769.806293:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622196352 00000100:00100000:0.0:1746143769.806295:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622196352 00010000:00010000:1.0:1746143769.806320:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73a6ebc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c35 expref: 35 pid: 12328 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143769.806320:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73a6d1f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409b2b expref: 9 pid: 3134 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746143769.806454:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622196224 00000100:00100000:1.0:1746143769.806457:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622196224 00010000:00010000:1.0:1746143769.806469:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a6e53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bcc expref: 30 pid: 13436 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746143769.806619:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5145 00000100:00100000:1.0:1746143769.806626:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622196480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143769.806629:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5147 00000100:00100000:0.0:1746143769.806635:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622196224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.806637:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.806643:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.806651:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73a6ebc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c35 expref: 35 pid: 12328 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143769.806652:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a6e53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bcc expref: 30 pid: 13436 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143769.806661:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73a6ebc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c35 expref: 35 pid: 12328 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143769.806682:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73a6ebc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c35 expref: 35 pid: 12328 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143769.806698:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.806700:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.806707:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.806714:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.806719:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a6e53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bcc expref: 30 pid: 13436 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143769.806737:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ba00/0x87925e4cb73a6e53 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bcc expref: 30 pid: 13436 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143769.806741:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.806748:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.806751:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626628480:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143769.806763:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622196224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 129us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.806768:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5147 00000100:00100000:1.0:1746143769.806973:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.809438:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626628480:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143769.809448:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.809473:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622196480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2848us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.809479:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5145 00000100:00100000:1.0:1746143769.809538:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.810597:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.813124:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.819629:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.819686:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.820229:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622197248 00000100:00100000:1.0:1746143769.820233:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622197248 00010000:00010000:1.0:1746143769.820257:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a6f3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c6d expref: 8 pid: 9585 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746143769.820278:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5149 00000100:00100000:1.0:1746143769.820282:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622197248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.820292:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.820306:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a6f3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c6d expref: 8 pid: 9585 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143769.820315:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a6f3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c6d expref: 8 pid: 9585 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143769.820336:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a6f3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c6d expref: 8 pid: 9585 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143769.820362:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.820384:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622197248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 101us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.820389:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5149 00000100:00100000:0.0:1746143769.820884:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.821699:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.822486:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.833134:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.948607:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.948682:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622198528 00000100:00100000:1.0:1746143769.948692:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622198528 00000100:00100000:1.0:1746143769.948756:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12695 00000100:00100000:1.0:1746143769.948765:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+270:31758:x1830963622198528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143769.948794:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.948821:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a7075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409d0e expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.948948:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.948965:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.948976:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949015:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7083 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949022:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949027:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949127:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a708a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949136:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a708a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949142:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a708a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143769.949151:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143769.949228:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949233:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949242:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949247:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949251:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55da00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.949254:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949261:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949271:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143769.949274:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.949278:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949282:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73a707c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949315:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949321:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7083 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949326:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7083 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949330:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.949333:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7083 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949341:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7083 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949348:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880082e65500) 00010000:00010000:1.0:1746143769.949350:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.949352:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7083 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949357:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a7083 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.949392:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a7075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d0e expref: 273 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.949403:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a708a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d0e expref: 272 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.949408:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.949410:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143769.949412:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d200, rc 0) 00000100:00100000:1.0:1746143769.949805:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+272:31758:x1830963622198528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 711us (879us total) trans 8589943380 rc 0/0 00000100:00100000:1.0:1746143769.949814:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12695 00000100:00100000:0.0:1746143769.951942:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.954005:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.954795:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622198912 00000100:00100000:1.0:1746143769.954803:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622198912 00000100:00100000:1.0:1746143769.954862:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12696 00000100:00100000:1.0:1746143769.954870:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31759:x1830963622198912:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.954891:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.954909:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a709f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409d1c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.955020:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955033:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955044:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955056:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092459200/0x87925e4cb73a70ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955061:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092459200/0x87925e4cb73a70ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955066:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092459200/0x87925e4cb73a70ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955168:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a70b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955177:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a70b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955183:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a70b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143769.955192:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143769.955266:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955272:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955277:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955283:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955288:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55d000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.955291:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955297:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955308:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143769.955310:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.955314:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955319:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73a70a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955330:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092459200/0x87925e4cb73a70ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955334:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092459200/0x87925e4cb73a70ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955338:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092459200/0x87925e4cb73a70ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.955342:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092459200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143769.955344:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092459200/0x87925e4cb73a70ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.956589:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092459200/0x87925e4cb73a70ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.956601:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880082e65c00) 00010000:00010000:1.0:1746143769.956603:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.956607:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092459200/0x87925e4cb73a70ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.956612:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092459200/0x87925e4cb73a70ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143769.956669:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a709f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d1c expref: 22 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.956682:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a70b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d1c expref: 21 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.956688:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143769.956690:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143769.956692:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad34000, rc 0) 00000100:00100000:1.0:1746143769.956763:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:31759:x1830963622198912:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1893us (2758us total) trans 8589943381 rc 0/0 00000100:00100000:1.0:1746143769.956772:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12696 00000100:00100000:0.0:1746143769.965326:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.967399:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.967590:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622199296 00000100:00100000:1.0:1746143769.967595:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622199296 00000100:00100000:1.0:1746143769.967626:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11100 00000100:00100000:1.0:1746143769.967632:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31759:x1830963622199296:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.967641:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.968804:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a70c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409d2a expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.968835:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a6fe9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cc8 expref: 33 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.968842:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73a702f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ce4 expref: 20 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.968848:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.968849:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.968852:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a70c9 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1880064->1978367] (req 1880064->1978367) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d2a expref: 20 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.968877:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73a702f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ce4 expref: 20 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.968887:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73a702f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ce4 expref: 20 pid: 9587 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746143769.968897:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626629504:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143769.969012:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a6fe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cc8 expref: 33 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.969020:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a6fe9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cc8 expref: 33 pid: 9587 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746143769.969028:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626629632:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143769.969048:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.969643:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.969765:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622199424 00000100:00100000:1.0:1746143769.969771:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622199424 00002000:00100000:1.0:1746143769.969815:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (663552->987135) req@ffff88012b1d9880 x1830963622199424/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.969825:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9880 with x1830963622199424 ext(663552->987135) 00010000:00010000:1.0:1746143769.969832:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a7067 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->987135) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d00 expref: 17 pid: 9585 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143769.969843:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a7067 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->987135) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d00 expref: 17 pid: 9585 timeout: 929 lvb_type: 0 00002000:00010000:1.0:1746143769.969849:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1d9880 00000100:00100000:1.0:1746143769.969881:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1309 00000100:00100000:1.0:1746143769.969889:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622199424:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143769.973543:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143769.973830:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626629504:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143769.973841:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626629632:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143769.973869:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a70c9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1880064->1978367] (req 1880064->1978367) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d2a expref: 20 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.973886:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74e00, rc 0) 00000100:00100000:1.0:1746143769.973950:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:31759:x1830963622199296:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6317us (6549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.973958:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11100 00000100:00100000:0.0:1746143769.980668:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.981161:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622199424:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 11273us (11520us total) trans 21474840195 rc 0/0 00000100:00100000:0.0:1746143769.981167:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1309 00002000:00100000:0.0:1746143769.981173:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (663552->987135) req@ffff88012b1d9880 x1830963622199424/t21474840195(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143769.981179:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9880 with x1830963622199424 ext(663552->987135) 00010000:00010000:0.0:1746143769.981186:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a7067 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->987135) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d00 expref: 19 pid: 9585 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143769.981201:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a7067 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 663552->987135) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d00 expref: 19 pid: 9585 timeout: 929 lvb_type: 0 00002000:00010000:0.0:1746143769.981207:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1d9880 00000100:00100000:0.0:1746143769.985121:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.989859:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143769.999487:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.000251:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622200576 00000100:00100000:1.0:1746143770.000263:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622200576 00000100:00100000:1.0:1746143770.000329:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12697 00000100:00100000:1.0:1746143770.000338:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:31762:x1830963622200576:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143770.000366:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.000385:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a70d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409d31 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.000464:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000478:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000489:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000502:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a70de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000507:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a70de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000518:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a70de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000616:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a70e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000627:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a70e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000632:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a70e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143770.000645:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143770.000719:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000725:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000730:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000736:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000743:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143770.000746:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000752:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000762:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143770.000765:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143770.000769:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000774:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a70d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000790:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a70de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000795:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a70de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000803:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a70de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000807:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143770.000810:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a70de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000815:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a70de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000820:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880082e65c00) 00010000:00010000:1.0:1746143770.000822:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143770.000824:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a70de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000829:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a70de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.000864:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a70d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d31 expref: 23 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.000876:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a70e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d31 expref: 22 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.000882:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143770.000884:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143770.000886:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74600, rc 0) 00000100:00100000:1.0:1746143770.000974:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:31762:x1830963622200576:12345-192.168.202.3@tcp:101:cat.0 Request processed in 637us (1510us total) trans 8589943382 rc 0/0 00000100:00100000:1.0:1746143770.000981:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12697 00000100:00100000:0.0:1746143770.002709:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622200832 00000100:00100000:0.0:1746143770.002717:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622200832 00002000:00100000:0.0:1746143770.002768:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800921cea00 x1830963622200832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.002787:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cea00 with x1830963622200832 ext(0->1048575) 00002000:00010000:0.0:1746143770.002793:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cea00 00000100:00100000:0.0:1746143770.002830:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3018 00000100:00100000:0.0:1746143770.002837:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622200832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143770.006153:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622201344 00000100:00100000:1.0:1746143770.006165:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622201344 00000100:00100000:1.0:1746143770.006205:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622201472 00000100:00100000:1.0:1746143770.006208:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622201472 00000100:00100000:1.0:1746143770.006237:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11102 00000100:00100000:1.0:1746143770.006245:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622201216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143770.006263:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.006278:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800973b8200/0x87925e4cb73a70fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409d38 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.006308:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.006310:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.006318:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8200/0x87925e4cb73a70fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d38 expref: 21 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.006333:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800973b8200/0x87925e4cb73a70fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d38 expref: 21 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.006343:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8200, rc 0) 00000100:00100000:1.0:1746143770.006386:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963622201216:12345-192.168.202.3@tcp:101:cat.0 Request processed in 142us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.006391:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11102 00000100:00100000:1.0:1746143770.006648:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.023977:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.025609:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.025833:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622202112 00000100:00100000:1.0:1746143770.025839:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622202112 00002000:00100000:1.0:1746143770.025863:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093417800 x1830963622202112/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 504/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.025871:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417800 with x1830963622202112 ext(1048576->2097151) 00002000:00010000:1.0:1746143770.025876:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093417800 00000100:00100000:1.0:1746143770.025903:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3020 00000100:00100000:1.0:1746143770.025925:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963622202112:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143770.036020:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.036454:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963622202112:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10542us (10845us total) trans 0 rc 950272/950272 00000100:00100000:1.0:1746143770.036466:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3020 00002000:00100000:1.0:1746143770.036478:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093417800 x1830963622202112/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 504/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.036488:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417800 with x1830963622202112 ext(1048576->2097151) 00002000:00010000:1.0:1746143770.036495:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093417800 00000100:00100000:0.0:1746143770.048517:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.048568:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.056062:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622202368:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6270us (7541us total) trans 17179872878 rc 0/0 00000100:00100000:0.0:1746143770.056075:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1310 00002000:00100000:0.0:1746143770.056087:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1880064->1978367) req@ffff880093417100 x1830963622202368/t17179872878(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/448 e 0 to 0 dl 1746143781 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.056096:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417100 with x1830963622202368 ext(1880064->1978367) 00010000:00010000:0.0:1746143770.056107:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a70c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->1978367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d2a expref: 22 pid: 12328 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143770.056121:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a70c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->1978367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d2a expref: 22 pid: 12328 timeout: 929 lvb_type: 0 00002000:00010000:0.0:1746143770.056129:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093417100 00000100:00100000:0.0:1746143770.059155:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.060209:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.060865:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.060882:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622203264 00000100:00100000:0.0:1746143770.060885:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622203264 00000100:00100000:0.0:1746143770.060908:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 704 00000100:00100000:0.0:1746143770.060938:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+274:2011:x1830963622203264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.060947:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.060963:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b600/0x87925e4cb73a712b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d5b expref: 274 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.060978:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143770.060982:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143770.061016:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+273:2011:x1830963622203264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.061022:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 704 00000100:00100000:1.0:1746143770.066689:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622203520 00000100:00100000:1.0:1746143770.066697:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622203520 00002000:00100000:1.0:1746143770.066730:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095c6a680 x1830963622203520/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.066739:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a680 with x1830963622203520 ext(1048576->2097151) 00002000:00010000:1.0:1746143770.066743:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c6a680 00000100:00100000:1.0:1746143770.066771:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3021 00000100:00100000:1.0:1746143770.066779:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2010:x1830963622203520:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143770.070112:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.079125:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2010:x1830963622203520:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12339us (12534us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143770.079135:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3021 00002000:00100000:1.0:1746143770.079144:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095c6a680 x1830963622203520/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.079159:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a680 with x1830963622203520 ext(1048576->2097151) 00002000:00010000:1.0:1746143770.079163:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c6a680 00000100:00100000:0.0:1746143770.088729:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.088784:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.088868:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622203904 00000100:00100000:1.0:1746143770.088876:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622203904 00000100:00100000:1.0:1746143770.088945:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622204032 00000100:00100000:1.0:1746143770.088947:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622204032 00000100:00100000:1.0:1746143770.088968:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11106 00000100:00100000:1.0:1746143770.088974:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963622203904:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143770.088997:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.089013:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7139 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409d62 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.089063:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626630656:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143770.089122:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.106382:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626630656:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143770.106409:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7139 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d62 expref: 20 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.106582:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7139 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d62 expref: 20 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.106978:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9200, rc 0) 00000100:00100000:1.0:1746143770.107318:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963622203904:12345-192.168.202.3@tcp:101:cat.0 Request processed in 18343us (18595us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143770.107324:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11106 00000100:00100000:0.0:1746143770.108668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.108707:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.109276:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3024 00000100:00100000:1.0:1746143770.109283:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622204544:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143770.110536:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.119171:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.126402:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.132358:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.135352:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622204544:12345-192.168.202.3@tcp:3:cat.0 Request processed in 26068us (26643us total) trans 0 rc 2084864/2084864 00000100:00100000:1.0:1746143770.135359:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3024 00002000:00100000:1.0:1746143770.135366:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880082ed5f80 x1830963622204544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 504/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 2084864/2084864 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.135374:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed5f80 with x1830963622204544 ext(2097152->4194303) 00002000:00010000:1.0:1746143770.135378:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed5f80 00000100:00100000:0.0:1746143770.141026:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.142731:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.142766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.142808:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.142841:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622205440 00000100:00100000:1.0:1746143770.142850:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622205440 00010000:00010000:1.0:1746143770.142872:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8200/0x87925e4cb73a70fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d38 expref: 20 pid: 12328 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746143770.142893:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622205568 00000100:00100000:1.0:1746143770.142895:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622205568 00000100:00100000:1.0:1746143770.142937:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5157 00000100:00100000:1.0:1746143770.142943:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622205440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.142953:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.142965:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800973b8200/0x87925e4cb73a70fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d38 expref: 20 pid: 12328 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.142974:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800973b8200/0x87925e4cb73a70fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d38 expref: 20 pid: 12328 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.143004:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8200/0x87925e4cb73a70fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d38 expref: 20 pid: 12328 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.143017:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.143019:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.143025:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.143033:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.143061:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.143071:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626631296:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143770.143124:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.144388:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626631296:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143770.144402:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.144438:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622205440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1494us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.144445:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5157 00000100:00100000:0.0:1746143770.144806:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.144848:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.144851:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622205952 00000100:00100000:1.0:1746143770.144855:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622205952 00000100:00100000:0.0:1746143770.145011:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3025 00000100:00100000:0.0:1746143770.145021:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622206080:12345-192.168.202.3@tcp:3:multiop.0 00010000:00010000:1.0:1746143770.145025:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a706e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d07 expref: 34 pid: 9585 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746143770.145053:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5158 00000100:00100000:1.0:1746143770.145121:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622205952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.145130:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.145143:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a706e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d07 expref: 34 pid: 9585 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.145152:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a706e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3903487) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d07 expref: 34 pid: 9585 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.145167:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a706e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3903487) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d07 expref: 34 pid: 9585 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.145177:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.145178:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.145183:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e24c600/0x87925e4cb73a7147 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d70 expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.145189:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e24c600/0x87925e4cb73a7147 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d70 expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.145195:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.145197:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.145199:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7178 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d85 expref: 33 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.145398:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7178 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d85 expref: 33 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.145424:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7178 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d85 expref: 33 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.145433:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626631424:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143770.145453:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622206080:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 434us (603us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143770.145461:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3025 00002000:00100000:0.0:1746143770.145468:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (503808->507903) req@ffff88012b7a8380 x1830963622206080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/4536 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.145475:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8380 with x1830963622206080 ext(503808->507903) 00002000:00010000:0.0:1746143770.145480:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a8380 00010000:00010000:1.0:1746143770.145493:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e24c600/0x87925e4cb73a7147 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d70 expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.145500:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626631552:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143770.145516:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.149764:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626631424:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143770.149783:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626631552:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143770.149801:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.149907:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963622205952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4785us (5101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.149958:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5158 00000100:00100000:0.0:1746143770.150211:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.154233:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.158000:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.163416:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622206848 00000100:00100000:1.0:1746143770.163419:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622206976 00000100:00100000:0.0:1746143770.163425:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622206848 00000100:00100000:1.0:1746143770.163432:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622206976 00010000:00010000:0.0:1746143770.163457:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73a6fdb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cb3 expref: 36 pid: 13436 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.163471:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e59e000/0x87925e4cb73a6f9c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c97 expref: 21 pid: 13436 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143770.163482:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5159 00000100:00100000:0.0:1746143770.163488:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622206848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.163499:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143770.163505:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5160 00000100:00100000:1.0:1746143770.163512:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622206976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.163521:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73a6fdb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cb3 expref: 36 pid: 13436 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.163525:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.163533:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73a6fdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cb3 expref: 36 pid: 13436 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.163543:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e59e000/0x87925e4cb73a6f9c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c97 expref: 21 pid: 13436 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.163776:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e59e000/0x87925e4cb73a6f9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c97 expref: 21 pid: 13436 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.163795:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e59e000/0x87925e4cb73a6f9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409c97 expref: 21 pid: 13436 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.163812:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.163814:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.163819:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a717f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d8c expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.164097:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a717f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d8c expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.164110:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143770.164128:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a717f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d8c expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.164161:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622206848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 671us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.164172:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5159 00000100:00100000:1.0:1746143770.164424:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626631936:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143770.164492:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.167182:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626631936:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143770.167199:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.168243:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622206976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4721us (4902us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.168256:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5160 00000100:00100000:0.0:1746143770.169864:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.172451:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622207744 00000100:00100000:0.0:1746143770.172459:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622207744 00002000:00100000:0.0:1746143770.172493:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3133440->3145727) req@ffff880095c68000 x1830963622207744/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 12776/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.172503:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68000 with x1830963622207744 ext(3133440->3145727) 00010000:00010000:0.0:1746143770.172511:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 34 pid: 3135 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143770.172524:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 34 pid: 3135 timeout: 929 lvb_type: 0 00002000:00010000:0.0:1746143770.172532:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c68000 00000100:00100000:0.0:1746143770.172560:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1312 00000100:00100000:0.0:1746143770.172567:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622207744:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143770.173093:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622207744:12345-192.168.202.3@tcp:4:cat.0 Request processed in 525us (796us total) trans 17179872879 rc 0/0 00000100:00100000:0.0:1746143770.173101:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1312 00002000:00100000:0.0:1746143770.173107:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3133440->3145727) req@ffff880095c68000 x1830963622207744/t17179872879(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 12776/448 e 0 to 0 dl 1746143781 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.173114:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68000 with x1830963622207744 ext(3133440->3145727) 00010000:00010000:0.0:1746143770.173119:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 36 pid: 3135 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143770.173134:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 36 pid: 3135 timeout: 929 lvb_type: 0 00002000:00010000:0.0:1746143770.173239:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c68000 00000100:00100000:0.0:1746143770.173538:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622207616:12345-192.168.202.3@tcp:3:cat.0 Request processed in 3527us (3674us total) trans 0 rc 581632/581632 00000100:00100000:0.0:1746143770.173544:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3029 00002000:00100000:0.0:1746143770.173549:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4775935) req@ffff88012b7a9500 x1830963622207616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 581632/581632 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.173555:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9500 with x1830963622207616 ext(4194304->4775935) 00002000:00010000:0.0:1746143770.173558:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a9500 00000100:00100000:0.0:1746143770.178441:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.178502:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.178680:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622207872 00000100:00100000:1.0:1746143770.178691:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622207872 00010000:00010000:1.0:1746143770.178732:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 36 pid: 3135 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746143770.178763:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5161 00000100:00100000:1.0:1746143770.178771:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622207872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.178787:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.178808:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 36 pid: 3135 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.178821:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 36 pid: 3135 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.178844:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2000/0x87925e4cb73a7060 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409cf9 expref: 36 pid: 3135 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.178867:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.178869:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.178876:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d200/0x87925e4cb73a7186 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d93 expref: 20 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.178884:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7d200/0x87925e4cb73a7186 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d93 expref: 20 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.178947:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7d200/0x87925e4cb73a7186 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d93 expref: 20 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.178964:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626632192:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143770.179067:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.187279:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.187324:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.187393:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.187422:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622208640 00000100:00100000:0.0:1746143770.187433:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622208640 00002000:00100000:0.0:1746143770.187488:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095cb4a80 x1830963622208640/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.187499:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4a80 with x1830963622208640 ext(3145728->4194303) 00002000:00010000:0.0:1746143770.187505:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb4a80 00000100:00100000:0.0:1746143770.188452:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622208768 00000100:00100000:0.0:1746143770.188458:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622208768 00002000:00100000:0.0:1746143770.188481:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095cb6680 x1830963622208768/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.188490:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6680 with x1830963622208768 ext(2097152->4194303) 00002000:00010000:0.0:1746143770.188494:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb6680 00000100:00100000:1.0:1746143770.188537:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3030 00000100:00100000:1.0:1746143770.188548:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622208640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143770.195764:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.204049:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622208640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15491us (16713us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143770.204061:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3030 00002000:00100000:1.0:1746143770.204074:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095cb4a80 x1830963622208640/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.204083:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4a80 with x1830963622208640 ext(3145728->4194303) 00002000:00010000:1.0:1746143770.204089:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb4a80 00000100:00100000:0.0:1746143770.208187:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.215355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.219391:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622209536 00000100:00100000:1.0:1746143770.219398:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622209536 00000100:00100000:0.0:1746143770.220677:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.220704:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.220727:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.220751:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.220804:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622209664 00000100:00100000:1.0:1746143770.220809:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622209664 00000100:00100000:1.0:1746143770.220829:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622209792 00000100:00100000:1.0:1746143770.220831:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622209792 00000100:00100000:1.0:1746143770.220854:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622210048 00000100:00100000:1.0:1746143770.220856:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622210048 00000100:00100000:1.0:1746143770.220866:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622210304 00000100:00100000:1.0:1746143770.220868:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622210304 00000100:00100000:1.0:1746143770.220881:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11117 00000100:00100000:1.0:1746143770.220885:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622209792:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143770.220891:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.220897:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73a71c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409dbd expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.220933:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626632832:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143770.221227:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.221399:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.221464:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.222961:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626632832:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143770.222977:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73a71c5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dbd expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.222994:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73a71c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dbd expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.223005:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74a00, rc 0) 00000100:00100000:1.0:1746143770.223214:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622209792:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2133us (2315us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143770.223221:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11117 00000100:00100000:0.0:1746143770.226400:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.229700:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.231266:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.239632:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.243122:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.243181:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.243247:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622211200 00000100:00100000:1.0:1746143770.243255:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622211200 00000100:00100000:1.0:1746143770.243402:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11123 00000100:00100000:1.0:1746143770.243409:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622211200:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143770.243418:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.243430:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097369e00/0x87925e4cb73a7212 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409dee expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.243461:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626633344:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143770.243842:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.244784:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.246802:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626633344:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143770.246821:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097369e00/0x87925e4cb73a7212 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dee expref: 20 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.246831:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097369e00/0x87925e4cb73a7212 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dee expref: 20 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.246855:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369e00, rc 0) 00000100:00100000:0.0:1746143770.247342:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.247381:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.247397:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622211712 00000100:00100000:0.0:1746143770.247399:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622211712 00000100:00100000:1.0:1746143770.247431:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622211200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4023us (4443us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143770.247435:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11123 00000100:00100000:1.0:1746143770.247445:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11125 00000100:00100000:1.0:1746143770.247449:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622211712:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143770.247455:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.247461:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73a7220 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409e03 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.247490:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626633600:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143770.247531:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.252650:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626633600:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143770.252686:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73a7220 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e03 expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.252699:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73a7220 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e03 expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.252717:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097368200, rc 0) 00000100:00100000:0.0:1746143770.252809:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622211840 00000100:00100000:0.0:1746143770.252816:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622211840 00000100:00100000:0.0:1746143770.252983:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11126 00000100:00100000:0.0:1746143770.253002:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622211840:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143770.253006:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622211712:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5556us (5623us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143770.253012:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11125 00010000:00010000:0.0:1746143770.253015:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143770.253028:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73a7227 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409e0a expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.253165:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626633728:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143770.253287:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.255275:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.255838:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.258308:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.259313:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.259504:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.259613:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622212992 00000100:00100000:1.0:1746143770.259618:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622212992 00000100:00100000:1.0:1746143770.259648:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4600 00000100:00100000:1.0:1746143770.259653:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013735a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:31762:x1830963622212992:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143770.259735:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013735a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:31762:x1830963622212992:12345-192.168.202.3@tcp:35:cat.0 Request processed in 81us (423us total) trans 8589943391 rc 0/0 00000100:00100000:1.0:1746143770.259742:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4600 00000100:00100000:0.0:1746143770.261127:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.261320:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622213120 00000100:00100000:0.0:1746143770.261324:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622213120 00010000:00010000:0.0:1746143770.261339:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a71d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dd9 expref: 10 pid: 13436 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746143770.261354:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5166 00000100:00100000:0.0:1746143770.261358:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622213120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.261366:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.261374:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a71d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dd9 expref: 10 pid: 13436 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143770.261381:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a71d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dd9 expref: 10 pid: 13436 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143770.261393:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a71d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dd9 expref: 10 pid: 13436 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143770.261409:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143770.261701:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622213120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 341us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.261707:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5166 00000100:00100000:0.0:1746143770.263679:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.266570:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.275672:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.278180:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.279447:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.281443:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.286011:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.289167:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.320638:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.326015:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.326065:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.326405:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11131 00000100:00100000:1.0:1746143770.326413:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622214912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143770.326422:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.326432:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a727b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409e34 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.326459:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626635136:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143770.326481:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.328514:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626635136:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143770.328549:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a727b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e34 expref: 32 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.328563:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a727b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e34 expref: 32 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.328585:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097368a00, rc 0) 00000100:00100000:1.0:1746143770.328623:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622214912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2210us (2620us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143770.328630:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11131 00000100:00100000:0.0:1746143770.335022:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.335074:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.335289:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622215424 00000100:00100000:1.0:1746143770.335299:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622215424 00002000:00100000:1.0:1746143770.335346:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (0->503807) req@ffff88009391f800 x1830963622215424/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.335356:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f800 with x1830963622215424 ext(0->503807) 00002000:00010000:1.0:1746143770.335361:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391f800 00000100:00100000:1.0:1746143770.335378:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622215552 00000100:00100000:1.0:1746143770.335380:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622215552 00002000:00100000:1.0:1746143770.335391:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1167360->2097151) req@ffff88009391ca80 x1830963622215552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.335398:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ca80 with x1830963622215552 ext(1167360->2097151) 00002000:00010000:1.0:1746143770.335401:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391ca80 00000100:00100000:1.0:1746143770.335415:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3035 00000100:00100000:1.0:1746143770.335427:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622215424:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143770.335870:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3036 00000100:00100000:0.0:1746143770.335875:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622215552:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143770.341471:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622215424:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6036us (6446us total) trans 0 rc 503808/503808 00000100:00100000:1.0:1746143770.341485:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3035 00002000:00100000:1.0:1746143770.341498:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (0->503807) req@ffff88009391f800 x1830963622215424/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 503808/503808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.341508:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f800 with x1830963622215424 ext(0->503807) 00002000:00010000:1.0:1746143770.341514:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391f800 00000100:00100000:1.0:1746143770.344008:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622215552:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8121us (8922us total) trans 0 rc 929792/929792 00000100:00100000:1.0:1746143770.344020:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3036 00002000:00100000:1.0:1746143770.344031:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1167360->2097151) req@ffff88009391ca80 x1830963622215552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 929792/929792 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.344041:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ca80 with x1830963622215552 ext(1167360->2097151) 00002000:00010000:1.0:1746143770.344047:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391ca80 00000100:00100000:0.0:1746143770.352296:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.352379:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.352418:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11132 00000100:00100000:0.0:1746143770.352425:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622215680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143770.352444:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143770.352460:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e76e00/0x87925e4cb73a7282 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409e42 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.352507:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626635264:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143770.352607:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.363090:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.366529:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.366568:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622216064 00000100:00100000:0.0:1746143770.366577:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622216064 00002000:00100000:0.0:1746143770.366628:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4370431) req@ffff880092145c00 x1830963622216064/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.366638:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145c00 with x1830963622216064 ext(4194304->4370431) 00010000:00010000:0.0:1746143770.366647:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73a724a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4370431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e26 expref: 19 pid: 13430 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143770.366660:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73a724a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4370431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e26 expref: 19 pid: 13430 timeout: 929 lvb_type: 0 00002000:00010000:0.0:1746143770.366666:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092145c00 00000100:00100000:0.0:1746143770.366696:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1313 00000100:00100000:0.0:1746143770.366704:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622216064:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143770.375289:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.381969:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.382004:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622216448 00000100:00100000:0.0:1746143770.382014:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622216448 00000100:00100000:0.0:1746143770.382073:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12705 00000100:00100000:0.0:1746143770.382082:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:31779:x1830963622216448:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143770.382107:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143770.382128:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77800/0x87925e4cb73a7297 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409e57 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.382210:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382223:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382234:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382247:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73a72a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382252:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73a72a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382257:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73a72a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382365:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73a72ac lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382375:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73a72ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382381:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73a72ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143770.382390:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143770.382465:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382470:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382477:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382483:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382488:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e77c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143770.382492:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382498:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382509:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143770.382512:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143770.382516:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382521:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73a729e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382547:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73a72a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382552:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73a72a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382557:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73a72a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382561:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143770.382563:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73a72a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.382571:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73a72a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.384502:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009600b400) 00010000:00010000:0.0:1746143770.384506:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143770.384511:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73a72a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.384518:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73a72a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.384577:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77800/0x87925e4cb73a7297 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e57 expref: 28 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.384590:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73a72ac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e57 expref: 27 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.384597:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143770.384599:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143770.384601:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77e00, rc 0) 00000100:00100000:0.0:1746143770.385203:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:31779:x1830963622216448:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3120us (3242us total) trans 8589943394 rc 0/0 00000100:00100000:0.0:1746143770.385210:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12705 00000100:00100000:0.0:1746143770.385290:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.391969:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622216960 00000100:00100000:1.0:1746143770.391974:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622216960 00000100:00100000:1.0:1746143770.392028:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622217088 00000100:00100000:1.0:1746143770.392030:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622217088 00000100:00100000:1.0:1746143770.392044:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11135 00000100:00100000:1.0:1746143770.392052:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963622216960:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143770.392052:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11136 00000100:00100000:0.0:1746143770.392061:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963622217088:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143770.392071:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143770.392071:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.392088:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32600/0x87925e4cb73a72ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409e65 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.392088:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a72c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409e6c expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.392111:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.392113:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.392122:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a72c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e6c expref: 22 pid: 9839 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143770.392138:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626635776:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143770.392138:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a72c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e6c expref: 22 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143770.392149:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77600, rc 0) 00000100:00100000:1.0:1746143770.392373:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.393277:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622217088:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1214us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.393284:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11136 00000100:00100000:1.0:1746143770.401300:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626635776:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143770.401301:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.401329:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622217472 00000100:00100000:0.0:1746143770.401335:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622217472 00010000:00010000:1.0:1746143770.401394:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32600/0x87925e4cb73a72ba lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e65 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.401410:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32600/0x87925e4cb73a72ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e65 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143770.401410:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12706 00000100:00100000:0.0:1746143770.401420:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+277:31781:x1830963622217472:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143770.401428:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32600, rc 0) 00010000:00010000:0.0:1746143770.401444:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143770.401461:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a72cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409e7a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.401473:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963622216960:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9421us (9900us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143770.401481:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11135 00010000:00010000:0.0:1746143770.401572:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73a72d6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.401587:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a7204 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409de7 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.401599:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a7266 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e2d expref: 278 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.401605:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73a72ac lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e57 expref: 26 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.401612:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73a72d6 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.401641:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73a72ac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e57 expref: 26 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.401653:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73a72ac lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e57 expref: 26 pid: 6587 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143770.401662:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b62680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626636032:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143770.401722:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a7266 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e2d expref: 278 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.401729:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a7266 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e2d expref: 278 pid: 7245 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143770.401736:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b60000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626636288:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143770.401848:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a7204 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409de7 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.401855:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a7204 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409de7 expref: 10 pid: 6587 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143770.401863:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b63100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626636416:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143770.401878:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.406789:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.406819:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.406879:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.407306:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5173 00000100:00100000:1.0:1746143770.407314:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622217856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143770.407314:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5174 00000100:00100000:0.0:1746143770.407321:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622217728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.407326:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.407329:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.407330:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a7204 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409de7 expref: 11 pid: 6587 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143770.407335:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73a72ac lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e57 expref: 27 pid: 6587 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.407338:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a7204 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409de7 expref: 11 pid: 6587 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143770.407345:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73a72ac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e57 expref: 27 pid: 6587 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.407357:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a7204 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409de7 expref: 11 pid: 6587 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143770.407364:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73a72ac lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e57 expref: 27 pid: 6587 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.407379:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143770.407382:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73a72d6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.407389:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73a72d6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143770.407397:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73a72d6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143770.407403:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143770.409132:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143770.409164:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622217728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1841us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.409173:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5174 00010000:00010000:1.0:1746143770.409180:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.409200:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622217856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1887us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.409206:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5173 00000100:00100000:0.0:1746143770.409227:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.409389:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.418363:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622218240 00000100:00100000:1.0:1746143770.418370:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622218240 00002000:00100000:1.0:1746143770.418402:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (503808->1048575) req@ffff88012e358e00 x1830963622218240/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.418411:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358e00 with x1830963622218240 ext(503808->1048575) 00010000:00010000:1.0:1746143770.418419:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 32 pid: 13436 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.418429:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 32 pid: 13436 timeout: 929 lvb_type: 0 00002000:00010000:1.0:1746143770.418435:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e358e00 00000100:00100000:1.0:1746143770.418451:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1315 00000100:00100000:1.0:1746143770.418457:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622218240:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143770.418664:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.422444:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622218240:12345-192.168.202.3@tcp:4:cat.0 Request processed in 3984us (4320us total) trans 21474840198 rc 0/0 00000100:00100000:1.0:1746143770.422451:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1315 00002000:00100000:1.0:1746143770.422458:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (503808->1048575) req@ffff88012e358e00 x1830963622218240/t21474840198(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/448 e 0 to 0 dl 1746143781 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.422474:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358e00 with x1830963622218240 ext(503808->1048575) 00010000:00010000:1.0:1746143770.422481:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 34 pid: 13436 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.422489:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 34 pid: 13436 timeout: 929 lvb_type: 0 00002000:00010000:1.0:1746143770.422495:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e358e00 00000100:00100000:0.0:1746143770.423199:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.423263:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622218624 00000100:00100000:1.0:1746143770.423270:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622218624 00000100:00100000:1.0:1746143770.423315:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 706 00000100:00100000:1.0:1746143770.423321:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622218624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.423332:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.423348:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73a7307 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e88 expref: 28 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.423376:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143770.423379:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.423400:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622218624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 79us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.423406:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 706 00000100:00100000:0.0:1746143770.425505:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.426453:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.426521:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622218752 00000100:00100000:0.0:1746143770.426531:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622218752 00010000:00010000:0.0:1746143770.426570:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e1f expref: 23 pid: 13430 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143770.426635:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622218880 00000100:00100000:0.0:1746143770.426638:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622218880 00010000:00010000:0.0:1746143770.426651:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 34 pid: 13436 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143770.427037:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5176 00000100:00100000:0.0:1746143770.427044:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622218880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.427054:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.427067:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 34 pid: 13436 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143770.427112:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 34 pid: 13436 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143770.427126:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73a714e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d77 expref: 34 pid: 13436 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143770.427188:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.427189:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.427195:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73a72eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e81 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.427207:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73a72eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e81 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.427228:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73a72eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e81 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.427236:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e27800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626636800:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143770.427485:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.431154:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e27800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626636800:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143770.431176:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.431228:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622218880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4184us (4776us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.431238:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5176 00000100:00100000:0.0:1746143770.435217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.435548:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622219136 00000100:00100000:1.0:1746143770.435559:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622219136 00002000:00100000:1.0:1746143770.435612:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880090e25500 x1830963622219136/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.435623:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25500 with x1830963622219136 ext(0->1048575) 00002000:00010000:1.0:1746143770.435632:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e25500 00000100:00100000:1.0:1746143770.436588:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3038 00000100:00100000:1.0:1746143770.436601:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963622219136:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143770.437502:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.437551:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.455126:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.455470:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622219136:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18872us (20263us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143770.455480:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3038 00002000:00100000:1.0:1746143770.455488:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880090e25500 x1830963622219136/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.455497:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25500 with x1830963622219136 ext(0->1048575) 00002000:00010000:1.0:1746143770.455502:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e25500 00000100:00100000:0.0:1746143770.464279:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.464314:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.464338:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.464445:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622220032 00000100:00100000:1.0:1746143770.464452:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622220032 00010000:00010000:1.0:1746143770.464479:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a7036 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ceb expref: 23 pid: 9587 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746143770.464501:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622220160 00000100:00100000:1.0:1746143770.464502:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622220160 00010000:00010000:1.0:1746143770.464510:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee77000/0x87925e4cb73a6ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ccf expref: 33 pid: 9587 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746143770.464525:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622219904 00000100:00100000:1.0:1746143770.464527:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622219904 00010000:00010000:1.0:1746143770.464534:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a71cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dcb expref: 8 pid: 12327 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746143770.464546:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5177 00000100:00100000:1.0:1746143770.464552:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963622220032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.464562:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.464576:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a7036 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ceb expref: 23 pid: 9587 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.464585:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a7036 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ceb expref: 23 pid: 9587 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.464601:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a7036 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ceb expref: 23 pid: 9587 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.464616:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.464645:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622220032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 92us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.464651:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5177 00000100:00100000:1.0:1746143770.465229:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5179 00000100:00100000:1.0:1746143770.465260:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622219904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.465267:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.465275:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a71cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dcb expref: 8 pid: 12327 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.465283:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a71cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dcb expref: 8 pid: 12327 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.465292:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a71cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dcb expref: 8 pid: 12327 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.465300:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.465302:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.465307:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a7315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e8f expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.465313:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a7315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e8f expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.465342:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a7315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e8f expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.465356:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626637312:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143770.465394:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.469629:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.469703:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626637312:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143770.469718:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.469859:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2011:x1830963622219904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4600us (5519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.469867:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5179 00000100:00100000:0.0:1746143770.470263:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.477097:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.477792:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.478219:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.482536:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.487363:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.487452:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622221312 00000100:00100000:1.0:1746143770.487463:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622221312 00010000:00010000:1.0:1746143770.487500:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124512000/0x87925e4cb73a7290 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e50 expref: 35 pid: 9585 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746143770.487613:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5180 00000100:00100000:1.0:1746143770.487621:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622221312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.487633:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.487649:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124512000/0x87925e4cb73a7290 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e50 expref: 35 pid: 9585 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.487659:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124512000/0x87925e4cb73a7290 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e50 expref: 35 pid: 9585 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.487677:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124512000/0x87925e4cb73a7290 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e50 expref: 35 pid: 9585 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.487704:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.487750:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622221312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.487756:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5180 00000100:00100000:0.0:1746143770.490953:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.495501:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.495575:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.496584:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.500533:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.501083:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.501136:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622222336 00000100:00100000:0.0:1746143770.501140:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622222336 00002000:00100000:0.0:1746143770.501157:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1732607) req@ffff880092147100 x1830963622222336/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.501165:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092147100 with x1830963622222336 ext(1048576->1732607) 00002000:00010000:0.0:1746143770.501169:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092147100 00000100:00100000:0.0:1746143770.501187:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3043 00000100:00100000:0.0:1746143770.501192:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622222336:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143770.501949:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.502827:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.502853:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622222592 00000100:00100000:1.0:1746143770.502860:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622222592 00002000:00100000:1.0:1746143770.502894:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->2174975) req@ffff880092146300 x1830963622222592/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.502909:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146300 with x1830963622222592 ext(2097152->2174975) 00010000:00010000:1.0:1746143770.502940:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7200/0x87925e4cb73a7323 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409eab expref: 24 pid: 3135 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746143770.502953:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7200/0x87925e4cb73a7323 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409eab expref: 24 pid: 3135 timeout: 929 lvb_type: 0 00002000:00010000:1.0:1746143770.502959:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092146300 00000100:00100000:1.0:1746143770.502978:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1318 00000100:00100000:1.0:1746143770.502994:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622222592:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143770.510282:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622222336:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 9083us (9201us total) trans 0 rc 684032/684032 00000100:00100000:0.0:1746143770.510292:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3043 00002000:00100000:0.0:1746143770.510300:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1732607) req@ffff880092147100 x1830963622222336/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 684032/684032 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.510308:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092147100 with x1830963622222336 ext(1048576->1732607) 00002000:00010000:0.0:1746143770.510312:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092147100 00000100:00100000:1.0:1746143770.510440:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.511902:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.514561:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.519336:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.520969:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.521367:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.523817:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.524400:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.524450:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.527097:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.528105:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.528183:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622224512 00000100:00100000:1.0:1746143770.528262:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622224512 00000100:00100000:1.0:1746143770.528299:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11152 00000100:00100000:1.0:1746143770.528306:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622224512:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143770.528320:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.528333:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73a7369 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409ee3 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.528375:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626639232:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143770.528569:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.528812:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622224768 00000100:00100000:1.0:1746143770.528816:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622224768 00002000:00100000:1.0:1746143770.528937:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880092ef0000 x1830963622224768/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.528945:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0000 with x1830963622224768 ext(2097152->3145727) 00010000:00010000:1.0:1746143770.528952:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a734d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ec0 expref: 24 pid: 3135 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.528963:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a734d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ec0 expref: 24 pid: 3135 timeout: 929 lvb_type: 1 00002000:00010000:1.0:1746143770.528969:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ef0000 00000100:00100000:1.0:1746143770.529084:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1319 00000100:00100000:1.0:1746143770.529091:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622224768:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143770.533183:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.535736:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.535796:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622225152 00000100:00100000:1.0:1746143770.535801:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622225152 00000100:00100000:1.0:1746143770.535826:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4603 00000100:00100000:1.0:1746143770.535837:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:31776:x1830963622225152:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143770.536015:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:31776:x1830963622225152:12345-192.168.202.3@tcp:35:cat.0 Request processed in 177us (279us total) trans 8589943398 rc 0/0 00000100:00100000:1.0:1746143770.536021:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4603 00000100:00100000:1.0:1746143770.536460:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622224768:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7369us (7824us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143770.536468:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1319 00002000:00100000:1.0:1746143770.536476:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880092ef0000 x1830963622224768/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.536486:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0000 with x1830963622224768 ext(2097152->3145727) 00010000:00010000:1.0:1746143770.536493:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a734d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ec0 expref: 24 pid: 3135 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.536505:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a734d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ec0 expref: 24 pid: 3135 timeout: 929 lvb_type: 1 00002000:00010000:1.0:1746143770.536511:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ef0000 00000100:00100000:0.0:1746143770.539838:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.539969:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.540170:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622225408 00000100:00100000:1.0:1746143770.540181:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622225408 00010000:00010000:1.0:1746143770.540217:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a734d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ec0 expref: 24 pid: 3135 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746143770.540267:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5186 00000100:00100000:1.0:1746143770.540275:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622225408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.540288:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.540303:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a734d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ec0 expref: 24 pid: 3135 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.540312:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a734d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ec0 expref: 24 pid: 3135 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.540330:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a734d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ec0 expref: 24 pid: 3135 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.540343:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.540344:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.540349:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a7362 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409edc expref: 32 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.540360:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a7362 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409edc expref: 32 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.540387:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a7362 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409edc expref: 32 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.540396:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626639488:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143770.540603:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.542283:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626639488:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143770.542303:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143770.542336:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622225408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2060us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.542345:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5186 00000100:00100000:1.0:1746143770.542761:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.549032:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.553692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.561114:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.564041:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.571847:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.578311:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.579546:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.580493:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622226816 00000100:00100000:0.0:1746143770.580502:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622226816 00002000:00100000:0.0:1746143770.580541:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880092144000 x1830963622226816/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.580550:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144000 with x1830963622226816 ext(3145728->4194303) 00002000:00010000:0.0:1746143770.580556:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092144000 00000100:00100000:0.0:1746143770.580594:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3048 00000100:00100000:0.0:1746143770.580601:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622226816:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143770.583294:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626640000 00000100:00100000:1.0:1746143770.583302:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626640000 00000100:00100000:1.0:1746143770.583352:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1746143770.583359:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3774:x1830963626640000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1746143770.583393:0:12158:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446088704 avail 1316626432 00000100:00100000:1.0:1746143770.583434:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3774:x1830963626640000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.583440:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1746143770.592874:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.603534:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.616168:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143770.616189:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626640512:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.616265:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143770.616279:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626640256:0@lo:400:kworker.0 00000100:00100000:1.0:1746143770.616311:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.616323:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b99f1f93-ef24-4932-a1b4-452b64359da1:3773:1830963626640128:0@lo:400:kworker.0 00000100:00100000:1.0:1746143770.616327:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3771:1830963626640768:0@lo:400:kworker.0 00000100:00100000:1.0:1746143770.616359:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.616670:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.616709:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3773:1830963626641024:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.616729:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.616749:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3773:1830963626641536:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.616764:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143770.616798:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626641280:0@lo:400:kworker.0 00000100:00100000:1.0:1746143770.616817:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143770.616853:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626640512 00000100:00100000:1.0:1746143770.616857:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626640512 00000100:00100000:1.0:1746143770.616883:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1746143770.616894:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626641280 00000100:00100000:1.0:1746143770.616896:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626641280 00000100:00100000:1.0:1746143770.616934:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1746143770.616939:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626641280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143770.616971:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626641280:12345-0@lo:400:kworker.0 Request processed in 32us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.616976:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1746143770.617032:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626641280:0@lo:400:kworker.0 00000100:00100000:1.0:1746143770.617048:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963626640512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143770.617072:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963626640512:12345-0@lo:400:kworker.0 Request processed in 184us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.617076:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1746143770.617213:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626640512:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.617227:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143770.617231:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626640640:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.617248:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.617260:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3773:1830963626641152:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.617275:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.617294:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626641152 00000100:00100000:0.0:1746143770.617296:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626641152 00000100:00100000:0.0:1746143770.617314:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1746143770.617317:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3773:x1830963626641024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.617341:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3773:x1830963626641024:12345-0@lo:400:kworker.0 Request processed in 23us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.617346:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1746143770.617355:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1746143770.617359:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3773:x1830963626641152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.617377:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3773:x1830963626641152:12345-0@lo:400:kworker.0 Request processed in 18us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.617384:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1746143770.617402:0:8213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626640128 00000100:00100000:0.0:1746143770.617403:0:8213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626640128 00000100:00100000:0.0:1746143770.617421:0:8213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1746143770.617425:0:8213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3773:x1830963626640128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.617442:0:8213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3773:x1830963626640128:12345-0@lo:400:kworker.0 Request processed in 17us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.617446:0:8213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1746143770.617475:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626640640:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.617482:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3773:1830963626641152:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.617489:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3773:1830963626641024:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.617498:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3773:1830963626641536:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.617503:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b99f1f93-ef24-4932-a1b4-452b64359da1:3773:1830963626640128:0@lo:400:kworker.0 00000100:00100000:1.0:1746143770.617674:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626641408 00000100:00100000:1.0:1746143770.617678:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626641408 00000100:00100000:1.0:1746143770.617699:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1746143770.617703:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963626641408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143770.617733:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963626641408:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.617738:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1746143770.617755:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626640256:0@lo:400:kworker.0 00000100:00100000:1.0:1746143770.617762:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3771:1830963626640768:0@lo:400:kworker.0 00000100:00100000:0.0:1746143770.655187:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.662978:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.663018:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.663052:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.663086:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.663123:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622227840 00000100:00100000:1.0:1746143770.663128:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622227840 00000100:00100000:1.0:1746143770.663153:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622227968 00000100:00100000:1.0:1746143770.663155:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622227968 00000100:00100000:1.0:1746143770.663165:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622228096 00000100:00100000:1.0:1746143770.663167:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622228096 00000100:00100000:1.0:1746143770.663182:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11155 00000100:00100000:1.0:1746143770.663187:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622227840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143770.663203:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.663216:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73a73a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409eff expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.663278:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626641664:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143770.663330:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00002000:00010000:1.0:1746143770.665083:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime: 1746143770 -> 1746143771 00000100:00100000:1.0:1746143770.665105:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626641664:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143770.665127:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73a73a1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409eff expref: 37 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.665138:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73a73a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409eff expref: 37 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.665162:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048800, rc 0) 00000100:00100000:1.0:1746143770.665598:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622227840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2408us (2577us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143770.665605:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11155 00000100:00100000:0.0:1746143770.665740:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.669478:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.669525:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.671601:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.671638:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.671761:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622229248 00000100:00100000:1.0:1746143770.671766:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622229248 00002000:00100000:1.0:1746143770.671786:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8800921cca80 x1830963622229248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.671794:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cca80 with x1830963622229248 ext(1048576->2097151) 00002000:00010000:1.0:1746143770.671798:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cca80 00000100:00100000:1.0:1746143770.671900:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3051 00000100:00100000:1.0:1746143770.671907:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622229248:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143770.680770:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622229248:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8854us (9121us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143770.680781:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3051 00002000:00100000:1.0:1746143770.680791:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8800921cca80 x1830963622229248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.680800:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cca80 with x1830963622229248 ext(1048576->2097151) 00002000:00010000:1.0:1746143770.680806:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cca80 00000100:00100000:0.0:1746143770.688344:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.688483:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622229376 00000100:00100000:1.0:1746143770.688494:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622229376 00000100:00100000:1.0:1746143770.688542:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11158 00000100:00100000:1.0:1746143770.688550:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:31791:x1830963622229376:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143770.688569:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.688588:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73a73d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409f1b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.688621:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a7315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e8f expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.688633:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143770.688635:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143770.688639:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73a73d9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f1b expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.688670:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a7315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e8f expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.688682:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e505400/0x87925e4cb73a7315 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e8f expref: 23 pid: 3135 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746143770.688695:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626641792:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143770.688798:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.690835:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.690955:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626641792:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143770.690980:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73a73d9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f1b expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.691009:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048a00, rc 0) 00000100:00100000:1.0:1746143770.691059:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:31791:x1830963622229376:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2509us (2725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.691066:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11158 00000100:00100000:0.0:1746143770.698338:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.701317:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.718003:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.721637:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.721687:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.721938:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3053 00000100:00100000:0.0:1746143770.721947:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622230656:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143770.722823:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.742867:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.743083:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626642048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746143770.743123:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143770.743171:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626642048 00000100:00100000:1.0:1746143770.743177:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626642048 00000100:00100000:1.0:1746143770.743213:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1746143770.743219:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963626642048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746143770.743236:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1017950272 pending 5857280 free 3914395648 avail 3682873344 00000100:00100000:1.0:1746143770.743261:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963626642048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.743266:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1746143770.743301:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626642048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746143770.747860:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622230656:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25913us (26231us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143770.747870:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3053 00002000:00100000:1.0:1746143770.747878:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012b7a8e00 x1830963622230656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.747887:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8e00 with x1830963622230656 ext(2097152->4194303) 00002000:00010000:1.0:1746143770.747891:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a8e00 00000100:00100000:0.0:1746143770.749889:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.750066:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.750091:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.750113:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.750177:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622231424 00000100:00100000:1.0:1746143770.750184:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622231424 00010000:00010000:1.0:1746143770.750210:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3000/0x87925e4cb73a7108 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d4d expref: 40 pid: 3135 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746143770.750326:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622231552 00000100:00100000:1.0:1746143770.750329:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622231552 00010000:00010000:1.0:1746143770.750340:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a710f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d54 expref: 25 pid: 9585 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746143770.750430:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5191 00000100:00100000:1.0:1746143770.750437:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622231296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.750444:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.750452:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d7c400/0x87925e4cb73a71da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dc4 expref: 9 pid: 9586 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.750459:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d7c400/0x87925e4cb73a71da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dc4 expref: 9 pid: 9586 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.750470:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7c400/0x87925e4cb73a71da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409dc4 expref: 9 pid: 9586 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746143770.750483:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.750499:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622231296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 63us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.750505:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5191 00000100:00100000:1.0:1746143770.750517:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 710 00000100:00100000:1.0:1746143770.750522:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2011:x1830963622231680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.750528:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.750539:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a7418 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f29 expref: 32 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.750549:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143770.750552:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.750564:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2011:x1830963622231680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 43us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.750569:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 710 00000100:00100000:0.0:1746143770.751421:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.751463:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.751608:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11161 00000100:00100000:1.0:1746143770.751655:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622231936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143770.751673:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.751728:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73a7434 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409f3e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.751749:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.751751:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.751759:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73a7434 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f3e expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.751773:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73a7434 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f3e expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.751783:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048400, rc 0) 00000100:00100000:1.0:1746143770.751942:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622231936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 291us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.751948:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11161 00000100:00100000:0.0:1746143770.755235:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.755290:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.755340:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622232192 00000100:00100000:1.0:1746143770.755346:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622232192 00002000:00100000:1.0:1746143770.755384:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1122304->1126399) req@ffff880095cb5880 x1830963622232192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.755394:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5880 with x1830963622232192 ext(1122304->1126399) 00002000:00010000:1.0:1746143770.755399:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5880 00000100:00100000:1.0:1746143770.755423:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3055 00000100:00100000:1.0:1746143770.755429:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622232192:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143770.755705:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622232192:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 275us (471us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143770.755711:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3055 00002000:00100000:1.0:1746143770.755716:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1122304->1126399) req@ffff880095cb5880 x1830963622232192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/4536 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.755723:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5880 with x1830963622232192 ext(1122304->1126399) 00002000:00010000:1.0:1746143770.755726:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5880 00000100:00100000:0.0:1746143770.762694:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622232832:12345-192.168.202.3@tcp:3:cat.0 Request processed in 3095us (3459us total) trans 0 rc 585728/585728 00000100:00100000:0.0:1746143770.762705:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3057 00002000:00100000:0.0:1746143770.762714:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880093073480 x1830963622232832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.762722:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093073480 with x1830963622232832 ext(4194304->4780031) 00002000:00010000:0.0:1746143770.762727:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093073480 00000100:00100000:1.0:1746143770.763225:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.765314:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143770.769790:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime: 1746143770 -> 1746143771 00002000:00010000:0.0:1746143770.769794:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime: 1746143770 -> 1746143771 00000100:00100000:0.0:1746143770.769804:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626642944:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143770.769842:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a7442 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f4c expref: 40 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143770.769855:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a7442 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f4c expref: 40 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143770.769881:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97200, rc 0) 00000100:00100000:0.0:1746143770.769959:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622233472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4483us (4644us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143770.769966:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11163 00000100:00100000:0.0:1746143770.772590:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.772703:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622233984 00000100:00100000:1.0:1746143770.772712:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622233984 00002000:00100000:1.0:1746143770.772759:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095c38e00 x1830963622233984/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.772769:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38e00 with x1830963622233984 ext(1048576->2097151) 00002000:00010000:1.0:1746143770.772774:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c38e00 00000100:00100000:1.0:1746143770.773199:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3060 00000100:00100000:1.0:1746143770.773208:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622233984:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143770.775121:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622234112 00000100:00100000:0.0:1746143770.775128:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622234112 00000100:00100000:0.0:1746143770.775585:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11164 00000100:00100000:0.0:1746143770.775593:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622234112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143770.775607:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143770.775623:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048c00/0x87925e4cb73a7449 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409f53 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.775670:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626643200:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143770.776123:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.776138:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626643072 00000100:00100000:0.0:1746143770.776141:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626643072 00000100:00100000:0.0:1746143770.776175:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1746143770.776180:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626643072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746143770.776483:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1018252480 pending 6160384 free 3913007104 avail 3681484800 00000100:00100000:0.0:1746143770.776529:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626643072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 345us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.776535:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1746143770.780389:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.780678:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622233984:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7469us (8096us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143770.780812:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3060 00002000:00100000:1.0:1746143770.780819:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095c38e00 x1830963622233984/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.780827:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38e00 with x1830963622233984 ext(1048576->2097151) 00002000:00010000:1.0:1746143770.780830:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c38e00 00000100:00100000:0.0:1746143770.782905:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.782960:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622234624 00000100:00100000:1.0:1746143770.782968:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622234624 00000100:00100000:1.0:1746143770.783022:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4607 00000100:00100000:1.0:1746143770.783027:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+282:31791:x1830963622234624:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143770.783205:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+283:31791:x1830963622234624:12345-192.168.202.3@tcp:35:cat.0 Request processed in 178us (309us total) trans 8589943406 rc 0/0 00000100:00100000:1.0:1746143770.783210:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4607 00000100:00100000:0.0:1746143770.787582:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.787665:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.791027:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143770.791041:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626643584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143770.791052:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.791081:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143770.791130:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622235264 00000100:00100000:1.0:1746143770.791749:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622235264 00002000:00100000:1.0:1746143770.791780:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1593344->1597439) req@ffff880092b3aa00 x1830963622235264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.791790:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3aa00 with x1830963622235264 ext(1593344->1597439) 00002000:00010000:1.0:1746143770.791794:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b3aa00 00000100:00100000:1.0:1746143770.791809:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3062 00000100:00100000:1.0:1746143770.791814:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622235264:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143770.791952:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622235264:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 136us (900us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143770.791957:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3062 00002000:00100000:1.0:1746143770.791962:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1593344->1597439) req@ffff880092b3aa00 x1830963622235264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:166/0 lens 488/4536 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.791969:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b3aa00 with x1830963622235264 ext(1593344->1597439) 00002000:00010000:1.0:1746143770.791977:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b3aa00 00000100:00100000:0.0:1746143770.797506:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.798405:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.802096:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.802455:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.802482:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622235648 00000100:00100000:0.0:1746143770.802488:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622235648 00010000:00010000:0.0:1746143770.802513:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73a7434 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f3e expref: 26 pid: 9585 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746143770.802540:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622235776 00000100:00100000:0.0:1746143770.802542:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622235776 00010000:00010000:0.0:1746143770.802553:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73a73d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f1b expref: 38 pid: 3135 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143770.802567:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5194 00000100:00100000:0.0:1746143770.802578:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622235648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.802592:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.802611:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73a7434 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f3e expref: 26 pid: 9585 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143770.802637:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73a7434 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f3e expref: 26 pid: 9585 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143770.802666:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73a7434 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f3e expref: 26 pid: 9585 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143770.802701:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143770.802718:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622235648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 142us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.802725:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5194 00000100:00100000:0.0:1746143770.803276:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.803314:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.806306:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.806332:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.806359:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.806410:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11170 00000100:00100000:0.0:1746143770.806417:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622236416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143770.806432:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143770.806446:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7473 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409f7d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.806482:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626644480:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143770.806600:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.812104:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.812145:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622236800 00000100:00100000:1.0:1746143770.812154:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622236800 00000100:00100000:1.0:1746143770.812189:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4608 00000100:00100000:1.0:1746143770.812195:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:31798:x1830963622236800:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143770.812375:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:31798:x1830963622236800:12345-192.168.202.3@tcp:35:cat.0 Request processed in 180us (279us total) trans 8589943407 rc 0/0 00000100:00100000:1.0:1746143770.812380:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4608 00000100:00100000:0.0:1746143770.886330:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.890370:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.890845:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.892878:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.900578:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.902659:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.908323:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.908393:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622238080 00000100:00100000:1.0:1746143770.908403:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622238080 00002000:00100000:1.0:1746143770.908452:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1396736->1400831) req@ffff880093724380 x1830963622238080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.908462:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724380 with x1830963622238080 ext(1396736->1400831) 00002000:00010000:1.0:1746143770.908466:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093724380 00000100:00100000:1.0:1746143770.908501:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3065 00000100:00100000:1.0:1746143770.908509:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622238080:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143770.908667:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622238080:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 157us (352us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143770.908672:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3065 00002000:00100000:1.0:1746143770.908679:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1396736->1400831) req@ffff880093724380 x1830963622238080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:166/0 lens 488/4536 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.908685:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724380 with x1830963622238080 ext(1396736->1400831) 00002000:00010000:1.0:1746143770.908688:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093724380 00000100:00100000:0.0:1746143770.910529:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.911235:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622238336 00000100:00100000:1.0:1746143770.911243:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622238336 00000100:00100000:1.0:1746143770.911418:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4609 00000100:00100000:1.0:1746143770.911426:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:31805:x1830963622238336:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143770.911659:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:31805:x1830963622238336:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 233us (1136us total) trans 8589943409 rc 0/0 00000100:00100000:1.0:1746143770.911665:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4609 00000100:00100000:0.0:1746143770.927369:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.931150:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.931187:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.966511:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.973006:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143770.973999:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.974112:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622239360 00000100:00100000:0.0:1746143770.974117:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622239360 00010000:00010000:0.0:1746143770.974133:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a7370 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409eea expref: 26 pid: 9587 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143770.974151:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5198 00000100:00100000:0.0:1746143770.974156:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622239360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.974162:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.974169:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a7370 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409eea expref: 26 pid: 9587 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143770.974177:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a7370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409eea expref: 26 pid: 9587 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143770.974189:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a7370 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409eea expref: 26 pid: 9587 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143770.974205:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.974208:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.974214:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a74ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa0 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.974222:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a74ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa0 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.974250:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a74ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa0 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.974262:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626645248:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143770.974459:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.976355:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.980676:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.987340:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.987402:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143770.987594:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5199 00000100:00100000:0.0:1746143770.987604:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622239872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.987620:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.987643:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082087400/0x87925e4cb73a7377 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ef1 expref: 25 pid: 9587 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143770.987663:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082087400/0x87925e4cb73a7377 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ef1 expref: 25 pid: 9587 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143770.987695:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082087400/0x87925e4cb73a7377 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ef1 expref: 25 pid: 9587 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143770.987716:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.987718:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.987725:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73a74d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa7 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.987733:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73a74d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa7 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.987766:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73a74d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa7 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.987778:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626645632:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143770.987834:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.992326:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626645632:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143770.992348:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143770.992398:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622239872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4796us (5068us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.992406:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5199 00000100:00100000:0.0:1746143771.002207:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.005336:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.006426:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143771.006558:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143771.013074:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.013270:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11176 00000100:00100000:0.0:1746143771.013280:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+41:31812:x1830963622240896:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143771.013301:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.013319:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a7506 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409fbc expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.013351:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a74a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->1400831) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f92 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.013359:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143771.013361:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143771.013364:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a7506 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fbc expref: 42 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.013396:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a74a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->1400831) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f92 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.013408:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a74a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->1400831) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f92 expref: 24 pid: 13436 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143771.013420:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626645888:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143771.013523:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.014860:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143771.015023:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143771.016990:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622241024:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 1844us (2113us total) trans 17179872885 rc 0/0 00000100:00100000:0.0:1746143771.017001:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1325 00002000:00100000:0.0:1746143771.017012:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1339392->1400831) req@ffff880093724700 x1830963622241024/t17179872885(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.017026:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724700 with x1830963622241024 ext(1339392->1400831) 00010000:00010000:0.0:1746143771.017035:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a74a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f92 expref: 27 pid: 13436 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.017050:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a74a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1339392->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f92 expref: 27 pid: 13436 timeout: 930 lvb_type: 0 00002000:00010000:0.0:1746143771.017056:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093724700 00000100:00100000:0.0:1746143771.024658:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.024703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.024783:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622241536 00000100:00100000:1.0:1746143771.024794:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622241536 00002000:00100000:1.0:1746143771.024841:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093724a80 x1830963622241536/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.024850:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724a80 with x1830963622241536 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.024855:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093724a80 00000100:00100000:1.0:1746143771.024884:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622241664 00000100:00100000:1.0:1746143771.024887:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622241664 00002000:00100000:1.0:1746143771.024907:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b5:0x0] (1413120->2097151) req@ffff880093725880 x1830963622241664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.024940:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725880 with x1830963622241664 ext(1413120->2097151) 00002000:00010000:1.0:1746143771.024944:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093725880 00000100:00100000:1.0:1746143771.024958:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3068 00000100:00100000:1.0:1746143771.024965:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622241536:12345-192.168.202.3@tcp:3:cat.0 00000100:00080000:0.0:1746143771.025942:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143771.030181:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143771.031955:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143771.033344:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622241536:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8376us (8695us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.033352:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3068 00002000:00100000:1.0:1746143771.033359:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093724a80 x1830963622241536/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.033366:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724a80 with x1830963622241536 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.033370:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093724a80 00000100:00100000:0.0:1746143771.034040:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.034878:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.037426:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.037873:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:1.0:1746143771.038036:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143771.038803:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622242688 00000100:00100000:0.0:1746143771.038807:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622242688 00000100:00100000:0.0:1746143771.038820:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622242816 00000100:00100000:0.0:1746143771.038822:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622242816 00000100:00100000:0.0:1746143771.038833:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11179 00000100:00100000:0.0:1746143771.038838:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622242688:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143771.038845:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.038851:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a7561 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409fdf expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.038876:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626646272:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.038941:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11180 00000100:00100000:1.0:1746143771.038952:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622242816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.038963:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.038974:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a7568 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409fe6 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.039023:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626646400:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143771.039305:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.039313:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00002000:00010000:1.0:1746143771.042153:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143770 -> 1746143771 00002000:00010000:1.0:1746143771.042160:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143770 -> 1746143771 00002000:00010000:1.0:1746143771.042162:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143770 -> 1746143771 00000100:00100000:1.0:1746143771.042186:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626646400:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143771.042215:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a7568 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fe6 expref: 28 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.042228:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a7568 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fe6 expref: 28 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.042242:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049c00, rc 0) 00000100:00100000:1.0:1746143771.042282:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622242816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3333us (3698us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.042294:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11180 00000100:00100000:0.0:1746143771.044030:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.044366:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.044452:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622243456 00000100:00100000:1.0:1746143771.044457:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622243456 00002000:00100000:1.0:1746143771.044712:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3792895) req@ffff8801373b9500 x1830963622243456/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.044720:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9500 with x1830963622243456 ext(2097152->3792895) 00002000:00010000:1.0:1746143771.044723:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b9500 00000100:00100000:1.0:1746143771.044748:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3071 00000100:00100000:1.0:1746143771.044753:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622243456:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143771.045231:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.045249:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.045266:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.046010:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622243584 00000100:00100000:1.0:1746143771.046016:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622243584 00000100:00100000:1.0:1746143771.046041:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622243712 00000100:00100000:1.0:1746143771.046043:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622243712 00000100:00100000:1.0:1746143771.046052:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622243840 00000100:00100000:1.0:1746143771.046054:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622243840 00000100:00100000:1.0:1746143771.046068:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11181 00000100:00100000:1.0:1746143771.046073:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622243584:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.046084:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.046099:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049000/0x87925e4cb73a756f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409fed expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.046143:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626646528:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.046190:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.046203:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11182 00000100:00100000:1.0:1746143771.046207:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622243712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.046215:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.046220:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73a7576 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409ff4 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.046237:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626646656:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.046251:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.046262:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11183 00000100:00100000:1.0:1746143771.046266:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622243840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.046271:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.046277:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a757d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248409ffb expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.046293:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626646784:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.046305:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.053162:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626646784:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.053180:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626646528:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143771.053204:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a757d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ffb expref: 28 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.053210:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049000/0x87925e4cb73a756f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fed expref: 27 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.053219:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a757d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ffb expref: 28 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.053224:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049000/0x87925e4cb73a756f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fed expref: 27 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.053244:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9800, rc 0) 00000100:00100000:0.0:1746143771.053299:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622243840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7031us (8030us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143771.053307:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11183 00010000:00010000:1.0:1746143771.053315:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049000, rc 0) 00000100:00100000:1.0:1746143771.053357:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622243584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7282us (8126us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.053365:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11181 00000100:00100000:1.0:1746143771.053408:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626646656:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143771.053422:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73a7576 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ff4 expref: 25 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.053430:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73a7576 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409ff4 expref: 25 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.053437:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049400, rc 0) 00000100:00100000:1.0:1746143771.053510:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622243712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7301us (8258us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.053515:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11182 00000100:00100000:1.0:1746143771.053609:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622243456:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8855us (9243us total) trans 0 rc 1695744/1695744 00000100:00100000:1.0:1746143771.053616:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3071 00002000:00100000:1.0:1746143771.053623:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3792895) req@ffff8801373b9500 x1830963622243456/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1695744/1695744 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.053631:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9500 with x1830963622243456 ext(2097152->3792895) 00002000:00010000:1.0:1746143771.053634:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b9500 00000100:00100000:0.0:1746143771.062606:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.062675:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622243968 00000100:00100000:1.0:1746143771.062681:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622243968 00000100:00100000:1.0:1746143771.062711:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11184 00000100:00100000:1.0:1746143771.062718:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:31816:x1830963622243968:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143771.062731:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.062745:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b25800/0x87925e4cb73a7584 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a002 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.062773:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73a74d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa7 expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.062780:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143771.062781:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143771.062785:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25800/0x87925e4cb73a7584 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2535424->2990079] (req 2535424->2990079) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a002 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.062809:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73a74d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa7 expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.062818:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73a74d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa7 expref: 36 pid: 13436 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.062829:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626646912:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.063141:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.065839:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626646912:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.065863:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b25800/0x87925e4cb73a7584 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2535424->2990079] (req 2535424->2990079) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a002 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.065878:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25800, rc 0) 00000100:00100000:1.0:1746143771.065936:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:31816:x1830963622243968:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3218us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.065944:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11184 00000100:00100000:0.0:1746143771.067147:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.067190:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.067285:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622244224 00000100:00100000:1.0:1746143771.067291:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622244224 00000100:00100000:1.0:1746143771.068041:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11185 00000100:00100000:1.0:1746143771.068048:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:31812:x1830963622244224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143771.068074:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.068088:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a758b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a009 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.068110:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143771.068112:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143771.068115:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a758b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a009 expref: 40 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.068124:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a758b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a009 expref: 40 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.068131:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2db400, rc 0) 00000100:00100000:0.0:1746143771.068167:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:31812:x1830963622244224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 119us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.068173:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11185 00000100:00100000:0.0:1746143771.069098:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.077298:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.077575:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.077754:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622244736 00000100:00100000:1.0:1746143771.077766:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622244736 00010000:00010000:1.0:1746143771.077803:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73a74d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa7 expref: 40 pid: 13436 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.077840:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5202 00000100:00100000:1.0:1746143771.077847:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622244736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.077860:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.077876:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73a74d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa7 expref: 40 pid: 13436 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.077885:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73a74d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa7 expref: 40 pid: 13436 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.077905:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73a74d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa7 expref: 40 pid: 13436 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.077949:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.077951:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.077957:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b25800/0x87925e4cb73a7584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2535424->2990079) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a002 expref: 26 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.077963:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25800/0x87925e4cb73a7584 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2535424->2990079) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a002 expref: 26 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.077973:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.077974:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.077989:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a758b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a009 expref: 39 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.077995:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a758b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a009 expref: 39 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.078022:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a758b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a009 expref: 39 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.078033:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626647168:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143771.078107:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b25800/0x87925e4cb73a7584 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2535424->2990079) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a002 expref: 26 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.078115:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626647296:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143771.078133:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.078662:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.079485:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626647168:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143771.079495:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626647296:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143771.079508:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.079530:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963622244736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1684us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.079538:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5202 00000100:00100000:0.0:1746143771.079663:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.079766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.080099:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.081899:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.084401:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622245888 00000100:00100000:1.0:1746143771.084410:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622245888 00010000:00010000:1.0:1746143771.084446:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73a72d6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e7a expref: 287 pid: 6587 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.084477:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5203 00000100:00100000:1.0:1746143771.084484:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+287:2010:x1830963622245888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.084497:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.084502:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73a72d6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e7a expref: 287 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.084512:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73a72d6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e7a expref: 287 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.084534:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73a72d6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e7a expref: 287 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.084564:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143771.084569:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a75ae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.084578:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a75ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.084586:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a75ae lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.084609:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.084640:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:2010:x1830963622245888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 156us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.084646:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5203 00000100:00100000:0.0:1746143771.088850:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.088955:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622246272 00000100:00100000:1.0:1746143771.088998:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622246272 00010000:00010000:1.0:1746143771.089030:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a7457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f61 expref: 41 pid: 3135 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.089063:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5204 00000100:00100000:1.0:1746143771.089069:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622246272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.089081:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.089094:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a7457 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f61 expref: 41 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.089105:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a7457 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f61 expref: 41 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.089142:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a7457 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409f61 expref: 41 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.089157:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.089159:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.089165:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73a7592 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a010 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.089176:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73a7592 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a010 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.089207:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73a7592 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a010 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.089227:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626647552:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143771.089291:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.089304:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.089333:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.089350:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:1.0:1746143771.089416:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143771.089421:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143771.090340:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622246784 00000100:00100000:0.0:1746143771.090347:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622246784 00000100:00100000:0.0:1746143771.090384:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11190 00000100:00100000:0.0:1746143771.090390:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622246784:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143771.090397:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.090407:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73a75ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a033 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.090419:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.090421:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.090426:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73a75ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a033 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.090436:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73a75ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a033 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.090443:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de82600, rc 0) 00000100:00100000:0.0:1746143771.090474:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622246784:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 83us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.090480:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11190 00000100:00100000:0.0:1746143771.090973:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.091013:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.091044:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.091963:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626647552:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143771.091975:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.092014:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622246272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2944us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.092022:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5204 00000100:00100000:0.0:1746143771.093943:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.094030:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622247424 00000100:00100000:1.0:1746143771.094037:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622247424 00000100:00100000:0.0:1746143771.094045:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.094091:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622247552 00000100:00100000:1.0:1746143771.094093:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622247552 00000100:00100000:1.0:1746143771.094106:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11193 00000100:00100000:1.0:1746143771.094112:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622247424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.094126:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.094137:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73a75df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a048 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.094153:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.094154:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.094160:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73a75df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a048 expref: 42 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.094169:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73a75df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a048 expref: 43 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.094179:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25c00, rc 0) 00000100:00100000:1.0:1746143771.094208:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622247424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 96us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.094213:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11193 00000100:00100000:0.0:1746143771.094398:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.098760:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.099820:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.103272:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.103590:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622248448 00000100:00100000:1.0:1746143771.103596:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622248448 00010000:00010000:1.0:1746143771.103624:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a75ae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a017 expref: 13 pid: 6587 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.103706:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5205 00000100:00100000:1.0:1746143771.103713:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622248448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.103725:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.103731:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a75ae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a017 expref: 13 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.103740:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a75ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a017 expref: 13 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.103944:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73a75ae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a017 expref: 13 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.104023:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143771.104028:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a75f4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.104036:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a75f4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.104043:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a75f4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.104195:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.104241:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622248448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 528us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.104247:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5205 00000100:00100000:0.0:1746143771.106534:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.107395:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.107427:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.108052:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.108559:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.108574:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622249088 00000100:00100000:1.0:1746143771.108578:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622249088 00010000:00010000:1.0:1746143771.108592:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a75f4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a056 expref: 14 pid: 6587 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.108622:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5206 00000100:00100000:1.0:1746143771.108627:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622249088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.108635:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.108639:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a75f4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a056 expref: 14 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.108647:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a75f4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a056 expref: 14 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.108658:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a75f4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a056 expref: 14 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.108667:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143771.108671:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a7609 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.108681:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a7609 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.108686:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a7609 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.108698:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.108708:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622249088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.108713:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5206 00000100:00100000:0.0:1746143771.110181:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.110426:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.110466:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.110520:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622249344 00000100:00100000:1.0:1746143771.110524:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622249344 00000100:00100000:1.0:1746143771.110540:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622249472 00000100:00100000:1.0:1746143771.110542:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622249472 00000100:00100000:1.0:1746143771.110557:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11199 00000100:00100000:1.0:1746143771.110562:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622249344:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143771.110568:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.110574:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73a762c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a080 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.110587:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73a762c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a080 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.110594:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73a762c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a080 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.110601:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24000, rc 0) 00000100:00100000:1.0:1746143771.110616:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622249344:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 54us (191us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.110621:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11199 00000100:00100000:1.0:1746143771.110628:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11200 00000100:00100000:1.0:1746143771.110633:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622249472:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143771.110638:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.110646:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73a7633 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a087 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.110671:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626648192:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.110701:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.111744:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.111950:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626648192:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143771.111967:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73a7633 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a087 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.111976:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73a7633 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a087 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.111998:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25200, rc 0) 00000100:00100000:1.0:1746143771.112027:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622249472:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1394us (1561us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.112033:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11200 00000100:00100000:0.0:1746143771.113959:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.114001:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.114080:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622249984 00000100:00100000:1.0:1746143771.114084:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622249984 00000100:00100000:1.0:1746143771.114124:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4613 00000100:00100000:1.0:1746143771.114130:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+286:31812:x1830963622249984:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143771.114263:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+287:31812:x1830963622249984:12345-192.168.202.3@tcp:35:cat.0 Request processed in 132us (309us total) trans 8589943418 rc 0/0 00000100:00100000:1.0:1746143771.114268:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4613 00000100:00100000:0.0:1746143771.115898:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.115969:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.116047:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622250624 00000100:00100000:1.0:1746143771.116050:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622250624 00000100:00100000:1.0:1746143771.116069:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11202 00000100:00100000:1.0:1746143771.116074:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622250624:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143771.116096:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.116106:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a7506 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fbc expref: 41 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.116114:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7fc00/0x87925e4cb73a75c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a02c expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.116124:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082084c00/0x87925e4cb73a7553 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fd1 expref: 26 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.116130:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.116131:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.116134:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.116159:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082084c00/0x87925e4cb73a7553 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fd1 expref: 26 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.116172:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082084c00/0x87925e4cb73a7553 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fd1 expref: 26 pid: 3135 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.116183:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626648320:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.116261:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7fc00/0x87925e4cb73a75c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a02c expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.116269:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7fc00/0x87925e4cb73a75c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a02c expref: 10 pid: 9839 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.116275:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626648576:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.116431:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a7506 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fbc expref: 41 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.116440:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a7506 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fbc expref: 41 pid: 3135 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.116447:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626648960:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.116465:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.116677:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.116691:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622250880 00000100:00100000:0.0:1746143771.116694:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622250880 00000100:00100000:1.0:1746143771.116778:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.117018:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.117063:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622250496 00000100:00100000:0.0:1746143771.117067:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622250496 00000100:00100000:0.0:1746143771.117085:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11203 00000100:00100000:0.0:1746143771.117090:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622250880:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143771.117107:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.117117:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b25800/0x87925e4cb73a7584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2535424->2990079) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a002 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.117124:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a758b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a009 expref: 40 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.117129:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143771.117130:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143771.117132:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 5/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.117147:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a758b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a009 expref: 40 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.117155:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a758b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a009 expref: 40 pid: 9839 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143771.117163:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626649088:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143771.117192:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b25800/0x87925e4cb73a7584 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2535424->2990079) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a002 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.117199:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b25800/0x87925e4cb73a7584 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2535424->2990079) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a002 expref: 25 pid: 9839 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143771.117205:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626649344:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143771.117219:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.117534:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.118392:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626648320:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143771.121459:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.121485:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.121511:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.121538:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.121571:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626649088:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143771.121588:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.121608:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626649216:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143771.121631:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626649344:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143771.121650:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.121768:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5209 00000100:00100000:1.0:1746143771.121775:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2011:x1830963622251392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.121783:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.121795:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082084c00/0x87925e4cb73a7553 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fd1 expref: 27 pid: 3135 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.121804:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082084c00/0x87925e4cb73a7553 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fd1 expref: 27 pid: 3135 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.121814:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084c00/0x87925e4cb73a7553 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fd1 expref: 27 pid: 3135 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.121822:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.121840:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622251392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.121846:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5209 00010000:00010000:1.0:1746143771.121890:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7fc00/0x87925e4cb73a75c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a02c expref: 13 pid: 9839 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.121898:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626648576:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.121929:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626648960:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.121942:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.122287:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626649472:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.122294:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626649600:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.122307:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.123136:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622252032 00000100:00100000:0.0:1746143771.123140:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622252032 00010000:00010000:0.0:1746143771.123156:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a7506 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fbc expref: 42 pid: 3135 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143771.123176:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5212 00000100:00100000:0.0:1746143771.123181:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622252032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143771.123188:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143771.123196:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a7506 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fbc expref: 43 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.123205:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a7506 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fbc expref: 43 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.123216:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a7506 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fbc expref: 43 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.123228:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.123229:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.123232:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123239:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123253:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.123268:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622252032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.123274:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5212 00000100:00100000:0.0:1746143771.123325:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.123349:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.123373:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.123384:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.123395:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.123423:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.123454:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.123466:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622252800 00000100:00100000:0.0:1746143771.123468:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622252800 00010000:00010000:0.0:1746143771.123479:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a758b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a009 expref: 41 pid: 9839 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.123485:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622253056 00000100:00100000:1.0:1746143771.123489:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622253056 00000100:00100000:0.0:1746143771.123492:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5217 00000100:00100000:0.0:1746143771.123497:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2010:x1830963622252544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143771.123503:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746143771.123504:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (3792896->4194303) req@ffff8800939a6d80 x1830963622253056/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746143771.123509:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73a731c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e96 expref: 26 pid: 3135 timeout: 930 lvb_type: 0 00002000:00100000:1.0:1746143771.123511:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a6d80 with x1830963622253056 ext(3792896->4194303) 00010000:00010000:1.0:1746143771.123515:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a74ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa0 expref: 40 pid: 13436 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.123517:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73a731c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e96 expref: 26 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.123523:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a74ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa0 expref: 40 pid: 13436 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.123527:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73a731c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409e96 expref: 26 pid: 3135 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746143771.123529:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800939a6d80 00010000:00010000:0.0:1746143771.123536:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.123537:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143771.123540:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1329 00010000:00010000:0.0:1746143771.123540:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.123545:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622253056:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:0.0:1746143771.123546:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123557:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.123571:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622252544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.123576:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5217 00010000:00010000:0.0:1746143771.123598:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73a75df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a048 expref: 38 pid: 9587 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746143771.123607:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626649856:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143771.123620:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73a7592 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a010 expref: 27 pid: 9839 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.123623:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.123627:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626649984:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.123631:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123639:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a766b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123641:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123646:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a766b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123648:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123654:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123656:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a766b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123659:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d7d200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143771.123661:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123666:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a766b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123667:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123671:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a766b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123676:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123677:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a766b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123681:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73a7664 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123681:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a53800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143771.123683:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a766b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123689:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a766b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123697:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a766b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.123702:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a766b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.123708:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622250496:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 6601us (6930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.123714:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11204 00010000:00010000:1.0:1746143771.123729:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123735:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.123738:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622250752:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 6374us (6720us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.123744:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11205 00010000:00010000:1.0:1746143771.123746:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123752:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123757:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123762:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b25a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143771.123764:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123770:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123778:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.123783:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a7656 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.123812:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622250624:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 7737us (7843us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.123818:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11202 00000100:00100000:1.0:1746143771.129222:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622253056:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5668us (5759us total) trans 17179872886 rc 0/0 00000100:00100000:1.0:1746143771.129235:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1329 00002000:00100000:1.0:1746143771.129244:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (3792896->4194303) req@ffff8800939a6d80 x1830963622253056/t17179872886(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.129253:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a6d80 with x1830963622253056 ext(3792896->4194303) 00010000:00010000:1.0:1746143771.129262:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a74ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa0 expref: 42 pid: 13436 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.129273:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a74ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409fa0 expref: 42 pid: 13436 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746143771.129279:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800939a6d80 00000100:00100000:0.0:1746143771.132031:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.132360:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143771.132956:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.133043:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.133054:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.133059:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.133065:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.133075:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8b400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143771.133077:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.133082:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.133091:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.133097:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a765d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.133147:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2011:x1830963622250880:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 16056us (16469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.133154:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11203 00000100:00100000:0.0:1746143771.136284:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.136370:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.136447:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622253824 00000100:00100000:1.0:1746143771.136450:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622253824 00002000:00100000:1.0:1746143771.136474:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff8800939a4700 x1830963622253824/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.136483:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a4700 with x1830963622253824 ext(2097152->3145727) 00002000:00010000:1.0:1746143771.136487:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a4700 00000100:00100000:1.0:1746143771.136511:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3079 00000100:00100000:1.0:1746143771.136516:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622253824:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143771.139750:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622254080 00000100:00100000:0.0:1746143771.139758:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622254080 00010000:00010000:0.0:1746143771.139791:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a6e45 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bbe expref: 287 pid: 10936 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143771.139815:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622253952 00000100:00100000:0.0:1746143771.139818:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622253952 00010000:00010000:0.0:1746143771.139827:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6e3e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb7 expref: 38 pid: 7244 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143771.139854:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5222 00000100:00100000:0.0:1746143771.139860:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+287:2010:x1830963622254080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143771.139870:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143771.139875:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a6e45 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bbe expref: 287 pid: 10936 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.139884:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a6e45 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bbe expref: 287 pid: 10936 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.139901:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5223 00010000:00010000:0.0:1746143771.139902:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a6e45 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bbe expref: 287 pid: 10936 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.139925:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:2010:x1830963622253952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143771.139930:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143771.139934:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143771.139935:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a7680 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.139939:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6e3e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb7 expref: 38 pid: 7244 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.139943:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143771.139948:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6e3e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb7 expref: 38 pid: 7244 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.139959:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73a6e3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb7 expref: 38 pid: 7244 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.139972:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143771.139975:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a7680 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.139991:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.139991:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:2010:x1830963622254080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 131us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.139998:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5222 00000100:00100000:1.0:1746143771.140010:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+37:2010:x1830963622253952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.140017:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5223 00000100:00100000:0.0:1746143771.140054:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622254208 00000100:00100000:0.0:1746143771.140057:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622254208 00010000:00010000:0.0:1746143771.140066:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb0 expref: 286 pid: 7243 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143771.140083:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5224 00000100:00100000:0.0:1746143771.140087:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:2010:x1830963622254208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143771.140093:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143771.140096:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb0 expref: 286 pid: 7243 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.140103:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb0 expref: 286 pid: 7243 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.140112:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523000/0x87925e4cb73a6e37 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409bb0 expref: 286 pid: 7243 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.140119:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143771.140121:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a7680 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143771.140126:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.140148:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+285:2010:x1830963622254208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.140154:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5224 00000100:00100000:0.0:1746143771.142678:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.142708:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.142850:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622254464 00000100:00100000:1.0:1746143771.142854:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622254464 00010000:00010000:1.0:1746143771.142867:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a708a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d0e expref: 285 pid: 6587 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.142903:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5226 00000100:00100000:1.0:1746143771.142906:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+285:2008:x1830963622254464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.142936:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.142940:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a708a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d0e expref: 285 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.142950:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a708a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d0e expref: 285 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.142995:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d200/0x87925e4cb73a708a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248409d0e expref: 285 pid: 6587 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.143008:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143771.143012:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a7680 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.143018:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a7680 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.143023:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a7680 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.143038:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.143081:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:2008:x1830963622254464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 174us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.143085:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5226 00000100:00100000:1.0:1746143771.143157:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622253824:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6643us (6789us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.143163:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3079 00002000:00100000:1.0:1746143771.143171:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff8800939a4700 x1830963622253824/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.143177:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a4700 with x1830963622253824 ext(2097152->3145727) 00002000:00010000:1.0:1746143771.143181:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a4700 00000100:00100000:0.0:1746143771.146258:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143771.147374:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943420 is committed 00000004:00080000:0.0:1746143771.147380:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1790 committed 00000004:00080000:0.0:1746143771.147395:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1817 committed 00000004:00080000:0.0:1746143771.147400:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1816 committed 00000004:00080000:0.0:1746143771.147402:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1815 committed 00000004:00080000:0.0:1746143771.147404:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1814 committed 00000004:00080000:0.0:1746143771.147406:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1789 committed 00000004:00080000:0.0:1746143771.147408:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1813 committed 00000004:00080000:0.0:1746143771.147409:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1788 committed 00000004:00080000:0.0:1746143771.147410:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1812 committed 00000004:00080000:0.0:1746143771.147412:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1787 committed 00000004:00080000:0.0:1746143771.147413:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1786 committed 00000004:00080000:0.0:1746143771.147415:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1785 committed 00000004:00080000:0.0:1746143771.147417:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1811 committed 00000004:00080000:0.0:1746143771.147418:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1810 committed 00000004:00080000:0.0:1746143771.147419:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1784 committed 00000004:00080000:0.0:1746143771.147421:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1783 committed 00000004:00080000:0.0:1746143771.147422:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1809 committed 00000001:00080000:0.0:1746143771.147429:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943418 is committed 00000001:00080000:0.0:1746143771.147433:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943416 is committed 00000100:00100000:1.0:1746143771.147527:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626651136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.147561:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143771.147580:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626651648:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.147596:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143771.147614:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143771.147618:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626651008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.147631:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143771.147655:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626651520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.147669:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143771.147687:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626651520 00000100:00100000:1.0:1746143771.147690:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626651520 00000100:00100000:1.0:1746143771.147707:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11211 00000100:00100000:1.0:1746143771.147711:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3774:x1830963626651648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.147755:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626651392 00000100:00100000:1.0:1746143771.147758:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626651392 00000100:00100000:1.0:1746143771.147769:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11212 00000100:00100000:1.0:1746143771.147773:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963626651008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143771.147798:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11213 00000100:00100000:0.0:1746143771.147804:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963626651520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143771.147815:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11215 00000100:00100000:0.0:1746143771.147820:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3772:x1830963626651904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.147845:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626652032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.147863:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143771.147873:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626652544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.147886:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143771.147895:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143771.147899:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626652160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.147926:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143771.147935:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626652672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.147948:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143771.147963:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626652416 00000100:00100000:1.0:1746143771.147966:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626652416 00000100:00100000:1.0:1746143771.147990:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626652032 00000100:00100000:1.0:1746143771.147993:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626652032 00000100:00100000:1.0:1746143771.148000:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626652928 00000100:00100000:1.0:1746143771.148002:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626652928 00000100:00100000:1.0:1746143771.148007:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626652544 00000100:00100000:1.0:1746143771.148009:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626652544 00000100:00100000:1.0:1746143771.148014:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626652160 00000100:00100000:1.0:1746143771.148015:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626652160 00000100:00100000:1.0:1746143771.148021:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626652672 00000100:00100000:1.0:1746143771.148022:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626652672 00000100:00100000:1.0:1746143771.148029:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11216 00000100:00100000:1.0:1746143771.148033:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3772:x1830963626652416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143771.148092:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143771.148095:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143771.148097:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:1.0:1746143771.148099:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143771.148101:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143771.148120:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963626652416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (279us total) trans 17179872887 rc 0/0 00000004:00080000:0.0:1746143771.148346:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093725180/2, rc 0, transno 17179872888 00000100:00100000:0.0:1746143771.148351:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626652032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.148506:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11216 00000100:00100000:1.0:1746143771.148517:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11222 00000100:00100000:1.0:1746143771.148522:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963626652288:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143771.148662:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093725f80/2, rc 0, transno 17179872891 00000100:00100000:0.0:1746143771.148666:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626652160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143771.148673:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093727100/2, rc 0, transno 17179872890 00000100:00100000:0.0:1746143771.148676:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626652544:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143771.148688:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143771.148691:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143771 -> 1746143771 00002000:00010000:1.0:1746143771.148693:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143771 -> 1746143771 00002000:00010000:1.0:1746143771.148695:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143771 -> 1746143771 00002000:00010000:1.0:1746143771.148696:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143771.148717:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963626652288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (298us total) trans 17179872894 rc 0/0 00000100:00100000:0.0:1746143771.148725:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963626651648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1013us (1128us total) trans 21474840208 rc 0/0 00000100:00100000:1.0:1746143771.148727:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11222 00000100:00100000:0.0:1746143771.148730:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11211 00000100:00100000:1.0:1746143771.148819:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3774:x1830963626651008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1044us (1186us total) trans 21474840210 rc 0/0 00000100:00100000:0.0:1746143771.148821:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3774:x1830963626651520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1018us (1151us total) trans 21474840211 rc 0/0 00000100:00100000:1.0:1746143771.148824:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11212 00000100:00100000:0.0:1746143771.148827:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11213 00000004:00080000:1.0:1746143771.148845:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009391df80/2, rc 0, transno 21474840210 00000100:00100000:1.0:1746143771.148848:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626651008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143771.148855:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009391f800/2, rc 0, transno 21474840211 00000100:00100000:1.0:1746143771.148858:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626651520:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143771.148864:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009391fb80/2, rc 0, transno 21474840207 00000100:00100000:1.0:1746143771.148866:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626651136:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143771.148871:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009391ca80/2, rc 0, transno 21474840208 00000100:00100000:1.0:1746143771.148874:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626651648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143771.148880:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963626651392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1072us (1134us total) trans 21474840212 rc 0/0 00000100:00100000:0.0:1746143771.148885:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11214 00000100:00100000:1.0:1746143771.148900:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746143771.148905:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626653056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.148938:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143771.148950:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963626651904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1130us (1178us total) trans 21474840213 rc 0/0 00000100:00100000:1.0:1746143771.148955:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626653056 00000100:00100000:0.0:1746143771.148956:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11215 00000100:00100000:1.0:1746143771.148957:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626653056 00000100:00100000:1.0:1746143771.148971:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11225 00000100:00100000:1.0:1746143771.148976:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963626653056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.149037:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963626653056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (98us total) trans 21474840214 rc 0/0 00000100:00100000:1.0:1746143771.149044:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11225 00000004:00080000:0.0:1746143771.149196:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373ba300/2, rc 0, transno 21474840214 00000100:00100000:0.0:1746143771.149200:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626653056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143771.149423:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093726d80/2, rc 0, transno 17179872892 00000100:00100000:0.0:1746143771.149426:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626652672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143771.150015:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.150066:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.150158:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12722 00000100:00100000:0.0:1746143771.150167:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31818:x1830963622254720:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143771.150189:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.150206:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a768e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a0a3 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.150254:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a768e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0a3 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.150342:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a768e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0a3 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.150358:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143771.150361:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143771.150364:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d800, rc 0) 00000100:00100000:0.0:1746143771.150412:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31818:x1830963622254720:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 246us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.150417:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12722 00000100:00100000:0.0:1746143771.152538:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.155190:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.155222:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.155244:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.155265:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.155278:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.155278:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622255360 00000100:00100000:0.0:1746143771.155282:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622255360 00000100:00100000:1.0:1746143771.155304:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.155322:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622255744 00000100:00100000:0.0:1746143771.155324:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622255744 00000100:00100000:1.0:1746143771.155335:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11227 00000100:00100000:1.0:1746143771.155342:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622255488:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143771.155345:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11229 00000100:00100000:0.0:1746143771.155349:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622255232:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143771.155357:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143771.155358:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11230 00000100:00100000:1.0:1746143771.155362:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622255616:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143771.155369:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.155373:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a76b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a0bf expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.155377:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7f400/0x87925e4cb73a76bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a0d4 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143771.155392:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a1a, atime: 0x68140a1a, ctime: 0x68140a1a, blocks: 0x808 00010000:00010000:1.0:1746143771.155397:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.155399:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.155401:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.155403:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.155408:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7f400/0x87925e4cb73a76bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0d4 expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.155408:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a76b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0bf expref: 12 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.155421:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7f400/0x87925e4cb73a76bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0d4 expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.155427:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a76b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0bf expref: 12 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.155430:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7f400, rc 0) 00010000:00010000:0.0:1746143771.155432:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25a00, rc 0) 00000100:00100000:0.0:1746143771.155461:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622255232:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 110us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.155465:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622255616:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 101us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.155480:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11229 00000100:00100000:1.0:1746143771.155487:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11230 00010000:00010000:1.0:1746143771.155504:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.155513:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a76cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a0cd expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143771.155525:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a1b, atime: 0x68140a1b, ctime: 0x68140a1b, blocks: 0x808 00010000:00010000:1.0:1746143771.155533:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.155534:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.155539:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a76cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0cd expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.155548:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a76cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0cd expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.155555:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ec00, rc 0) 00000100:00100000:1.0:1746143771.155572:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622255488:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 231us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.155577:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11227 00000100:00100000:0.0:1746143771.156557:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.156593:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.156610:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622256128 00000100:00100000:1.0:1746143771.156615:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622256128 00002000:00100000:1.0:1746143771.156646:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff8800939a5c00 x1830963622256128/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.156656:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5c00 with x1830963622256128 ext(3145728->4194303) 00002000:00010000:1.0:1746143771.156660:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a5c00 00000100:00100000:1.0:1746143771.156687:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3080 00000100:00100000:1.0:1746143771.156693:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622256128:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143771.160423:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.160458:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.160544:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622256384 00000100:00100000:1.0:1746143771.160554:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622256384 00000100:00100000:1.0:1746143771.160693:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11232 00000100:00100000:1.0:1746143771.160702:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622256384:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143771.160856:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622256384:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 155us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.160862:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11232 00000100:00100000:0.0:1746143771.164378:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.164420:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.164445:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.164474:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.164563:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622257024 00000100:00100000:1.0:1746143771.164566:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622257024 00000100:00100000:1.0:1746143771.164600:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622256640 00000100:00100000:1.0:1746143771.164602:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622256640 00000100:00100000:1.0:1746143771.164611:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622256896 00000100:00100000:1.0:1746143771.164613:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622256896 00000100:00100000:1.0:1746143771.164629:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11234 00000100:00100000:1.0:1746143771.164636:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622257024:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143771.164702:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11236 00000100:00100000:1.0:1746143771.164749:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622257024:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 113us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.164756:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11234 00000100:00100000:1.0:1746143771.165218:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622256128:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8525us (8663us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143771.165221:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622256896:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143771.165225:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3080 00002000:00100000:1.0:1746143771.165233:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff8800939a5c00 x1830963622256128/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.165242:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5c00 with x1830963622256128 ext(3145728->4194303) 00002000:00010000:1.0:1746143771.165247:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a5c00 00000100:00100000:0.0:1746143771.165260:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622256896:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 551us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.165269:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11236 00000100:00100000:0.0:1746143771.167158:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.167188:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.167201:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.167215:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.167230:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622257280 00000100:00100000:0.0:1746143771.167237:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622257280 00000100:00100000:0.0:1746143771.167265:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622257536 00000100:00100000:0.0:1746143771.167266:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622257536 00000100:00100000:0.0:1746143771.167277:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622257792 00000100:00100000:0.0:1746143771.167278:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622257792 00000100:00100000:0.0:1746143771.167299:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11238 00000100:00100000:0.0:1746143771.167305:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622257280:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143771.167341:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11240 00000100:00100000:1.0:1746143771.167352:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622257792:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143771.167377:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622257280:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.167387:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11238 00000100:00100000:1.0:1746143771.167419:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622257792:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.167421:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.167427:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11240 00000100:00100000:0.0:1746143771.167459:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.167494:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622257664 00000100:00100000:1.0:1746143771.167500:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622257664 00000100:00100000:1.0:1746143771.167526:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11243 00000100:00100000:1.0:1746143771.167530:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622257664:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143771.167572:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622257664:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 41us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.167577:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11243 00000100:00100000:0.0:1746143771.170843:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.170906:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622257920 00000100:00100000:1.0:1746143771.170943:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622257920 00000100:00100000:1.0:1746143771.171003:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11244 00000100:00100000:1.0:1746143771.171051:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622257920:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:1.0:1746143771.171212:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143771.171215:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143771.171217:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:1.0:1746143771.171219:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143771.171221:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143771.171284:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622257920:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 273us (451us total) trans 17179872895 rc 0/0 00000100:00100000:1.0:1746143771.171291:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11244 00000100:00100000:0.0:1746143771.171679:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.171708:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.171728:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622258048 00000100:00100000:0.0:1746143771.171731:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.171732:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622258048 00000100:00100000:1.0:1746143771.171856:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622258304 00000100:00100000:1.0:1746143771.171859:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622258304 00000100:00100000:1.0:1746143771.171872:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622258176 00000100:00100000:1.0:1746143771.171873:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622258176 00000100:00100000:0.0:1746143771.171874:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.171895:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11245 00000100:00100000:1.0:1746143771.171900:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2010:x1830963622258048:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143771.171904:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11246 00010000:00010000:1.0:1746143771.171924:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143771.171932:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2010:x1830963622258304:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.171937:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a76d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a0e2 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.171940:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.171949:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a76db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a0f0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.171953:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.171955:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.171960:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.171961:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.171962:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a76d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0e2 expref: 28 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.171966:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a76db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f0 expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.171974:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a76d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0e2 expref: 28 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.171976:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a76db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f0 expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.171996:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e29a00, rc 0) 00010000:00010000:0.0:1746143771.171996:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8b000, rc 0) 00000100:00100000:1.0:1746143771.172018:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2010:x1830963622258048:12345-192.168.202.3@tcp:101:cat.0 Request processed in 117us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.172018:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2010:x1830963622258304:12345-192.168.202.3@tcp:101:cat.0 Request processed in 108us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.172023:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11245 00000100:00100000:0.0:1746143771.172027:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11246 00000100:00100000:0.0:1746143771.173117:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.174646:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.177964:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.178053:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.178084:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.178155:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.178259:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3084 00000100:00100000:1.0:1746143771.178272:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622259456:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143771.178306:0:20386:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a76f7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.178324:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.178326:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.178329:0:20386:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a76f7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.178340:0:20386:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a76f7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.178379:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3086 00000100:00100000:1.0:1746143771.178384:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622259968:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143771.178399:0:29558:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a7705 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.178405:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.178406:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.178409:0:29558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a7705 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.178416:0:29558:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a7705 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.181076:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.183002:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.183039:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143771.184816:0:29558:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a7705 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.184827:0:29558:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a7705 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.184840:0:29558:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a7705 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.184845:0:29558:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e28c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143771.184849:0:29558:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a7705 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.184855:0:29558:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a7705 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.184870:0:29558:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a7705 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.184874:0:29558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e28c00/0x87925e4cb73a7705 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.184938:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622259968:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 6550us (6779us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.184946:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3086 00000100:00100000:0.0:1746143771.187301:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.187359:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622260992 00000100:00100000:1.0:1746143771.187370:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622260992 00000100:00100000:1.0:1746143771.187429:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4614 00000100:00100000:1.0:1746143771.187437:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31817:x1830963622260992:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143771.188507:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31817:x1830963622260992:12345-192.168.202.3@tcp:35:cat.0 Request processed in 1068us (1210us total) trans 8589943421 rc 0/0 00000100:00100000:1.0:1746143771.188515:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4614 00010000:00010000:1.0:1746143771.196237:0:20386:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a76f7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.196252:0:20386:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a76f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.196259:0:20386:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a76f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.196264:0:20386:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e28a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143771.196268:0:20386:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a76f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.196274:0:20386:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a76f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.196290:0:20386:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a76f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.196297:0:20386:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73a76f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.196364:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622259456:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 18093us (18307us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.196373:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3084 00000100:00100000:0.0:1746143771.210508:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622261504 00000100:00100000:0.0:1746143771.210518:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622261504 00000100:00100000:0.0:1746143771.210582:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12725 00000100:00100000:0.0:1746143771.210590:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31825:x1830963622261504:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143771.210620:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.210642:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a7721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a105 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.210710:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622261248 00000100:00100000:1.0:1746143771.210715:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622261248 00000100:00100000:1.0:1746143771.210753:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12726 00000100:00100000:1.0:1746143771.210758:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+260:31824:x1830963622261248:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143771.210768:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.210775:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a7728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a0fe expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.210790:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73a772f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143771.210803:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73a772f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.210804:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.210812:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73a772f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.210813:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143771.210819:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.210824:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73a773d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143771.210826:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73a7744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.210830:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73a773d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143771.210835:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73a773d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143771.210964:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a774b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143771.210974:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73a7641 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a08e expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.210989:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a774b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143771.211019:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73a7641 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a08e expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.211035:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73a7641 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a08e expref: 8 pid: 6587 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143771.211047:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626653184:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143771.211130:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00010000:00010000:1.0:1746143771.211306:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73a7744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143771.211314:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73a7744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143771.211355:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143771.211362:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143771.211367:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746143771.212964:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143771.214960:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.214971:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746143771.214992:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143771.215054:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215061:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215066:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215070:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a52600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143771.215074:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215079:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215086:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143771.215088:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143771.215091:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215096:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52600/0x87925e4cb73a7752 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215124:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215463:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215470:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215475:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215531:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143771.215542:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215547:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215554:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143771.215556:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143771.215559:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215563:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a7736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215573:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73a7744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215582:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73a7744 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215586:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73a7744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215590:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a52c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143771.215593:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73a7744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215598:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73a7744 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215604:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fee7d00) 00010000:00010000:0.0:1746143771.215606:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143771.215608:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73a7744 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215612:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73a7744 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.215720:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a7728 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0fe expref: 262 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.215727:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a7728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0fe expref: 262 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.215734:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32c00, rc 0) 00000100:00100000:0.0:1746143771.215759:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+261:31824:x1830963622261248:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5000us (5088us total) trans 8589943423 rc 301/301 00000100:00100000:0.0:1746143771.215764:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12726 00000100:00100000:0.0:1746143771.215799:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.216000:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622262016 00000100:00100000:1.0:1746143771.216004:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622262016 00000100:00100000:1.0:1746143771.216028:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11251 00000100:00100000:1.0:1746143771.216034:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622262016:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:1.0:1746143771.216099:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143771.216101:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143770 -> 1746143771 00002000:00010000:1.0:1746143771.216103:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143770 -> 1746143771 00002000:00010000:1.0:1746143771.216105:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143770 -> 1746143771 00002000:00010000:1.0:1746143771.216107:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:1.0:1746143771.216122:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622262016:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 88us (323us total) trans 21474840216 rc 0/0 00000100:00100000:1.0:1746143771.216127:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11251 00000100:00100000:1.0:1746143771.216251:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.216262:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622262400 00000100:00100000:1.0:1746143771.216265:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622262400 00000100:00100000:1.0:1746143771.216277:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11252 00000100:00100000:1.0:1746143771.216281:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622262400:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:1.0:1746143771.216318:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746143771.216452:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11254 00000100:00100000:0.0:1746143771.216458:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622262272:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143771.216501:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143771.216503:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143771 -> 1746143771 00002000:00010000:0.0:1746143771.216504:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143771 -> 1746143771 00002000:00010000:0.0:1746143771.216506:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143771 -> 1746143771 00002000:00010000:0.0:1746143771.216508:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746143771.216521:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2008:x1830963622262272:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 63us (197us total) trans 17179872898 rc 0/0 00000100:00100000:0.0:1746143771.216528:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11254 00002000:00010000:1.0:1746143771.216705:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143771 -> 1746143771 00002000:00010000:1.0:1746143771.216708:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143771 -> 1746143771 00002000:00010000:1.0:1746143771.216710:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143771 -> 1746143771 00002000:00010000:1.0:1746143771.216711:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143771.216733:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622262400:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 449us (481us total) trans 21474840217 rc 0/0 00000100:00100000:1.0:1746143771.216738:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11252 00000100:00100000:1.0:1746143771.221510:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622262912 00000100:00100000:1.0:1746143771.221520:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622262912 00000100:00100000:1.0:1746143771.221571:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4615 00000100:00100000:1.0:1746143771.221579:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:31818:x1830963622262912:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143771.226255:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:31818:x1830963622262912:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 4661us (4842us total) trans 8589943425 rc 0/0 00000100:00100000:1.0:1746143771.226270:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4615 00000100:00100000:0.0:1746143771.227806:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.229235:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622263168 00000100:00100000:1.0:1746143771.229247:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622263168 00000100:00100000:1.0:1746143771.229309:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4616 00000100:00100000:1.0:1746143771.229316:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:31818:x1830963622263168:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143771.229550:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:31818:x1830963622263168:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 233us (1750us total) trans 8589943426 rc 0/0 00000100:00100000:1.0:1746143771.229556:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4616 00000100:00100000:0.0:1746143771.236372:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.240072:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.240137:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.240194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.241766:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622263552 00000100:00100000:1.0:1746143771.241780:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622263552 00000100:00100000:1.0:1746143771.241829:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622263680 00000100:00100000:1.0:1746143771.241831:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622263680 00000100:00100000:1.0:1746143771.242179:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622263808 00000100:00100000:1.0:1746143771.242182:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622263808 00000100:00100000:0.0:1746143771.242239:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.244078:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.244146:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.244244:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622264064 00000100:00100000:1.0:1746143771.244249:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622264064 00000100:00100000:1.0:1746143771.244268:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622264192 00000100:00100000:1.0:1746143771.244270:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622264192 00000100:00100000:1.0:1746143771.244279:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11260 00000100:00100000:1.0:1746143771.244283:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622264064:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.244290:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.244298:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a77ad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a12f expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.244309:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.244310:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.244316:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a77ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a12f expref: 41 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.244325:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a77ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a12f expref: 41 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.244331:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107a00, rc 0) 00000100:00100000:1.0:1746143771.244350:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622264064:12345-192.168.202.3@tcp:101:cat.0 Request processed in 66us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.244354:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11260 00000100:00100000:1.0:1746143771.244362:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11261 00000100:00100000:1.0:1746143771.244365:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963622264192:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.244370:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.244377:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097106800/0x87925e4cb73a77b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a136 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.244385:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.244386:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.244389:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097106800/0x87925e4cb73a77b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a136 expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.244397:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097106800/0x87925e4cb73a77b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a136 expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.244403:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106800, rc 0) 00000100:00100000:1.0:1746143771.244412:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622264192:12345-192.168.202.3@tcp:101:cat.0 Request processed in 46us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.244419:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11261 00000100:00100000:0.0:1746143771.257326:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.257446:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.257494:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.258573:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.261948:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3092 00000100:00100000:1.0:1746143771.261962:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963622264832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143771.262690:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3093 00000100:00100000:1.0:1746143771.262697:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963622265088:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143771.280756:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963622264832:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18787us (23251us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.280768:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3092 00002000:00100000:1.0:1746143771.280779:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095c6ad80 x1830963622264832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.280787:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6ad80 with x1830963622264832 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.280793:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c6ad80 00000100:00100000:1.0:1746143771.286682:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622265088:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23968us (28094us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.286697:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3093 00002000:00100000:1.0:1746143771.286714:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095c68380 x1830963622265088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.286724:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68380 with x1830963622265088 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.286730:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c68380 00000100:00100000:0.0:1746143771.300399:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.300668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.303073:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622265856 00000100:00100000:1.0:1746143771.303079:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622265856 00002000:00100000:1.0:1746143771.303132:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880095c69880 x1830963622265856/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.303162:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69880 with x1830963622265856 ext(2097152->4194303) 00002000:00010000:1.0:1746143771.303174:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c69880 00000100:00100000:1.0:1746143771.303220:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3094 00000100:00100000:1.0:1746143771.303232:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622265856:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143771.306015:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12729 00000100:00100000:0.0:1746143771.306031:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31825:x1830963622265472:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143771.306057:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.306060:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143771.306090:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73a7695 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0aa expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.306112:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143771.306117:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143771.306128:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a77bb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a13d expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.306177:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.306189:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a7783 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a10c expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.306195:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a768e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0a3 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.306202:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.306232:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a768e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0a3 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.306243:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a768e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0a3 expref: 10 pid: 7245 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143771.306254:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626653312:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143771.306335:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a7783 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a10c expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.306342:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a7783 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a10c expref: 262 pid: 6587 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143771.306349:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626653440:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143771.306367:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.307521:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.307570:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622265984 00000100:00100000:0.0:1746143771.307579:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622265984 00002000:00100000:0.0:1746143771.307613:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880092b63800 x1830963622265984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.307622:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b63800 with x1830963622265984 ext(2097152->4194303) 00002000:00010000:0.0:1746143771.307627:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b63800 00000100:00100000:0.0:1746143771.307650:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3095 00000100:00100000:0.0:1746143771.307655:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622265984:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143771.311273:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.311289:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626653312:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.311301:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626653440:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.311330:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746143771.311350:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.311377:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622266112 00000100:00100000:1.0:1746143771.311382:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622266112 00010000:00010000:1.0:1746143771.311420:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a768e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0a3 expref: 11 pid: 7245 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.311446:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5228 00000100:00100000:1.0:1746143771.311453:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622266112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.311467:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.311473:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a768e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0a3 expref: 11 pid: 7245 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.311482:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a768e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0a3 expref: 11 pid: 7245 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.311505:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73a768e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0a3 expref: 11 pid: 7245 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.311687:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143771.311692:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143771.311701:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143771.311705:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.312366:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622266112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 291us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.312374:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5228 00010000:00010000:0.0:1746143771.312462:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143771.312469:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000040:00080000:0.0:1746143771.312815:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2590, 88 off215632 00000004:00080000:0.0:1746143771.312821:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 830536907974ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143771.312941:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2561, 88 off213432 00000004:00080000:0.0:1746143771.312947:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 830537034418ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143771.313103:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2562, 88 off213520 00000004:00080000:0.0:1746143771.313108:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 830537195573ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143771.313119:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2591, 88 off215720 00000004:00080000:0.0:1746143771.313121:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 830537209086ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143771.313130:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2592, 88 off215808 00000004:00080000:0.0:1746143771.313132:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 830537219934ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143771.313447:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2563, 88 off213608 00000004:00080000:0.0:1746143771.313452:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 830537539972ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143771.313501:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2564, 88 off213696 00000004:00080000:0.0:1746143771.313505:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 830537592454ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143771.313513:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2565, 88 off213784 00000004:00080000:0.0:1746143771.313515:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 830537603082ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143771.313525:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2593, 88 off215896 00000004:00080000:0.0:1746143771.313528:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 830537615494ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143771.313673:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2566, 88 off213872 00000004:00080000:0.0:1746143771.313677:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 830537765097ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143771.313701:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2594, 88 off215984 00000004:00080000:0.0:1746143771.313704:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 830537791874ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143771.313713:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2567, 88 off213960 00000004:00080000:0.0:1746143771.313716:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 830537803747ns, next at 770855090093ns, rc = 0 00000040:00080000:0.0:1746143771.313724:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2595, 88 off216072 00000004:00080000:0.0:1746143771.313726:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 830537813936ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143771.313733:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2596, 88 off216160 00000004:00080000:0.0:1746143771.313736:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 830537823786ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143771.313743:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2597, 88 off216248 00000004:00080000:0.0:1746143771.313746:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 830537833604ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143771.313754:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2598, 88 off216336 00000004:00080000:0.0:1746143771.313756:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 830537844235ns, next at 775898816462ns, rc = 0 00000040:00080000:0.0:1746143771.313764:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2568, 88 off214048 00000004:00080000:0.0:1746143771.313767:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 830537854484ns, next at 770855090093ns, rc = 0 00000001:00080000:0.0:1746143771.316082:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943428 is committed 00000004:00080000:0.0:1746143771.316093:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1798 committed 00000004:00080000:0.0:1746143771.316105:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1826 committed 00000100:00100000:1.0:1746143771.316570:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626653952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.316761:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143771.316782:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1825 committed 00000004:00080000:0.0:1746143771.316785:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1824 committed 00000004:00080000:0.0:1746143771.316787:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1823 committed 00000004:00080000:0.0:1746143771.316788:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1797 committed 00000004:00080000:0.0:1746143771.316790:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1822 committed 00000004:00080000:0.0:1746143771.316792:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1796 committed 00000004:00080000:0.0:1746143771.316793:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1821 committed 00000004:00080000:0.0:1746143771.316794:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1795 committed 00000004:00080000:0.0:1746143771.316795:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1794 committed 00000004:00080000:0.0:1746143771.316796:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1793 committed 00000004:00080000:0.0:1746143771.316797:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1820 committed 00000004:00080000:0.0:1746143771.316799:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1819 committed 00000004:00080000:0.0:1746143771.316800:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1792 committed 00000004:00080000:0.0:1746143771.316801:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1791 committed 00000004:00080000:0.0:1746143771.316806:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1818 committed 00000001:00080000:0.0:1746143771.316811:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943427 is committed 00000001:00080000:0.0:1746143771.316821:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943426 is committed 00000100:00100000:0.0:1746143771.316854:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626653568:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746143771.316937:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a13d expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.316945:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143771.316948:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143771.317171:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a77bb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a13d expref: 9 pid: 7245 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143771.317186:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a13d expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.317214:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143771.317216:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143771.317218:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ee00, rc 0) 00000100:00100000:0.0:1746143771.317264:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31825:x1830963622265472:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11238us (16877us total) trans 8589943428 rc 0/0 00000100:00100000:0.0:1746143771.317273:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12729 00000100:00100000:1.0:1746143771.317411:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626654464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.317431:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143771.317454:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626653952 00000100:00100000:0.0:1746143771.317464:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626653952 00000100:00100000:0.0:1746143771.317504:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626654464 00000100:00100000:0.0:1746143771.317508:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626654464 00000100:00100000:0.0:1746143771.317726:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11262 00000100:00100000:0.0:1746143771.317735:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3773:x1830963626653952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.317737:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626654976:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143771.317883:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143771.317887:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143771.317889:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:0.0:1746143771.317891:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143771.317892:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143771.317956:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3773:x1830963626653952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (1195us total) trans 17179872899 rc 0/0 00000100:00100000:0.0:1746143771.317962:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11262 00000100:00100000:0.0:1746143771.317992:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11265 00000100:00100000:0.0:1746143771.317999:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3772:x1830963626654336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143771.318087:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3772:x1830963626654336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (278us total) trans 17179872902 rc 0/0 00000100:00100000:0.0:1746143771.318093:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11265 00000100:00100000:0.0:1746143771.318109:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11269 00000100:00100000:0.0:1746143771.318116:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3772:x1830963626654720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143771.318181:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143771.318185:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143771 -> 1746143771 00002000:00010000:0.0:1746143771.318186:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143771 -> 1746143771 00002000:00010000:0.0:1746143771.318188:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143771 -> 1746143771 00002000:00010000:0.0:1746143771.318190:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143771.318217:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3772:x1830963626654720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (308us total) trans 21474840221 rc 0/0 00000100:00100000:0.0:1746143771.318223:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11269 00000100:00100000:0.0:1746143771.318257:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626653696 00000100:00100000:0.0:1746143771.318262:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626653696 00000100:00100000:1.0:1746143771.318278:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143771.318287:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626654976 00000100:00100000:0.0:1746143771.318291:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626654976 00000100:00100000:1.0:1746143771.318298:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626655488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143771.318311:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11271 00000100:00100000:0.0:1746143771.318317:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3771:x1830963626653696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.318320:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143771.318336:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b62d80/2, rc 0, transno 17179872899 00000100:00100000:1.0:1746143771.318339:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626653952:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143771.318344:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b61f80/2, rc 0, transno 17179872900 00000100:00100000:1.0:1746143771.318347:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626654464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.318352:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143771.318356:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626654592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.318381:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143771.318392:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626655104:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143771.318396:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143771.318400:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143771 -> 1746143771 00002000:00010000:0.0:1746143771.318402:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143771 -> 1746143771 00002000:00010000:0.0:1746143771.318403:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143771 -> 1746143771 00002000:00010000:0.0:1746143771.318405:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746143771.318406:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143771.318427:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626654592 00000100:00100000:1.0:1746143771.318430:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626654592 00000100:00100000:0.0:1746143771.318439:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3771:x1830963626653696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (193us total) trans 17179872904 rc 0/0 00000100:00100000:1.0:1746143771.318444:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626655104 00000100:00100000:1.0:1746143771.318446:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626655104 00000100:00100000:0.0:1746143771.318447:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11271 00000100:00100000:1.0:1746143771.318454:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11273 00000100:00100000:0.0:1746143771.318462:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11275 00000100:00100000:0.0:1746143771.318468:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963626655104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143771.318548:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3773:x1830963626655104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (138us total) trans 21474840225 rc 0/0 00000100:00100000:0.0:1746143771.318554:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11275 00000100:00100000:0.0:1746143771.318577:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143771.318601:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626654080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143771.318627:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143771.318649:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626655616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143771.318674:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143771.318701:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b62a00/2, rc 0, transno 17179872905 00000100:00100000:0.0:1746143771.318707:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626653568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143771.318727:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11278 00000100:00100000:0.0:1746143771.318735:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963626655616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143771.318813:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963626655616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (137us total) trans 21474840226 rc 0/0 00000100:00100000:0.0:1746143771.318820:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11278 00000004:00080000:0.0:1746143771.318849:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cc000/2, rc 0, transno 21474840226 00000100:00100000:0.0:1746143771.318853:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626655616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143771.318863:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b61880/2, rc 0, transno 17179872906 00000100:00100000:0.0:1746143771.318867:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626654080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.319417:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3773:x1830963626655488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.319481:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963626655488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1023us (1159us total) trans 21474840227 rc 0/0 00000100:00100000:1.0:1746143771.319487:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11273 00000004:00080000:1.0:1746143771.319603:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b45500/2, rc 0, transno 21474840224 00000100:00100000:1.0:1746143771.319606:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626654592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143771.319612:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b45880/2, rc 0, transno 21474840225 00000100:00100000:1.0:1746143771.319614:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626655104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143771.319621:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b46d80/2, rc 0, transno 21474840223 00000100:00100000:1.0:1746143771.319623:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626654976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143771.319628:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b44000/2, rc 0, transno 21474840227 00000100:00100000:1.0:1746143771.319630:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626655488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.324221:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622265856:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20979us (23541us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143771.324234:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3094 00002000:00100000:1.0:1746143771.324247:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880095c69880 x1830963622265856/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.324264:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69880 with x1830963622265856 ext(2097152->4194303) 00002000:00010000:1.0:1746143771.324270:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c69880 00000100:00100000:0.0:1746143771.328863:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.334641:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.341695:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.341770:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.341890:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622266752 00000100:00100000:1.0:1746143771.341896:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622266752 00010000:00010000:1.0:1746143771.341956:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a7679 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a095 expref: 30 pid: 9839 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.341996:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5231 00000100:00100000:1.0:1746143771.342004:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622266752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.342014:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.342306:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a7679 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a095 expref: 30 pid: 9839 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.342326:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a7679 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a095 expref: 30 pid: 9839 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.342538:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a7679 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a095 expref: 30 pid: 9839 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.342569:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.342597:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2010:x1830963622266752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 592us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.342604:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5231 00000100:00100000:0.0:1746143771.345001:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.349023:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.349059:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.349142:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.351023:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3096 00000100:00100000:0.0:1746143771.351033:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622267392:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143771.356399:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.361139:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.361270:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622267904 00000100:00100000:1.0:1746143771.361277:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622267904 00010000:00010000:1.0:1746143771.361302:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a77ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a152 expref: 9 pid: 7245 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.361338:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5232 00000100:00100000:1.0:1746143771.361345:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622267904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.361359:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.361364:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a77ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a152 expref: 9 pid: 7245 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.361372:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a77ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a152 expref: 9 pid: 7245 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.361393:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a77ec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a152 expref: 9 pid: 7245 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.361410:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143771.361414:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a7801 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143771.361422:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a7801 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143771.361427:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a7801 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143771.361454:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.361475:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622267904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 131us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.361480:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5232 00000100:00100000:0.0:1746143771.363888:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.367125:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.367178:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622268416 00000100:00100000:1.0:1746143771.367187:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622268416 00000100:00100000:1.0:1746143771.367234:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4617 00000100:00100000:1.0:1746143771.367241:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31830:x1830963622268416:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143771.367458:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31830:x1830963622268416:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 216us (339us total) trans 8589943430 rc 0/0 00000100:00100000:1.0:1746143771.367467:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4617 00000100:00100000:0.0:1746143771.368577:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.368622:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.368642:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622268544 00000100:00100000:1.0:1746143771.368648:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622268544 00010000:00010000:1.0:1746143771.368765:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097106800/0x87925e4cb73a77b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a136 expref: 45 pid: 13436 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.368787:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5233 00000100:00100000:1.0:1746143771.368793:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622268544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.368802:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.368821:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097106800/0x87925e4cb73a77b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a136 expref: 46 pid: 13436 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.368832:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097106800/0x87925e4cb73a77b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a136 expref: 46 pid: 13436 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.368850:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097106800/0x87925e4cb73a77b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a136 expref: 46 pid: 13436 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.368859:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.368861:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.368867:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.368883:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.369588:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.369600:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 27 pid: 3135 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.369611:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626656384:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143771.369754:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.371574:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.371622:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626656384:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143771.371641:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.371677:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622268544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2883us (3103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.371687:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5233 00000100:00100000:0.0:1746143771.377737:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.377998:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1332 00000100:00100000:0.0:1746143771.378009:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2010:x1830963622269184:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143771.378175:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2010:x1830963622269184:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 168us (452us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143771.378182:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1332 00002000:00100000:0.0:1746143771.378188:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3944448->3948543) req@ffff880093072d80 x1830963622269184/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.378194:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093072d80 with x1830963622269184 ext(3944448->3948543) 00010000:00010000:0.0:1746143771.378200:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 28 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.378209:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 28 pid: 3135 timeout: 930 lvb_type: 0 00002000:00010000:0.0:1746143771.378215:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093072d80 00000100:00100000:0.0:1746143771.381475:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.381723:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.381792:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622269696 00000100:00100000:1.0:1746143771.381802:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622269696 00000100:00100000:1.0:1746143771.381850:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4618 00000100:00100000:1.0:1746143771.381858:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137359450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31825:x1830963622269696:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143771.383023:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137359450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31825:x1830963622269696:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 1164us (1555us total) trans 8589943431 rc 0/0 00000100:00100000:1.0:1746143771.383030:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4618 00000100:00100000:0.0:1746143771.386909:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.390315:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2011:x1830963622269440:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7716us (8582us total) trans 17179872907 rc 0/0 00000100:00100000:0.0:1746143771.390327:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1333 00002000:00100000:0.0:1746143771.390338:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3309568->3948543) req@ffff880093071180 x1830963622269440/t17179872907(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.390347:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071180 with x1830963622269440 ext(3309568->3948543) 00010000:00010000:0.0:1746143771.390357:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 30 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.390369:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 30 pid: 3135 timeout: 930 lvb_type: 0 00002000:00010000:0.0:1746143771.390376:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093071180 00000100:00100000:1.0:1746143771.390447:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622269952 00000100:00100000:1.0:1746143771.390455:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622269952 00010000:00010000:1.0:1746143771.390487:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7f400/0x87925e4cb73a76bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0d4 expref: 14 pid: 9587 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.391147:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5234 00000100:00100000:1.0:1746143771.391155:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622269952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.391168:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.391184:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7f400/0x87925e4cb73a76bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0d4 expref: 14 pid: 9587 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.391193:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7f400/0x87925e4cb73a76bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0d4 expref: 14 pid: 9587 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.391214:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7f400/0x87925e4cb73a76bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0d4 expref: 14 pid: 9587 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.391236:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.391252:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622269952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 98us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.391257:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5234 00000100:00100000:1.0:1746143771.391266:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622270080 00000100:00100000:1.0:1746143771.391269:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622270080 00010000:00010000:1.0:1746143771.391277:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a77ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a12f expref: 42 pid: 13436 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.391412:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5235 00000100:00100000:1.0:1746143771.391418:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622270080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.391427:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.391433:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a77ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a12f expref: 42 pid: 13436 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.391440:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a77ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a12f expref: 42 pid: 13436 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.391451:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a77ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a12f expref: 42 pid: 13436 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.391459:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.391535:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.391613:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622270080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 195us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.391618:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5235 00000100:00100000:1.0:1746143771.391627:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622270208 00000100:00100000:1.0:1746143771.391629:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622270208 00010000:00010000:1.0:1746143771.391638:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a7687 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a09c expref: 28 pid: 9586 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.391658:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5236 00000100:00100000:1.0:1746143771.391662:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963622270208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.391668:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.391674:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a7687 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a09c expref: 28 pid: 9586 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.391682:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a7687 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a09c expref: 28 pid: 9586 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.391693:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a7687 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a09c expref: 28 pid: 9586 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.391701:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.391703:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.391709:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e521600/0x87925e4cb73a7824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a175 expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.391715:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521600/0x87925e4cb73a7824 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a175 expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.391739:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e521600/0x87925e4cb73a7824 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a175 expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.391749:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626656896:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143771.391931:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622270336 00000100:00100000:0.0:1746143771.391935:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622270336 00010000:00010000:0.0:1746143771.391950:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 30 pid: 3135 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.391967:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.392013:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5237 00000100:00100000:0.0:1746143771.392019:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622270336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143771.392027:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143771.392038:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 30 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.392047:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 30 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.392059:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73a77d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->3948543) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a14b expref: 30 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.392072:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.392074:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.392078:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a781d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a16e expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.392084:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a781d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a16e expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.392102:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a781d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a16e expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.392110:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093070000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626657024:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143771.392131:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.393448:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626656896:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143771.393463:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.393497:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622270208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1833us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.393503:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5236 00000100:00100000:0.0:1746143771.393556:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.393615:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622270592 00000100:00100000:1.0:1746143771.393619:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622270592 00002000:00100000:1.0:1746143771.393645:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2654208->2658303) req@ffff880093073800 x1830963622270592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.393659:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093073800 with x1830963622270592 ext(2654208->2658303) 00002000:00010000:1.0:1746143771.393662:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093073800 00000100:00100000:1.0:1746143771.393683:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3097 00000100:00100000:1.0:1746143771.393688:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622270592:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143771.393796:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622270592:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 108us (240us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143771.393802:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3097 00002000:00100000:1.0:1746143771.393807:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2654208->2658303) req@ffff880093073800 x1830963622270592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.393813:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093073800 with x1830963622270592 ext(2654208->2658303) 00002000:00010000:1.0:1746143771.393816:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093073800 00000100:00100000:0.0:1746143771.393850:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093070000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626657024:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143771.393863:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.393881:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622270336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1863us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.393888:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5237 00000100:00100000:0.0:1746143771.396164:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.396239:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622270848 00000100:00100000:1.0:1746143771.396248:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622270848 00002000:00100000:1.0:1746143771.396289:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880093071500 x1830963622270848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.396297:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071500 with x1830963622270848 ext(3145728->4194303) 00002000:00010000:1.0:1746143771.396301:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093071500 00000100:00100000:1.0:1746143771.396326:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3098 00000100:00100000:1.0:1746143771.396332:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622270848:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143771.401769:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622270848:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 5423us (5599us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.401784:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3098 00002000:00100000:1.0:1746143771.401799:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880093071500 x1830963622270848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.401809:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071500 with x1830963622270848 ext(3145728->4194303) 00002000:00010000:1.0:1746143771.401815:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093071500 00000100:00100000:0.0:1746143771.405752:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.406079:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.406161:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622271232 00000100:00100000:1.0:1746143771.406166:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622271232 00002000:00100000:1.0:1746143771.406195:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880093071c00 x1830963622271232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.406203:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071c00 with x1830963622271232 ext(4194304->4780031) 00002000:00010000:1.0:1746143771.406208:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093071c00 00000100:00100000:1.0:1746143771.406234:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3099 00000100:00100000:1.0:1746143771.406239:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622271232:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143771.410429:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.412061:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.412082:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622271616 00000100:00100000:0.0:1746143771.412088:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622271616 00010000:00010000:0.0:1746143771.412110:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a781d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a16e expref: 46 pid: 13430 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.412119:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622271232:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5876us (6038us total) trans 0 rc 585728/585728 00000100:00100000:1.0:1746143771.412132:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3099 00000100:00100000:0.0:1746143771.412134:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5238 00000100:00100000:0.0:1746143771.412140:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622271616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00002000:00100000:1.0:1746143771.412141:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880093071c00 x1830963622271232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.412151:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071c00 with x1830963622271232 ext(4194304->4780031) 00010000:00010000:0.0:1746143771.412151:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143771.412155:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093071c00 00010000:00010000:0.0:1746143771.412167:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a781d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a16e expref: 45 pid: 13430 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.412177:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a781d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a16e expref: 45 pid: 13430 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.412199:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a781d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a16e expref: 45 pid: 13430 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143771.412227:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.412229:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.412448:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 44 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.412456:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 44 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.412485:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 44 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.412497:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093071880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626657280:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143771.412592:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.414052:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.416072:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.416160:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622271872 00000100:00100000:1.0:1746143771.416168:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622271872 00000100:00100000:1.0:1746143771.416218:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11285 00000100:00100000:1.0:1746143771.416339:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2008:x1830963622271872:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.416358:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.416376:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77200/0x87925e4cb73a785c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a191 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.416426:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626657536:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.416504:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.417803:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626657536:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143771.417821:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77200/0x87925e4cb73a785c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a191 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.417831:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77200/0x87925e4cb73a785c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a191 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.417853:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77200, rc 0) 00000100:00100000:1.0:1746143771.417885:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2008:x1830963622271872:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1660us (1821us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.417891:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11285 00000100:00100000:0.0:1746143771.419172:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.419221:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622272128 00000100:00100000:1.0:1746143771.419229:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622272128 00000100:00100000:1.0:1746143771.419277:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4619 00000100:00100000:1.0:1746143771.419284:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+261:31828:x1830963622272128:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143771.419332:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.419500:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:31828:x1830963622272128:12345-192.168.202.3@tcp:35:cat.0 Request processed in 216us (332us total) trans 8589943433 rc 0/0 00000100:00100000:1.0:1746143771.419507:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4619 00000100:00100000:0.0:1746143771.422837:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.423359:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622272640 00000100:00100000:1.0:1746143771.423369:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622272640 00000100:00100000:1.0:1746143771.423420:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4620 00000100:00100000:1.0:1746143771.423428:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:31824:x1830963622272640:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143771.423766:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:31824:x1830963622272640:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 337us (936us total) trans 8589943434 rc 0/0 00000100:00100000:1.0:1746143771.423773:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4620 00000100:00100000:0.0:1746143771.427676:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3102 00000100:00100000:0.0:1746143771.427715:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2011:x1830963622273280:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143771.428335:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.428355:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622273664 00000100:00100000:1.0:1746143771.428360:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622273664 00002000:00100000:1.0:1746143771.428385:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880082ed5500 x1830963622273664/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.428647:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed5500 with x1830963622273664 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.428651:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed5500 00000100:00100000:1.0:1746143771.428674:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3103 00000100:00100000:1.0:1746143771.428680:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2011:x1830963622273664:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143771.436624:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2011:x1830963622273280:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8927us (9927us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.436639:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3102 00002000:00100000:1.0:1746143771.436651:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092b46a00 x1830963622273280/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.436661:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b46a00 with x1830963622273280 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.436668:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b46a00 00000100:00100000:1.0:1746143771.442311:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2011:x1830963622273664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13621us (13967us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.442326:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3103 00002000:00100000:1.0:1746143771.442890:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880082ed5500 x1830963622273664/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.442899:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed5500 with x1830963622273664 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.442903:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed5500 00000100:00100000:1.0:1746143771.461929:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.462147:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.468404:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.471224:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.472209:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622274176 00000100:00100000:1.0:1746143771.472217:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622274176 00002000:00100000:1.0:1746143771.472377:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2654208->3145727) req@ffff880095c3a680 x1830963622274176/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.472387:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3a680 with x1830963622274176 ext(2654208->3145727) 00010000:00010000:1.0:1746143771.472394:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e521600/0x87925e4cb73a7824 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a175 expref: 41 pid: 13430 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.472408:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e521600/0x87925e4cb73a7824 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a175 expref: 41 pid: 13430 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746143771.472413:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c3a680 00000100:00100000:1.0:1746143771.472442:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1334 00000100:00100000:1.0:1746143771.472450:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622274176:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143771.477414:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622274176:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4952us (6179us total) trans 21474840228 rc 0/0 00000100:00100000:1.0:1746143771.477426:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1334 00002000:00100000:1.0:1746143771.477439:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2654208->3145727) req@ffff880095c3a680 x1830963622274176/t21474840228(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.477448:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3a680 with x1830963622274176 ext(2654208->3145727) 00010000:00010000:1.0:1746143771.477460:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e521600/0x87925e4cb73a7824 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a175 expref: 43 pid: 13430 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.477477:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e521600/0x87925e4cb73a7824 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a175 expref: 43 pid: 13430 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746143771.477483:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c3a680 00000100:00100000:0.0:1746143771.480683:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.485830:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.485879:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622274560 00000100:00100000:1.0:1746143771.485887:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622274560 00002000:00100000:1.0:1746143771.485950:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880095c3aa00 x1830963622274560/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.485959:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3aa00 with x1830963622274560 ext(2097152->3145727) 00002000:00010000:1.0:1746143771.485983:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3aa00 00000100:00100000:1.0:1746143771.486013:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3105 00000100:00100000:1.0:1746143771.486021:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963622274560:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143771.491153:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963622274560:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5119us (5312us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.491166:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3105 00002000:00100000:1.0:1746143771.491178:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880095c3aa00 x1830963622274560/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.491188:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3aa00 with x1830963622274560 ext(2097152->3145727) 00002000:00010000:1.0:1746143771.491194:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3aa00 00000100:00100000:0.0:1746143771.494891:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.498891:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.499156:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622274816 00000100:00100000:1.0:1746143771.499164:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622274816 00002000:00100000:1.0:1746143771.499207:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2641919) req@ffff880095c39500 x1830963622274816/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.499222:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39500 with x1830963622274816 ext(2097152->2641919) 00010000:00010000:1.0:1746143771.499229:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 44 pid: 13430 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.499241:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 44 pid: 13430 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746143771.499248:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c39500 00000100:00100000:1.0:1746143771.499584:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1335 00000100:00100000:1.0:1746143771.499600:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622274816:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143771.504246:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.505667:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963622274816:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6071us (6784us total) trans 17179872908 rc 0/0 00000100:00100000:1.0:1746143771.505678:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1335 00002000:00100000:1.0:1746143771.505689:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2641919) req@ffff880095c39500 x1830963622274816/t17179872908(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.505698:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39500 with x1830963622274816 ext(2097152->2641919) 00010000:00010000:1.0:1746143771.505707:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 46 pid: 13430 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.505717:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 46 pid: 13430 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746143771.505723:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c39500 00000100:00100000:0.0:1746143771.506655:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.508118:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622275328 00000100:00100000:1.0:1746143771.508124:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622275328 00010000:00010000:1.0:1746143771.508172:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 46 pid: 13430 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.508191:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5241 00000100:00100000:1.0:1746143771.508197:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963622275328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.508208:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.508226:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 46 pid: 13430 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.508366:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 46 pid: 13430 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.508381:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a782b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a17c expref: 46 pid: 13430 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.508464:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.508466:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.508473:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7878 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1ad expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.508482:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7878 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1ad expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.508511:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7878 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1ad expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.508523:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626658432:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143771.508596:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.513767:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626658432:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143771.513792:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.513857:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963622275328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5657us (5947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.513869:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5241 00000100:00100000:0.0:1746143771.518538:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.518637:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.518744:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622275712 00000100:00100000:1.0:1746143771.518754:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622275712 00002000:00100000:1.0:1746143771.518807:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095c3ad80 x1830963622275712/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.518819:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3ad80 with x1830963622275712 ext(2097152->4194303) 00002000:00010000:1.0:1746143771.518823:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3ad80 00000100:00100000:1.0:1746143771.518871:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622275840 00000100:00100000:1.0:1746143771.518876:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622275840 00002000:00100000:1.0:1746143771.518895:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095c3bb80 x1830963622275840/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.518902:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3bb80 with x1830963622275840 ext(3145728->4194303) 00002000:00010000:1.0:1746143771.518906:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3bb80 00000100:00100000:1.0:1746143771.518965:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3106 00000100:00100000:1.0:1746143771.518988:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622275712:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143771.530815:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622275712:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11828us (12278us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143771.530828:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3106 00002000:00100000:1.0:1746143771.530841:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095c3ad80 x1830963622275712/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.530858:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3ad80 with x1830963622275712 ext(2097152->4194303) 00002000:00010000:1.0:1746143771.530864:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3ad80 00000100:00100000:0.0:1746143771.538564:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.539022:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622276352 00000100:00100000:1.0:1746143771.539033:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622276352 00002000:00100000:1.0:1746143771.539084:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880095c38e00 x1830963622276352/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.539094:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38e00 with x1830963622276352 ext(4194304->4780031) 00002000:00010000:1.0:1746143771.539100:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c38e00 00000100:00100000:1.0:1746143771.539131:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3108 00000100:00100000:1.0:1746143771.539139:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2011:x1830963622276352:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143771.547287:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.547330:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.548229:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2011:x1830963622276352:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9089us (9675us total) trans 0 rc 585728/585728 00000100:00100000:1.0:1746143771.548238:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3108 00002000:00100000:1.0:1746143771.548247:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880095c38e00 x1830963622276352/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.548256:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38e00 with x1830963622276352 ext(4194304->4780031) 00002000:00010000:1.0:1746143771.548260:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c38e00 00000100:00100000:1.0:1746143771.553765:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622276864 00000100:00100000:1.0:1746143771.553774:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622276864 00000100:00100000:1.0:1746143771.553833:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4621 00000100:00100000:1.0:1746143771.553842:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31835:x1830963622276864:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143771.554110:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:31835:x1830963622276864:12345-192.168.202.3@tcp:35:cat.0 Request processed in 268us (430us total) trans 8589943437 rc 0/0 00000100:00100000:1.0:1746143771.554121:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4621 00000100:00100000:0.0:1746143771.555486:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.556096:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622277120 00000100:00100000:1.0:1746143771.556104:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622277120 00002000:00100000:1.0:1746143771.556146:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800972ebb80 x1830963622277120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.556156:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ebb80 with x1830963622277120 ext(0->1048575) 00002000:00010000:1.0:1746143771.556161:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972ebb80 00000100:00100000:1.0:1746143771.556189:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3109 00000100:00100000:1.0:1746143771.556195:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622277120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143771.556889:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.558839:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.558883:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.558903:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622277632 00000100:00100000:0.0:1746143771.558925:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622277632 00002000:00100000:0.0:1746143771.558963:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff8800972e8700 x1830963622277632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.558972:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8700 with x1830963622277632 ext(1048576->2097151) 00002000:00010000:0.0:1746143771.558988:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8700 00000100:00100000:0.0:1746143771.559618:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3112 00000100:00100000:0.0:1746143771.559629:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963622277760:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143771.568749:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622277120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12539us (13252us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.568764:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3109 00002000:00100000:1.0:1746143771.568779:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800972ebb80 x1830963622277120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.568789:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ebb80 with x1830963622277120 ext(0->1048575) 00002000:00010000:1.0:1746143771.568796:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972ebb80 00000100:00100000:0.0:1746143771.590629:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.590685:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.590968:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3114 00000100:00100000:1.0:1746143771.590990:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622278144:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143771.604211:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622278144:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13225us (13514us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143771.604224:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3114 00002000:00100000:1.0:1746143771.604234:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800972eb100 x1830963622278144/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.604249:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eb100 with x1830963622278144 ext(2097152->4194303) 00002000:00010000:1.0:1746143771.604255:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972eb100 00000100:00100000:0.0:1746143771.613627:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.613738:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622278656 00000100:00100000:1.0:1746143771.613748:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622278656 00002000:00100000:1.0:1746143771.613798:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff8800972e9500 x1830963622278656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.613809:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9500 with x1830963622278656 ext(4194304->4780031) 00002000:00010000:1.0:1746143771.613815:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e9500 00000100:00100000:1.0:1746143771.613853:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3115 00000100:00100000:1.0:1746143771.613862:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963622278656:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143771.617334:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963622278656:12345-192.168.202.3@tcp:3:cat.0 Request processed in 3461us (3706us total) trans 0 rc 585728/585728 00000100:00100000:1.0:1746143771.617347:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3115 00002000:00100000:1.0:1746143771.617360:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff8800972e9500 x1830963622278656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.617370:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9500 with x1830963622278656 ext(4194304->4780031) 00002000:00010000:1.0:1746143771.617376:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e9500 00000100:00100000:0.0:1746143771.624195:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.643450:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.647160:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.647224:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622279296 00000100:00100000:1.0:1746143771.647233:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622279296 00000100:00100000:1.0:1746143771.647289:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 716 00000100:00100000:1.0:1746143771.647295:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:2010:x1830963622279296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.647305:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.647322:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73a78da lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1d0 expref: 268 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.647349:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143771.647352:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.647391:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+267:2010:x1830963622279296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.647398:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 716 00000100:00100000:0.0:1746143771.650120:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.655415:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.655455:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.655487:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.655517:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622279552 00000100:00100000:1.0:1746143771.655524:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622279552 00010000:00010000:1.0:1746143771.655546:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a76d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0e2 expref: 29 pid: 13436 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.655563:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622279680 00000100:00100000:1.0:1746143771.655565:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622279680 00010000:00010000:1.0:1746143771.655572:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b6e00/0x87925e4cb73a7791 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a113 expref: 43 pid: 13430 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.655583:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5242 00000100:00100000:1.0:1746143771.655588:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622279552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.655598:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.655611:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a76d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0e2 expref: 29 pid: 13436 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.655619:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a76d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0e2 expref: 29 pid: 13436 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.655635:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a76d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0e2 expref: 29 pid: 13436 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.655653:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.655676:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622279552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.655681:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5242 00000100:00100000:1.0:1746143771.655692:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5243 00000100:00100000:1.0:1746143771.655697:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622279680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.655703:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.655709:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913b6e00/0x87925e4cb73a7791 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a113 expref: 43 pid: 13430 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.655717:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913b6e00/0x87925e4cb73a7791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a113 expref: 43 pid: 13430 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.655728:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6e00/0x87925e4cb73a7791 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a113 expref: 43 pid: 13430 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.655736:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.655749:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622279680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 52us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.655753:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5243 00000100:00100000:0.0:1746143771.658486:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626658944:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143771.658508:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.659173:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622279808:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2966us (3683us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.659183:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5244 00000100:00100000:1.0:1746143771.661026:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622280064 00000100:00100000:1.0:1746143771.661035:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622280064 00002000:00100000:1.0:1746143771.661080:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (81920->86015) req@ffff880092b21180 x1830963622280064/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.661090:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b21180 with x1830963622280064 ext(81920->86015) 00002000:00010000:1.0:1746143771.661095:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b21180 00000100:00100000:1.0:1746143771.661127:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3116 00000100:00100000:1.0:1746143771.661135:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622280064:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143771.661282:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622280064:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 148us (492us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143771.661288:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3116 00002000:00100000:1.0:1746143771.661293:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (81920->86015) req@ffff880092b21180 x1830963622280064/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.661299:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b21180 with x1830963622280064 ext(81920->86015) 00002000:00010000:1.0:1746143771.661301:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b21180 00000100:00100000:0.0:1746143771.670752:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.676149:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.678517:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622280576 00000100:00100000:1.0:1746143771.678523:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622280576 00010000:00010000:1.0:1746143771.678549:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a76b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0bf expref: 14 pid: 12328 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.678575:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5245 00000100:00100000:1.0:1746143771.678580:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2010:x1830963622280576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.678592:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.678610:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a76b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0bf expref: 14 pid: 12328 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.678618:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a76b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0bf expref: 14 pid: 12328 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.678637:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73a76b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0bf expref: 14 pid: 12328 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.678661:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.678683:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622280576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 103us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.678689:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5245 00000100:00100000:0.0:1746143771.679290:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.679495:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622280704 00000100:00100000:1.0:1746143771.679499:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622280704 00010000:00010000:1.0:1746143771.679516:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73a7798 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a11a expref: 46 pid: 13430 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.679544:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5246 00000100:00100000:1.0:1746143771.679551:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622280704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.679559:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.679568:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73a7798 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a11a expref: 46 pid: 13430 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.679576:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73a7798 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a11a expref: 46 pid: 13430 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.679588:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73a7798 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a11a expref: 46 pid: 13430 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.679597:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.679630:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963622280704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 80us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.679636:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5246 00000100:00100000:0.0:1746143771.681147:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.682708:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.684858:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b20700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626659456:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143771.684875:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.685045:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622280832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3025us (3768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.685055:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5247 00000100:00100000:0.0:1746143771.687379:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.692740:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.692791:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.714520:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.723338:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.724433:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.725189:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622282240 00000100:00100000:1.0:1746143771.725194:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622282240 00010000:00010000:1.0:1746143771.725221:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7871 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1a6 expref: 28 pid: 3135 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.725245:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5248 00000100:00100000:1.0:1746143771.725250:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963622282240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.725266:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.725286:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7871 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1a6 expref: 28 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.725297:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7871 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1a6 expref: 28 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.725321:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7871 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1a6 expref: 28 pid: 3135 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143771.725338:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.725383:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622282240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 132us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.725389:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5248 00000100:00100000:1.0:1746143771.725444:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.725459:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622282368 00000100:00100000:1.0:1746143771.725462:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622282368 00010000:00010000:1.0:1746143771.725474:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a78b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1c2 expref: 43 pid: 9587 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.725656:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5249 00000100:00100000:1.0:1746143771.725663:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622282368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.725671:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.725677:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a78b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1c2 expref: 43 pid: 9587 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.725687:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a78b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1c2 expref: 43 pid: 9587 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.725700:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73a78b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1c2 expref: 43 pid: 9587 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.725708:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.725711:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.725717:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1f3 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.725725:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7920 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1f3 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.725757:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7920 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1f3 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.725768:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626659968:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143771.725831:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009aec29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.727624:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626659968:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143771.727645:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.727684:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622282368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2020us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.727694:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5249 00000100:00100000:1.0:1746143771.728172:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.737261:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.743639:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.743712:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.743739:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.743762:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622283136 00000100:00100000:1.0:1746143771.743767:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622283136 00010000:00010000:1.0:1746143771.743792:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73a78be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1c9 expref: 46 pid: 9587 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143771.743822:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622283264 00000100:00100000:1.0:1746143771.743824:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622283264 00010000:00010000:1.0:1746143771.743834:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7878 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1ad expref: 30 pid: 3135 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143771.743848:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5250 00000100:00100000:1.0:1746143771.743853:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622283136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.743863:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.743882:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73a78be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1c9 expref: 46 pid: 9587 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.743892:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73a78be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1c9 expref: 46 pid: 9587 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.743938:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73a78be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1c9 expref: 46 pid: 9587 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143771.743958:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.744008:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622283136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 154us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.744016:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5250 00000100:00100000:0.0:1746143771.747682:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.747724:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.747789:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622283520 00000100:00100000:1.0:1746143771.747796:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622283520 00000100:00100000:1.0:1746143771.747835:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622283648 00000100:00100000:1.0:1746143771.747838:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622283648 00000100:00100000:1.0:1746143771.747853:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11297 00000100:00100000:1.0:1746143771.747859:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963622283520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.747877:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.747894:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551400/0x87925e4cb73a7951 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a208 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.748249:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626660608:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.748276:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009aec2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.748494:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622283776 00000100:00100000:0.0:1746143771.748498:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622283776 00000100:00100000:0.0:1746143771.748568:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 717 00000100:00100000:0.0:1746143771.748575:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+269:2009:x1830963622283776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143771.748585:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143771.749237:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73a7943 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a201 expref: 269 pid: 7245 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143771.749495:0:9839:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime: 1746143771 -> 1746143772 00002000:00010000:1.0:1746143771.749499:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime: 1746143771 -> 1746143772 00002000:00010000:1.0:1746143771.749501:0:9839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime: 1746143771 -> 1746143772 00000100:00100000:1.0:1746143771.749513:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626660608:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143771.749532:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551400/0x87925e4cb73a7951 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a208 expref: 43 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.749541:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143771.749542:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551400/0x87925e4cb73a7951 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a208 expref: 43 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.749545:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143771.749549:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551400, rc 0) 00000100:00100000:1.0:1746143771.749878:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963622283520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2018us (2197us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143771.749878:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+268:2009:x1830963622283776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1302us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.749884:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 717 00000100:00100000:1.0:1746143771.749887:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11297 00000100:00100000:0.0:1746143771.751371:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.752102:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.755459:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.765129:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.768424:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.783557:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.785482:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.791474:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.794431:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626661120:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143771.794463:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.794518:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622285184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2880us (3054us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.794687:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5253 00000100:00100000:0.0:1746143771.795843:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.813505:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.813562:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.836515:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.845368:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.845499:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622286464 00000100:00100000:1.0:1746143771.845511:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622286464 00000100:00100000:1.0:1746143771.845570:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4625 00000100:00100000:1.0:1746143771.845578:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+269:31856:x1830963622286464:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143771.845795:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.845817:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+270:31856:x1830963622286464:12345-192.168.202.3@tcp:35:cat.0 Request processed in 238us (460us total) trans 8589943444 rc 0/0 00000100:00100000:1.0:1746143771.845823:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4625 00000100:00100000:0.0:1746143771.848755:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.849426:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.849498:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.849791:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.849825:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.849841:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11303 00000100:00100000:1.0:1746143771.849848:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2008:x1830963622287232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.849855:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.849863:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a79a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a239 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.849939:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626661376:192.168.202.3@tcp:106: 00002000:00010000:0.0:1746143771.851589:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143771 -> 1746143772 00002000:00010000:0.0:1746143771.851596:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143771 -> 1746143772 00002000:00010000:0.0:1746143771.851597:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143771 -> 1746143772 00000100:00100000:0.0:1746143771.851614:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626661248:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143771.851640:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74600/0x87925e4cb73a799e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a240 expref: 32 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.851650:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74600/0x87925e4cb73a799e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a240 expref: 32 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.851670:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74600, rc 0) 00000100:00100000:0.0:1746143771.851705:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622287360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1854us (1878us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143771.851713:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11304 00000100:00100000:0.0:1746143771.857667:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.857719:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.875798:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.877826:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.877870:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.878676:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622288512 00000100:00100000:0.0:1746143771.878679:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622288512 00000100:00100000:0.0:1746143771.878710:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 719 00000100:00100000:0.0:1746143771.878715:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+272:2009:x1830963622288512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143771.878725:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143771.878736:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a79c1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a247 expref: 272 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.878757:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143771.878761:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.878778:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+271:2009:x1830963622288512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 62us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.878782:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 719 00000100:00100000:0.0:1746143771.880430:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.880653:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622288640 00000100:00100000:1.0:1746143771.880658:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622288640 00000100:00100000:1.0:1746143771.880687:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11307 00000100:00100000:1.0:1746143771.880692:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:31863:x1830963622288640:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143771.880702:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.880947:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a79dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a25c expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.880982:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73a7966 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a21d expref: 47 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.880990:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a7990 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a232 expref: 31 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.880996:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.880998:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.881001:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a79dd lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1916928->2052095] (req 1916928->2052095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a25c expref: 47 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.881022:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a7990 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a232 expref: 31 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.881032:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a7990 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a232 expref: 31 pid: 13430 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746143771.881044:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626661760:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.881081:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73a7966 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a21d expref: 47 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.881087:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73a7966 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a21d expref: 47 pid: 13430 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143771.881093:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626661888:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.881106:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.883275:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626661760:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.883292:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626661888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.883323:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a79dd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1916928->2052095] (req 1916928->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a25c expref: 47 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.883340:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550800, rc 0) 00000100:00100000:1.0:1746143771.883382:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+47:31863:x1830963622288640:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2688us (2959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.883390:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11307 00000100:00100000:0.0:1746143771.884399:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.884442:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.884536:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622288896 00000100:00100000:1.0:1746143771.884541:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622288896 00000100:00100000:1.0:1746143771.884581:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11308 00000100:00100000:1.0:1746143771.884588:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:31860:x1830963622288896:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.884603:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.884619:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a79e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a263 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.884641:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1f3 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.884649:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143771.884651:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143771.884654:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a79e4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a263 expref: 30 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.884686:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7920 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1f3 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.884696:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7920 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3723264->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1f3 expref: 42 pid: 13430 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143771.884709:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626662016:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.884762:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.886449:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.886791:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626662016:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.886814:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a79e4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a263 expref: 30 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.886826:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550000, rc 0) 00000100:00100000:1.0:1746143771.886870:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:31860:x1830963622288896:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2282us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.886877:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11308 00000100:00100000:0.0:1746143771.887717:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.892078:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.895256:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.898706:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.898796:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622289920 00000100:00100000:1.0:1746143771.898805:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622289920 00000100:00100000:1.0:1746143771.898862:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4626 00000100:00100000:1.0:1746143771.898870:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+271:31863:x1830963622289920:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143771.899266:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+272:31863:x1830963622289920:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 395us (569us total) trans 8589943447 rc 0/0 00000100:00100000:1.0:1746143771.899273:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4626 00000100:00100000:0.0:1746143771.900668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.905658:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.910322:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.913587:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.913781:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.913874:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622290816 00000100:00100000:1.0:1746143771.913882:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622290816 00000100:00100000:1.0:1746143771.913952:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4627 00000100:00100000:1.0:1746143771.913959:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31865:x1830963622290816:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143771.914712:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:31865:x1830963622290816:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 752us (1130us total) trans 8589943449 rc 0/0 00000100:00100000:1.0:1746143771.914718:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4627 00000100:00100000:0.0:1746143771.915789:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.915845:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622291072 00000100:00100000:1.0:1746143771.915850:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622291072 00000100:00100000:1.0:1746143771.916289:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11309 00000100:00100000:1.0:1746143771.916296:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:31860:x1830963622291072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.916312:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.916327:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a7a0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a271 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.916356:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a7927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1fa expref: 45 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.916364:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143771.916366:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143771.916369:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a7a0e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a271 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.916398:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a7927 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1fa expref: 45 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.916409:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a7927 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1fa expref: 45 pid: 13430 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143771.916420:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626662400:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.916501:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.918908:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.919032:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626662400:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.919063:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a7a0e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a271 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.919081:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c800, rc 0) 00000100:00100000:1.0:1746143771.919125:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:31860:x1830963622291072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2824us (3335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.919133:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11309 00000100:00100000:1.0:1746143771.921777:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622291328 00000100:00100000:1.0:1746143771.921787:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622291328 00000100:00100000:1.0:1746143771.921840:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11310 00000100:00100000:1.0:1746143771.921848:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:31865:x1830963622291328:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143771.923228:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.923252:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7a15 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a278 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.923287:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a79e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a263 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.923295:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.923297:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.923300:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7a15 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4087808->4194303] (req 4087808->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a278 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.923338:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a79e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a263 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.923349:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a79e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a263 expref: 31 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143771.923361:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626662528:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.923508:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.927564:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626662528:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.927608:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7a15 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4087808->4194303] (req 4087808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a278 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.927627:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7de00, rc 0) 00000100:00100000:1.0:1746143771.927686:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:31865:x1830963622291328:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5837us (6016us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.927694:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11310 00000100:00100000:0.0:1746143771.928671:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.932116:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.932316:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622291712 00000100:00100000:1.0:1746143771.932326:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622291712 00000100:00100000:1.0:1746143771.932377:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11311 00000100:00100000:1.0:1746143771.932385:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:31865:x1830963622291712:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143771.932402:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.932419:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7a1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a27f expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.932453:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a7a0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a271 expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.932461:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.932462:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.932467:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7a1c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->3248127] (req 3145728->3248127) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a27f expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.932494:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a7a0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a271 expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.932506:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a7a0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a271 expref: 32 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143771.932516:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626662912:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143771.932566:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.934717:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626662912:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143771.934746:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7a1c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->3248127] (req 3145728->3248127) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a27f expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.934762:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d800, rc 0) 00000100:00100000:1.0:1746143771.934806:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:31865:x1830963622291712:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2420us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.934813:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11311 00000100:00100000:0.0:1746143771.939670:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.939736:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.940109:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3132 00000100:00100000:1.0:1746143771.940118:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622292224:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143771.945817:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622292224:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 5687us (6073us total) trans 0 rc 942080/942080 00000100:00100000:1.0:1746143771.945831:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3132 00002000:00100000:1.0:1746143771.945846:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4087807) req@ffff8800938dca80 x1830963622292224/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 942080/942080 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.945860:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dca80 with x1830963622292224 ext(3145728->4087807) 00002000:00010000:1.0:1746143771.945878:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dca80 00000100:00100000:0.0:1746143771.953029:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.953106:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622292352 00000100:00100000:1.0:1746143771.953121:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622292352 00000100:00100000:1.0:1746143771.953177:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11312 00000100:00100000:1.0:1746143771.953186:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:31860:x1830963622292352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.953206:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.953224:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7d200/0x87925e4cb73a7a23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a286 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.953261:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.953267:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7a1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->3248127] (req 3145728->3248127) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a27f expref: 33 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.953276:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143771.953280:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7d200/0x87925e4cb73a7a23 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a286 expref: 33 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.953318:0:9587:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7a1c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->3248127] (req 3145728->3248127) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a27f expref: 33 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.953335:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7d200/0x87925e4cb73a7a23 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a286 expref: 33 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.953344:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d200, rc 0) 00000100:00100000:1.0:1746143771.953397:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:31860:x1830963622292352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 212us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.953403:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11312 00000100:00100000:0.0:1746143771.956101:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.959496:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.962176:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143771.965954:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872911 is committed 00000001:00080000:0.0:1746143771.965962:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872910 is committed 00000001:00080000:0.0:1746143771.965989:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872906 is committed 00000001:00080000:0.0:1746143771.966008:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872898 is committed 00000100:00100000:0.0:1746143771.966966:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.973061:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.984328:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.984396:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622293504 00000100:00100000:1.0:1746143771.984408:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622293504 00000100:00100000:1.0:1746143771.984501:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11313 00000100:00100000:1.0:1746143771.984510:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622293504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.984531:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.984551:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7a2a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a28d expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.984607:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626663424:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.985063:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.986681:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626663424:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143771.986709:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7a2a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a28d expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.986719:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7a2a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a28d expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.986747:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d800, rc 0) 00000100:00100000:1.0:1746143771.986787:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622293504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2279us (2472us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.986793:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11313 00000100:00100000:0.0:1746143771.989091:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143771.993673:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.993795:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622293888 00000100:00100000:1.0:1746143771.993807:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622293888 00000100:00100000:1.0:1746143771.994524:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11314 00000100:00100000:1.0:1746143771.994534:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622293888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.994549:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.994564:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84e000/0x87925e4cb73a7a31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a294 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.994612:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626663552:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.994704:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.995965:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626663552:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143771.996000:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84e000/0x87925e4cb73a7a31 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a294 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.996011:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84e000/0x87925e4cb73a7a31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a294 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.996030:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e000, rc 0) 00000100:00100000:1.0:1746143771.996073:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622293888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1540us (2404us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.996082:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11314 00000100:00100000:0.0:1746143771.999222:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143771.999288:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622294016 00000100:00100000:1.0:1746143771.999298:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622294016 00000100:00100000:1.0:1746143771.999346:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11315 00000100:00100000:1.0:1746143771.999354:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622294016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143771.999369:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.999383:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73a7a38 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a29b expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.999428:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626663680:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143771.999523:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.003088:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626663680:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.003130:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73a7a38 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a29b expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.003144:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73a7a38 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a29b expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.003164:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fa00, rc 0) 00000100:00100000:1.0:1746143772.003209:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622294016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3855us (3998us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.003231:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11315 00000100:00100000:0.0:1746143772.009381:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.009514:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622294272 00000100:00100000:1.0:1746143772.009525:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622294272 00000100:00100000:1.0:1746143772.009584:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4628 00000100:00100000:1.0:1746143772.009592:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31860:x1830963622294272:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143772.010301:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:31860:x1830963622294272:12345-192.168.202.3@tcp:35:cat.0 Request processed in 707us (929us total) trans 8589943450 rc 0/0 00000100:00100000:1.0:1746143772.010309:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4628 00000100:00100000:0.0:1746143772.063709:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.073164:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.073216:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.073257:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.073357:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622294656 00000100:00100000:1.0:1746143772.073368:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622294656 00000100:00100000:1.0:1746143772.073419:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622294784 00000100:00100000:1.0:1746143772.073422:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622294784 00000100:00100000:1.0:1746143772.073440:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11316 00000100:00100000:1.0:1746143772.073448:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622294656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.073469:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.073488:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a7a62 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a2a9 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.073544:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626663808:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143772.073611:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.075791:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626663808:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.075820:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a7a62 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2a9 expref: 45 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.076334:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a7a62 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2a9 expref: 45 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.076361:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fa00, rc 0) 00000100:00100000:1.0:1746143772.076510:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622294656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3061us (3356us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.076519:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11316 00000100:00100000:0.0:1746143772.082654:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.082706:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.086352:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622295808 00000100:00100000:1.0:1746143772.086357:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622295808 00000100:00100000:1.0:1746143772.086393:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4629 00000100:00100000:1.0:1746143772.086399:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:31873:x1830963622295808:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143772.086934:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:31873:x1830963622295808:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 533us (707us total) trans 8589943453 rc 0/0 00000100:00100000:1.0:1746143772.086941:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4629 00000100:00100000:0.0:1746143772.099536:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.100015:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622295936 00000100:00100000:1.0:1746143772.100027:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622295936 00000100:00100000:1.0:1746143772.100085:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11318 00000100:00100000:1.0:1746143772.100094:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:31871:x1830963622295936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.100116:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.100138:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e03b600/0x87925e4cb73a7a93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a2be expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.100170:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7a15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a278 expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.100179:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.100182:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.100185:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e03b600/0x87925e4cb73a7a93 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2be expref: 45 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.100225:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7a15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a278 expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.100238:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7a15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a278 expref: 29 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.100251:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626663936:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.100349:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.102439:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626663936:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143772.102468:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e03b600/0x87925e4cb73a7a93 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2be expref: 45 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.102482:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e03b600, rc 0) 00000100:00100000:1.0:1746143772.102551:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:31871:x1830963622295936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2458us (3026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.102560:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11318 00000100:00100000:0.0:1746143772.102635:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143772.107100:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840231 is committed 00000001:00080000:0.0:1746143772.107120:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840230 is committed 00000001:00080000:0.0:1746143772.107133:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840227 is committed 00000001:00080000:0.0:1746143772.107146:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840218 is committed 00000100:00100000:0.0:1746143772.110503:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.115237:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.115376:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622296320 00000100:00100000:1.0:1746143772.115386:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622296320 00000100:00100000:1.0:1746143772.115434:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11319 00000100:00100000:1.0:1746143772.115442:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:31873:x1830963622296320:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143772.115463:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.115482:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a7a9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a2c5 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.115516:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a795f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a216 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.115525:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a7997 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a22b expref: 8 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.115537:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.115539:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.115543:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a7a9a lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [524288->929791] (req 524288->929791) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2c5 expref: 8 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.115574:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a7997 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a22b expref: 8 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.115588:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a7997 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a22b expref: 8 pid: 13430 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746143772.115599:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626664192:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143772.115882:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a795f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a216 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.115891:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a795f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a216 expref: 22 pid: 13430 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.116068:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626664320:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.116332:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.118321:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.118500:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626664192:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.118508:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626664320:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143772.118531:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a7a9a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [524288->929791] (req 524288->929791) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2c5 expref: 8 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.118548:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e600, rc 0) 00000100:00100000:1.0:1746143772.118586:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31873:x1830963622296320:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3144us (3361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.118591:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11319 00000100:00100000:0.0:1746143772.118803:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.118821:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622296832 00000100:00100000:0.0:1746143772.118824:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622296832 00002000:00100000:0.0:1746143772.118843:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88012e359c00 x1830963622296832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143772.118851:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359c00 with x1830963622296832 ext(2097152->4194303) 00002000:00010000:0.0:1746143772.118854:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e359c00 00000100:00100000:0.0:1746143772.118867:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3137 00000100:00100000:0.0:1746143772.118872:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622296832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143772.121427:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.123677:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626664448 00000100:00100000:0.0:1746143772.123681:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626664448 00000100:00100000:0.0:1746143772.123733:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1746143772.123740:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963626664448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746143772.123757:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 159744 granted 1012252736 pending 0 free 3914395648 avail 3674091520 00000100:00100000:0.0:1746143772.123804:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963626664448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.123810:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1746143772.129079:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.129410:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622297600 00000100:00100000:1.0:1746143772.129417:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622297600 00002000:00100000:1.0:1746143772.129457:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (524288->528383) req@ffff88012e35a300 x1830963622297600/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.129465:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35a300 with x1830963622297600 ext(524288->528383) 00002000:00010000:1.0:1746143772.129470:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35a300 00000100:00100000:1.0:1746143772.129499:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3138 00000100:00100000:1.0:1746143772.129507:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622297600:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143772.129638:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622297600:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 132us (569us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143772.129644:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3138 00002000:00100000:1.0:1746143772.129649:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (524288->528383) req@ffff88012e35a300 x1830963622297600/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.129656:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35a300 with x1830963622297600 ext(524288->528383) 00002000:00010000:1.0:1746143772.129659:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35a300 00000100:00100000:0.0:1746143772.131735:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.136420:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622298112 00000100:00100000:0.0:1746143772.136429:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622298112 00000100:00100000:0.0:1746143772.136478:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622297984 00000100:00100000:0.0:1746143772.136481:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622297984 00000100:00100000:0.0:1746143772.136500:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 723 00000100:00100000:0.0:1746143772.136507:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622298112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143772.136520:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143772.136545:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a7ad9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2d3 expref: 24 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.136577:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143772.136581:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.136609:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622298112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 101us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.136615:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 723 00000100:00100000:0.0:1746143772.141423:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.147110:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.147151:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.147187:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.147414:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11322 00000100:00100000:1.0:1746143772.147428:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963622298752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.147440:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.147447:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73a7af5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a2e8 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.147474:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626664832:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143772.147497:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096beb180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.149457:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626664832:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.149474:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73a7af5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2e8 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.149485:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73a7af5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2e8 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.149507:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52a00, rc 0) 00000100:00100000:1.0:1746143772.149528:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963622298752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2107us (2339us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.149538:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11322 00000100:00100000:0.0:1746143772.152851:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.153310:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.153657:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3140 00000100:00100000:1.0:1746143772.153667:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622299008:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143772.158817:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622299008:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5143us (5966us total) trans 0 rc 643072/643072 00000100:00100000:1.0:1746143772.158827:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3140 00002000:00100000:1.0:1746143772.158838:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012e358a80 x1830963622299008/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 504/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 643072/643072 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.158852:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358a80 with x1830963622299008 ext(0->1048575) 00002000:00010000:1.0:1746143772.158857:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e358a80 00000100:00100000:0.0:1746143772.164835:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.164946:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622299392 00000100:00100000:1.0:1746143772.164955:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622299392 00000100:00100000:1.0:1746143772.165012:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11323 00000100:00100000:1.0:1746143772.165020:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:31878:x1830963622299392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.165036:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.165050:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a2ef expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.165074:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a79dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a25c expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.165081:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.165083:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.165086:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 8 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.165109:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a79dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2052095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a25c expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.165119:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a79dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2052095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a25c expref: 23 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.165128:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626664960:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.165201:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096beb180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.167332:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.167632:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626664960:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143772.167657:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 8 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.167670:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ec00, rc 0) 00000100:00100000:1.0:1746143772.167706:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31878:x1830963622299392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2686us (2876us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.167713:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11323 00000100:00100000:0.0:1746143772.168150:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.173178:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.173217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.173547:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11326 00000100:00100000:1.0:1746143772.173556:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622299776:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.173564:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.173579:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73a7b11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a2fd expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.173607:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626665344:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143772.173744:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096beb180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.176056:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626665344:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.176089:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73a7b11 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2fd expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.176103:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73a7b11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2fd expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.176127:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7f800, rc 0) 00000100:00100000:1.0:1746143772.176163:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622299776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2608us (2944us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.176171:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11326 00000100:00100000:0.0:1746143772.176416:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622300032 00000100:00100000:0.0:1746143772.176423:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622300032 00010000:00010000:0.0:1746143772.176448:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a79dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a25c expref: 26 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746143772.176480:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5264 00000100:00100000:0.0:1746143772.176487:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622300032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143772.176499:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143772.176508:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a79dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a25c expref: 26 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746143772.176543:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a79dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2052095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a25c expref: 26 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746143772.176563:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73a79dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2052095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a25c expref: 26 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746143772.176668:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.176671:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.176678:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 7 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.176687:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 7 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.176772:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 7 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143772.176784:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626665472:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143772.176849:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.182478:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626665472:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143772.182503:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.182562:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622300032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6075us (6207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.182573:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5264 00000100:00100000:1.0:1746143772.182790:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622300288 00000100:00100000:1.0:1746143772.182797:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622300288 00000100:00100000:1.0:1746143772.183119:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4630 00000100:00100000:1.0:1746143772.183127:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137358c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+274:31871:x1830963622300288:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143772.184515:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137358c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+275:31871:x1830963622300288:12345-192.168.202.3@tcp:35:cat.0 Request processed in 1382us (2131us total) trans 8589943456 rc 0/0 00000100:00100000:1.0:1746143772.184524:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4630 00000100:00100000:0.0:1746143772.185579:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622300416 00000100:00100000:0.0:1746143772.185588:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622300416 00000100:00100000:0.0:1746143772.185656:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12747 00000100:00100000:0.0:1746143772.185665:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31880:x1830963622300416:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143772.185694:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.185718:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73a7b18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a30b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.185787:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.185801:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.185812:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.185828:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.185834:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.185840:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.185991:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.186007:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7dc00/0x87925e4cb73a7886 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1b4 expref: 22 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.186013:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.186052:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7dc00/0x87925e4cb73a7886 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1b4 expref: 22 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.186065:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7dc00/0x87925e4cb73a7886 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1b4 expref: 22 pid: 7245 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746143772.186079:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093070e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626665600:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143772.186160:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.196802:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.196874:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622300928 00000100:00100000:1.0:1746143772.196884:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622300928 00000100:00100000:1.0:1746143772.196977:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4631 00000100:00100000:1.0:1746143772.196985:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:30659:x1830963622300928:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143772.197206:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:30659:x1830963622300928:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 221us (416us total) trans 8589943457 rc 0/0 00000100:00100000:1.0:1746143772.197213:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4631 00000100:00100000:0.0:1746143772.199225:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143772.201294:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201303:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143772.201365:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143772.201371:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143772.201389:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201400:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201411:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201418:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201423:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201429:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201435:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7c800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143772.201439:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201446:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201456:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143772.201458:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143772.201462:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201466:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7b1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201481:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201486:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201490:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201494:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7d600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143772.201497:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201502:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201508:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008219e000) 00010000:00010000:0.0:1746143772.201510:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143772.201512:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201516:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.201553:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73a7b18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a30b expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.201565:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a30b expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.201571:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143772.201573:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143772.201575:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d400, rc 0) 00000100:00100000:0.0:1746143772.201622:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:31880:x1830963622300416:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 15957us (16267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.201629:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12747 00000100:00100000:0.0:1746143772.209535:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622301184 00000100:00100000:0.0:1746143772.209547:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622301184 00000100:00100000:0.0:1746143772.209641:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11327 00000100:00100000:0.0:1746143772.209650:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622301184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143772.209671:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.209688:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a312 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143772.209742:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626665728:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143772.210632:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.211659:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622301312 00000100:00100000:0.0:1746143772.211664:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622301312 00000100:00100000:0.0:1746143772.211697:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622301440 00000100:00100000:0.0:1746143772.211699:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622301440 00000100:00100000:0.0:1746143772.211709:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622301568 00000100:00100000:0.0:1746143772.211710:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622301568 00000100:00100000:0.0:1746143772.211721:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622301696 00000100:00100000:0.0:1746143772.211723:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622301696 00000100:00100000:0.0:1746143772.211736:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11328 00000100:00100000:0.0:1746143772.211742:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622301312:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143772.211755:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.211770:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a7b3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a319 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.211789:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.211791:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.211801:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a7b3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a319 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.211816:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a7b3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a319 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.211827:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7da00, rc 0) 00000100:00100000:0.0:1746143772.211866:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622301312:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 124us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.211872:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11328 00000100:00100000:0.0:1746143772.211888:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11329 00000100:00100000:0.0:1746143772.211893:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622301440:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143772.211899:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.211909:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7b42 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a320 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.211942:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.211943:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.211948:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7b42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a320 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.211958:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7b42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a320 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.211964:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7de00, rc 0) 00000100:00100000:0.0:1746143772.211990:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622301440:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 97us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.211995:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11329 00000100:00100000:0.0:1746143772.212003:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11330 00000100:00100000:0.0:1746143772.212008:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622301568:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143772.212014:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.212020:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7b49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a327 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.212033:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.212034:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.212038:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a327 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.212046:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a327 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.212052:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d800, rc 0) 00000100:00100000:0.0:1746143772.212064:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622301568:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 56us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.212068:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11330 00000100:00100000:0.0:1746143772.212076:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11331 00000100:00100000:0.0:1746143772.212081:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:31875:x1830963622301696:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143772.212086:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.212090:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7b50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a32e expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.212104:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e03b600/0x87925e4cb73a7a93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2be expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.212111:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7b42 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a320 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.212118:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73a7aee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2e1 expref: 7 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.212123:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.212124:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.212127:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7b50 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3432448->4157439] (req 3432448->4157439) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a32e expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.212151:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73a7aee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2e1 expref: 7 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.212162:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73a7aee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2e1 expref: 7 pid: 13430 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746143772.212173:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626665856:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143772.212224:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7b42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a320 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.212231:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7b42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a320 expref: 9 pid: 1945 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746143772.212238:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626665984:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143772.213514:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e03b600/0x87925e4cb73a7a93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2be expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.213532:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e03b600/0x87925e4cb73a7a93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2be expref: 23 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746143772.213547:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626666112:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.213741:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626665728:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.213768:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b34 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a312 expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.213778:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7b34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a312 expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.213792:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d600, rc 0) 00000100:00100000:1.0:1746143772.213813:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622301184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4164us (4386us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.213820:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11327 00000100:00100000:0.0:1746143772.214137:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.216394:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.218547:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.220401:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622302208 00000100:00100000:1.0:1746143772.220415:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622302208 00002000:00100000:1.0:1746143772.220464:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880095c3a300 x1830963622302208/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.220474:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3a300 with x1830963622302208 ext(2097152->3145727) 00002000:00010000:1.0:1746143772.220480:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3a300 00000100:00100000:1.0:1746143772.220503:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3143 00000100:00100000:1.0:1746143772.220510:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622302208:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143772.223356:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.223362:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.223405:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.223474:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622302720 00000100:00100000:1.0:1746143772.223483:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622302720 00010000:00010000:1.0:1746143772.223522:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e03b600/0x87925e4cb73a7a93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2be expref: 23 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.223544:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622302336 00000100:00100000:1.0:1746143772.223546:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622302336 00010000:00010000:1.0:1746143772.223555:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7b42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a320 expref: 8 pid: 1945 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746143772.223568:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5266 00000100:00100000:1.0:1746143772.223573:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622302720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.223586:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.223604:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e03b600/0x87925e4cb73a7a93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2be expref: 23 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.223619:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e03b600/0x87925e4cb73a7a93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2be expref: 23 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.223641:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e03b600/0x87925e4cb73a7a93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2be expref: 23 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.223662:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.223696:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622302720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 122us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.223703:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5266 00000100:00100000:1.0:1746143772.223717:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5267 00000100:00100000:1.0:1746143772.223721:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622302336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.223728:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.223734:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7b42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a320 expref: 8 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.223741:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7b42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a320 expref: 8 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.223751:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7b42 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a320 expref: 8 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.223759:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.223772:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622302336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.223780:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5267 00000100:00100000:0.0:1746143772.231078:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.231110:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622302848 00000100:00100000:0.0:1746143772.231117:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622302848 00010000:00010000:0.0:1746143772.231145:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a30b expref: 11 pid: 6587 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746143772.231171:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5268 00000100:00100000:0.0:1746143772.231179:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622302848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143772.231195:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143772.231200:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a30b expref: 11 pid: 6587 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746143772.231209:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a30b expref: 11 pid: 6587 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746143772.231232:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a7b2d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a30b expref: 11 pid: 6587 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746143772.231249:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143772.231254:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a7b5e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.231264:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a7b5e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.231270:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a7b5e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143772.231304:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.231321:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622302848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 143us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.231327:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5268 00000100:00100000:1.0:1746143772.231495:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622302208:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10984us (12953us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143772.231502:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3143 00002000:00100000:1.0:1746143772.231508:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880095c3a300 x1830963622302208/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.231516:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3a300 with x1830963622302208 ext(2097152->3145727) 00002000:00010000:1.0:1746143772.231519:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3a300 00000100:00100000:0.0:1746143772.234655:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.237465:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.238151:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.238520:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.239014:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5269 00000100:00100000:1.0:1746143772.239204:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622303232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.239214:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.239233:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73a7aee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2e1 expref: 9 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.239243:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73a7aee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2e1 expref: 9 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.239254:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73a7aee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2e1 expref: 9 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.239267:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.239269:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.239275:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3432448->4157439) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a32e expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.239287:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3432448->4157439) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a32e expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.239311:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3432448->4157439) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a32e expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.239322:0:12362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7b50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3432448->4157439) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a32e expref: 21 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.239333:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626666624:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.239381:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096bebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.241670:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.241697:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626666624:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143772.241704:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143772.241716:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.241748:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622303232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2726us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.241756:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5269 00000100:00100000:1.0:1746143772.241818:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622303744 00000100:00100000:1.0:1746143772.241824:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622303744 00000100:00100000:0.0:1746143772.242237:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.242267:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622303872 00000100:00100000:1.0:1746143772.242271:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622303872 00000100:00100000:0.0:1746143772.242298:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11334 00000100:00100000:0.0:1746143772.242305:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622303872:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143772.242312:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.242318:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a7b88 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a351 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143772.242339:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626666880:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143772.242381:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.249394:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.252446:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.252596:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622304640 00000100:00100000:1.0:1746143772.252604:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622304640 00000100:00100000:1.0:1746143772.252655:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4632 00000100:00100000:1.0:1746143772.252663:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:31880:x1830963622304640:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143772.252865:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:31880:x1830963622304640:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 203us (425us total) trans 8589943459 rc 0/0 00000100:00100000:1.0:1746143772.252872:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4632 00000100:00100000:0.0:1746143772.252902:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.253034:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622305024 00000100:00100000:1.0:1746143772.253037:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622305024 00000100:00100000:1.0:1746143772.253065:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4633 00000100:00100000:1.0:1746143772.253070:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+275:31875:x1830963622305024:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143772.253152:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+276:31875:x1830963622305024:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 80us (248us total) trans 8589943460 rc 0/0 00000100:00100000:1.0:1746143772.253157:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4633 00000100:00100000:0.0:1746143772.253353:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.263306:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622305280 00000100:00100000:1.0:1746143772.263316:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622305280 00010000:00010000:1.0:1746143772.263351:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7b50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->4157439) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a32e expref: 24 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.263385:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5271 00000100:00100000:1.0:1746143772.263392:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622305280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.263407:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.263426:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7b50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3432448->4157439) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a32e expref: 24 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.263438:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3432448->4157439) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a32e expref: 24 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.263465:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7b50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3432448->4157439) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a32e expref: 24 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.263485:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.263487:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.263495:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a7b7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a343 expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.263503:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a7b7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a343 expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.263540:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a7b7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a343 expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.263552:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626667008:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.263639:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.266842:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626667008:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143772.266864:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.267109:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622305280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3715us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.267120:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5271 00000100:00100000:1.0:1746143772.267356:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.282710:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.296097:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.313901:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.319535:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.320722:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.320780:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.320831:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622306560 00000100:00100000:1.0:1746143772.320835:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622306560 00000100:00100000:0.0:1746143772.326824:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.332567:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.341015:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.341615:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622307072 00000100:00100000:1.0:1746143772.341628:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622307072 00010000:00010000:1.0:1746143772.341678:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a7a9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->929791) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2c5 expref: 10 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.341741:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5272 00000100:00100000:1.0:1746143772.341750:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622307072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.341766:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.341800:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a7a9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->929791) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2c5 expref: 10 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.341813:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a7a9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->929791) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2c5 expref: 10 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.341838:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a7a9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->929791) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2c5 expref: 10 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.341870:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.341872:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.341880:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a7bd5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a37b expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.341894:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a7bd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a37b expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.341962:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a7bd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a37b expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.341988:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626667392:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.342087:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.343650:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626667392:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143772.343669:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.343706:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622307072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1956us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.343714:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5272 00000100:00100000:0.0:1746143772.350222:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.350276:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.350376:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622307328 00000100:00100000:1.0:1746143772.350387:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622307328 00002000:00100000:1.0:1746143772.350438:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8801368eb100 x1830963622307328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.350447:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb100 with x1830963622307328 ext(0->1048575) 00002000:00010000:1.0:1746143772.350452:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368eb100 00000100:00100000:1.0:1746143772.350488:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622307584 00000100:00100000:1.0:1746143772.350491:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622307584 00002000:00100000:1.0:1746143772.350505:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8801368eb800 x1830963622307584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.350512:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb800 with x1830963622307584 ext(1048576->2097151) 00002000:00010000:1.0:1746143772.350515:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368eb800 00000100:00100000:1.0:1746143772.350529:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3146 00000100:00100000:1.0:1746143772.350535:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622307328:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143772.359605:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622307328:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9057us (9382us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143772.359618:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3146 00002000:00100000:1.0:1746143772.359630:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8801368eb100 x1830963622307328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.359641:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb100 with x1830963622307328 ext(0->1048575) 00002000:00010000:1.0:1746143772.359648:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368eb100 00000100:00100000:0.0:1746143772.376371:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.381431:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.386451:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.386507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.386638:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622308480 00000100:00100000:1.0:1746143772.386649:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622308480 00010000:00010000:1.0:1746143772.386688:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a7bf1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a382 expref: 26 pid: 6587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.386724:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5273 00000100:00100000:1.0:1746143772.386732:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2010:x1830963622308480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.386746:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.386752:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a7bf1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a382 expref: 26 pid: 6587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.386763:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a7bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a382 expref: 26 pid: 6587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.386786:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143772.386791:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143772.386799:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143772.386804:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.386844:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2010:x1830963622308480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 113us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.386851:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5273 00000100:00100000:0.0:1746143772.391470:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.391498:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.391610:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622308608 00000100:00100000:1.0:1746143772.391621:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622308608 00010000:00010000:1.0:1746143772.391653:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a7b73 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a33c expref: 11 pid: 6587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.391691:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5274 00000100:00100000:1.0:1746143772.391699:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622308608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.391711:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.391717:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a7b73 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a33c expref: 11 pid: 6587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.391727:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a7b73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a33c expref: 11 pid: 6587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.391750:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a7b73 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a33c expref: 11 pid: 6587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.391774:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143772.391779:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143772.391787:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143772.391794:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143772.391814:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.391863:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622308608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 164us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.391869:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5274 00000100:00100000:0.0:1746143772.412518:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.426121:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.429767:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.429851:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622309376 00000100:00100000:1.0:1746143772.429860:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622309376 00000100:00100000:1.0:1746143772.430032:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4635 00000100:00100000:1.0:1746143772.430040:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:31887:x1830963622309376:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143772.430220:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+280:31887:x1830963622309376:12345-192.168.202.3@tcp:35:cat.0 Request processed in 180us (459us total) trans 8589943465 rc 0/0 00000100:00100000:1.0:1746143772.430226:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4635 00000100:00100000:0.0:1746143772.433413:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.433442:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622309504 00000100:00100000:0.0:1746143772.433449:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622309504 00010000:00010000:0.0:1746143772.433485:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7b49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a327 expref: 10 pid: 1945 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746143772.434285:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5276 00000100:00100000:0.0:1746143772.434295:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622309504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143772.434314:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143772.434337:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7b49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a327 expref: 10 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746143772.434348:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a327 expref: 10 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746143772.434370:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a7b49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a327 expref: 10 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746143772.434458:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.434497:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622309504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 203us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.434504:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5276 00000100:00100000:0.0:1746143772.435511:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.435583:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.435864:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622309632 00000100:00100000:1.0:1746143772.435872:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622309632 00010000:00010000:1.0:1746143772.435898:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a7a69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2b0 expref: 27 pid: 9839 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746143772.436429:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7d200/0x87925e4cb73a7a23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a286 expref: 8 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746143772.436444:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7d200/0x87925e4cb73a7a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a286 expref: 8 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746143772.436456:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d200/0x87925e4cb73a7a23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a286 expref: 8 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746143772.436471:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.436473:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.436480:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.436489:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.436522:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.436534:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626668288:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143772.436594:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5619c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.441442:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.441738:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626668288:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143772.441758:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143772.441814:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2011:x1830963622309760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5401us (6230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.441824:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5278 00000100:00100000:0.0:1746143772.446081:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.502345:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.508385:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.508430:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.508664:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622310656 00000100:00100000:3.0:1746143772.508677:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622310656 00010000:00010000:3.0:1746143772.508714:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a779f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a121 expref: 26 pid: 13430 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746143772.508738:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622310528 00000100:00100000:3.0:1746143772.508740:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622310528 00010000:00010000:3.0:1746143772.508751:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a76aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0c6 expref: 9 pid: 13436 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746143772.508768:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5279 00000100:00100000:3.0:1746143772.508774:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622310656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143772.508787:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143772.508806:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a779f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a121 expref: 26 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746143772.508817:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a779f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a121 expref: 26 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746143772.508840:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a779f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a121 expref: 26 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746143772.508858:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143772.508894:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622310656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 119us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.508900:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5279 00000100:00100000:0.0:1746143772.510791:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.511019:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622310784 00000100:00100000:1.0:1746143772.511027:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622310784 00010000:00010000:1.0:1746143772.511055:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a76db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f0 expref: 8 pid: 12327 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746143772.511085:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5281 00000100:00100000:1.0:1746143772.511092:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622310784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.511104:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.511119:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a76db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f0 expref: 8 pid: 12327 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.511131:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a76db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f0 expref: 8 pid: 12327 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.511154:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73a76db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f0 expref: 8 pid: 12327 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.511186:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.511188:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.511196:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.511480:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.511532:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.511544:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626668800:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.512187:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.516708:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626668800:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143772.516733:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.516778:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2011:x1830963622310784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5684us (5992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.516789:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5281 00000100:00100000:0.0:1746143772.518979:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.524308:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622311424 00000100:00100000:3.0:1746143772.524318:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622311424 00000100:00100000:3.0:1746143772.524393:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11341 00000100:00100000:3.0:1746143772.524402:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31889:x1830963622311424:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.524422:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.524442:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3a5 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143772.524456:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143772.524473:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a76cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0cd expref: 6 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.524481:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a77a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a128 expref: 24 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.524488:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73a76e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f7 expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.524495:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.524497:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.524500:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->1662975] (req 1048576->1662975) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.524533:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73a76e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f7 expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.524545:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73a76e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f7 expref: 10 pid: 13430 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746143772.524558:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626668928:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.524635:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a77a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a128 expref: 24 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.524644:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a77a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a128 expref: 24 pid: 13430 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746143772.524652:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626669056:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.524676:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a76cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0cd expref: 6 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.524684:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a76cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0cd expref: 6 pid: 1945 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746143772.524692:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626669184:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.524714:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5619c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143772.524729:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7c30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.524744:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7c30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.524757:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7c37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.524763:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7c37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.524768:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7c37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.524871:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7c3e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.524881:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7c3e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.524887:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7c3e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143772.524895:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143772.525000:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7c30 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525007:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7c30 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525012:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7c30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525017:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7c30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525023:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84f800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143772.525028:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7c30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525034:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7c30 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525045:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143772.525047:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143772.525051:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7c30 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525056:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7c30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525084:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7c37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525088:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7c37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525093:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7c37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525097:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84fc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143772.525099:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7c37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525103:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7c37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525109:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800969c8000) 00010000:00010000:2.0:1746143772.525111:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143772.525113:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7c37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525120:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7c37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.525153:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a7c29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a39e expref: 28 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.525162:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7c3e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a39e expref: 27 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.525168:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143772.525170:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143772.525172:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ea00, rc 0) 00000100:00100000:2.0:1746143772.525197:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:31896:x1830963622311296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 585us (741us total) trans 8589943466 rc 0/0 00000100:00100000:2.0:1746143772.525203:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12754 00000100:00100000:1.0:1746143772.529667:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.529692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.529853:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626668928:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.529865:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626669056:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.529873:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626669184:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.529933:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->1662975] (req 1048576->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.529952:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4200, rc 0) 00000100:00100000:3.0:1746143772.530013:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31889:x1830963622311424:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5611us (5894us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.530022:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11341 00000100:00100000:1.0:1746143772.530188:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.530212:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.530229:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622311936 00000100:00100000:1.0:1746143772.530235:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622311936 00000100:00100000:1.0:1746143772.530264:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622312064 00000100:00100000:1.0:1746143772.530266:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622312064 00000100:00100000:1.0:1746143772.530278:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11342 00000100:00100000:1.0:1746143772.530284:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622311936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.530300:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.530315:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a7c4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3ac expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.530334:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.530335:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.530345:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a7c4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ac expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.530359:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a7c4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ac expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.530365:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012224fc00, rc 0) 00000100:00100000:0.0:1746143772.530419:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622311680 00000100:00100000:0.0:1746143772.530424:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622311680 00010000:00010000:0.0:1746143772.530443:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a77a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a128 expref: 25 pid: 13430 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746143772.530464:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622311808 00000100:00100000:0.0:1746143772.530466:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622311808 00010000:00010000:0.0:1746143772.530475:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a76cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0cd expref: 7 pid: 1945 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746143772.530488:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5282 00000100:00100000:0.0:1746143772.530492:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622311680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143772.530501:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143772.530519:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a77a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a128 expref: 25 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746143772.530529:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a77a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a128 expref: 25 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746143772.530544:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a77a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a128 expref: 25 pid: 13430 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746143772.530594:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5283 00000100:00100000:2.0:1746143772.530602:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622311808:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.530610:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.530618:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a76cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0cd expref: 7 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746143772.530626:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a76cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0cd expref: 7 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746143772.530638:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a76cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0cd expref: 7 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746143772.530658:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143772.530667:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11343 00000100:00100000:3.0:1746143772.530715:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622312064:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143772.530767:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.530775:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7c53 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3b3 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.530786:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.530792:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7c53 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3b3 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.530800:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c800/0x87925e4cb73a7c53 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3b3 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.530815:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c800, rc 0) 00000100:00100000:1.0:1746143772.530881:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622311936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 596us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.530887:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11342 00010000:00010000:0.0:1746143772.530938:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.530982:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2008:x1830963622311808:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 379us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.530987:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5283 00000100:00100000:3.0:1746143772.531037:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622312064:12345-192.168.202.3@tcp:101:cat.0 Request processed in 361us (822us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143772.531042:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11343 00000100:00100000:0.0:1746143772.531077:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622311680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 583us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.531082:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5282 00000100:00100000:2.0:1746143772.531128:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.531156:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.531180:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622312192 00000100:00100000:3.0:1746143772.531184:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622312192 00000100:00100000:2.0:1746143772.531185:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.531205:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11344 00000100:00100000:3.0:1746143772.531210:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622312192:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143772.531218:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.531228:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a7c5a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3ba expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.531266:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626669312:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143772.531296:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622311552 00000100:00100000:1.0:1746143772.531304:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622311552 00000100:00100000:3.0:1746143772.531318:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5619c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.531321:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622312320 00000100:00100000:1.0:1746143772.531323:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622312320 00010000:00010000:1.0:1746143772.531331:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73a76e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f7 expref: 11 pid: 13430 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746143772.531348:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5284 00000100:00100000:1.0:1746143772.531353:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622312320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143772.531358:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 725 00010000:00010000:1.0:1746143772.531360:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143772.531365:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2011:x1830963622311552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.531366:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73a76e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f7 expref: 11 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746143772.531373:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.531374:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73a76e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f7 expref: 11 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.531384:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73a76e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a0f7 expref: 11 pid: 13430 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746143772.531388:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7c3e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a39e expref: 27 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.531395:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.531397:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.531400:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143772.531401:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.531404:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143772.531407:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.531420:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622311552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.531425:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 725 00010000:00010000:1.0:1746143772.531425:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.531431:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626669440:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.531449:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.533318:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626669312:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143772.533345:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a7c5a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ba expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.533357:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d400/0x87925e4cb73a7c5a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ba expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.533367:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d400, rc 0) 00000100:00100000:3.0:1746143772.533417:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622312192:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2205us (2287us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143772.533425:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11344 00000100:00100000:1.0:1746143772.534126:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626669440:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143772.534139:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.534554:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622312320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3199us (3367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.534563:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5284 00000100:00100000:1.0:1746143772.538160:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.538220:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622312576 00000100:00100000:2.0:1746143772.538231:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622312576 00002000:00100000:2.0:1746143772.538280:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1658880->1662975) req@ffff880082ed6680 x1830963622312576/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.538290:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed6680 with x1830963622312576 ext(1658880->1662975) 00002000:00010000:2.0:1746143772.538295:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed6680 00000100:00100000:2.0:1746143772.538329:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3153 00000100:00100000:2.0:1746143772.538338:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622312576:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143772.538868:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622312576:12345-192.168.202.3@tcp:3:cat.0 Request processed in 529us (716us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143772.538875:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3153 00002000:00100000:2.0:1746143772.538880:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1658880->1662975) req@ffff880082ed6680 x1830963622312576/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.538887:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed6680 with x1830963622312576 ext(1658880->1662975) 00002000:00010000:2.0:1746143772.538890:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed6680 00000100:00100000:0.0:1746143772.539004:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.539295:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622312832 00000100:00100000:2.0:1746143772.539300:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622312832 00002000:00100000:2.0:1746143772.539317:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b62300 x1830963622312832/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.539324:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62300 with x1830963622312832 ext(0->1048575) 00002000:00010000:2.0:1746143772.539327:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b62300 00000100:00100000:2.0:1746143772.539338:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3154 00000100:00100000:2.0:1746143772.539343:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622312832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143772.542129:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.542800:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622313088 00000100:00100000:2.0:1746143772.542809:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622313088 00002000:00100000:2.0:1746143772.542857:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1912831) req@ffff880092b63100 x1830963622313088/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.542867:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b63100 with x1830963622313088 ext(1048576->1912831) 00002000:00010000:2.0:1746143772.542873:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b63100 00000100:00100000:2.0:1746143772.542936:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3155 00000100:00100000:2.0:1746143772.542945:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2011:x1830963622313088:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143772.548390:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.549233:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2011:x1830963622313088:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6286us (7112us total) trans 0 rc 864256/864256 00000100:00100000:0.0:1746143772.549244:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3155 00002000:00100000:0.0:1746143772.549255:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1912831) req@ffff880092b63100 x1830963622313088/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 864256/864256 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143772.549270:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b63100 with x1830963622313088 ext(1048576->1912831) 00002000:00010000:0.0:1746143772.549276:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b63100 00000100:00100000:3.0:1746143772.549433:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622313344 00000100:00100000:3.0:1746143772.549441:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622313344 00000100:00100000:3.0:1746143772.549485:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4636 00000100:00100000:3.0:1746143772.549491:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137358850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:31889:x1830963622313344:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143772.549618:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622312832:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10272us (10612us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.549625:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3154 00002000:00100000:2.0:1746143772.549631:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b62300 x1830963622312832/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.549639:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62300 with x1830963622312832 ext(0->1048575) 00002000:00010000:2.0:1746143772.549643:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b62300 00000100:00100000:3.0:1746143772.549663:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137358850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:31889:x1830963622313344:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 172us (1283us total) trans 8589943467 rc 0/0 00000100:00100000:3.0:1746143772.549669:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4636 00000100:00100000:0.0:1746143772.556704:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.559383:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622313600 00000100:00100000:2.0:1746143772.559396:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622313600 00002000:00100000:2.0:1746143772.559456:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1662976->2097151) req@ffff880092b60000 x1830963622313600/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.559466:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60000 with x1830963622313600 ext(1662976->2097151) 00002000:00010000:2.0:1746143772.559473:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b60000 00000100:00100000:2.0:1746143772.559513:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3156 00000100:00100000:2.0:1746143772.559522:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622313600:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143772.562751:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.565780:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622313856 00000100:00100000:1.0:1746143772.565796:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622313856 00000100:00100000:1.0:1746143772.565878:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12755 00000100:00100000:1.0:1746143772.565887:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+280:31899:x1830963622313856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.565948:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.565981:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a7c61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3c1 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.566073:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566085:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566095:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566107:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521600/0x87925e4cb73a7c6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566112:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521600/0x87925e4cb73a7c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566116:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521600/0x87925e4cb73a7c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566217:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a7c76 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566226:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a7c76 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566232:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a7c76 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746143772.566239:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143772.566314:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566320:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566325:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566331:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566335:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e521000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143772.566339:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566345:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566356:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143772.566359:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143772.566363:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566380:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a7c68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566397:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521600/0x87925e4cb73a7c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566401:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521600/0x87925e4cb73a7c6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566406:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521600/0x87925e4cb73a7c6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566409:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e521600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143772.566411:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521600/0x87925e4cb73a7c6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566414:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521600/0x87925e4cb73a7c6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566419:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22100) 00010000:00010000:1.0:1746143772.566421:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143772.566422:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521600/0x87925e4cb73a7c6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566426:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521600/0x87925e4cb73a7c6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143772.566455:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a7c61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3c1 expref: 283 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.566465:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a7c76 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3c1 expref: 282 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.566475:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143772.566477:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143772.566479:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521200, rc 0) 00000100:00100000:1.0:1746143772.566524:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+282:31899:x1830963622313856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 639us (3783us total) trans 8589943468 rc 0/0 00000100:00100000:1.0:1746143772.566530:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12755 00000100:00100000:2.0:1746143772.566735:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622313600:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7214us (10043us total) trans 0 rc 434176/434176 00000100:00100000:2.0:1746143772.566742:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3156 00002000:00100000:2.0:1746143772.566750:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1662976->2097151) req@ffff880092b60000 x1830963622313600/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 434176/434176 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.566759:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60000 with x1830963622313600 ext(1662976->2097151) 00002000:00010000:2.0:1746143772.566764:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b60000 00000100:00100000:2.0:1746143772.576195:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.576278:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622314112 00000100:00100000:3.0:1746143772.576312:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622314112 00000100:00100000:3.0:1746143772.576379:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12756 00000100:00100000:3.0:1746143772.576388:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+282:31902:x1830963622314112:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.576412:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.576433:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7c84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3c8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.576625:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.576638:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.576648:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.576659:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7c92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.576664:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.576668:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143772.576736:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.576756:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622314240 00000100:00100000:1.0:1746143772.576760:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622314240 00000100:00100000:1.0:1746143772.577080:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 726 00000100:00100000:1.0:1746143772.577086:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+284:2011:x1830963622314240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.577094:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.577110:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a7c76 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3c1 expref: 284 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.577118:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7c99 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143772.577126:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143772.577130:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.577460:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+283:2011:x1830963622314240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 373us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.577467:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 726 00010000:00010000:3.0:1746143772.577710:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7c99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577719:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7c99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143772.577729:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:1.0:1746143772.577741:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.577775:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143772.577807:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577813:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577819:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577824:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577829:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7cc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.577834:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577841:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577848:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143772.577852:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.577854:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577859:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7c8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143772.577861:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622314368 00000100:00100000:2.0:1746143772.577865:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622314368 00010000:00010000:3.0:1746143772.577882:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577887:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7c92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577892:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577896:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7de00 already unused, calling callback (ffffffffa0f2a690) 00000100:00100000:2.0:1746143772.577897:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622314496 00010000:00010000:3.0:1746143772.577898:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143772.577899:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622314496 00010000:00010000:3.0:1746143772.577903:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7c92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577908:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093754000) 00010000:00010000:3.0:1746143772.577926:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.577929:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7c92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143772.577931:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11345 00010000:00010000:3.0:1746143772.577934:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7c92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.577982:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7c84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3c8 expref: 284 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.577993:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7c99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3c8 expref: 283 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.578000:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143772.578003:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143772.578005:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d600, rc 0) 00000100:00100000:0.0:1746143772.578023:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11346 00000100:00100000:0.0:1746143772.578032:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622314496:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143772.578033:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+283:31902:x1830963622314112:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1647us (1850us total) trans 8589943469 rc 0/0 00000100:00100000:3.0:1746143772.578040:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12756 00010000:00010000:0.0:1746143772.578042:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.578053:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a7ca7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3d6 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143772.578102:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626669568:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143772.578163:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.578280:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622314368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143772.578290:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.578299:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73a7cae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3cf expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.578326:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626669696:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143772.578351:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.579365:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.579657:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622314752 00000100:00100000:2.0:1746143772.579664:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622314752 00002000:00100000:2.0:1746143772.579699:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88009c4d7800 x1830963622314752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.579709:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7800 with x1830963622314752 ext(2097152->3145727) 00002000:00010000:2.0:1746143772.579714:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d7800 00000100:00100000:2.0:1746143772.579780:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3157 00000100:00100000:2.0:1746143772.579788:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622314752:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143772.585673:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.585709:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.585772:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622315008 00000100:00100000:3.0:1746143772.585783:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622315008 00000100:00100000:3.0:1746143772.585841:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4637 00000100:00100000:3.0:1746143772.585850:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+283:31902:x1830963622315008:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143772.586086:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:31902:x1830963622315008:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 237us (423us total) trans 8589943470 rc 0/0 00000100:00100000:3.0:1746143772.586093:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4637 00002000:00010000:0.0:1746143772.587751:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime: 1746143771 -> 1746143772 00002000:00010000:0.0:1746143772.587758:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime: 1746143771 -> 1746143773 00002000:00010000:0.0:1746143772.587760:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime: 1746143771 -> 1746143772 00000100:00100000:0.0:1746143772.587780:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626669568:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143772.587814:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a7ca7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3d6 expref: 25 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.587828:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a7ca7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3d6 expref: 25 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.587856:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7d800, rc 0) 00000100:00100000:0.0:1746143772.587898:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622314496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9868us (10121us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143772.587906:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11346 00002000:00010000:3.0:1746143772.589298:0:12327:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime: 1746143771 -> 1746143772 00002000:00010000:3.0:1746143772.589302:0:12327:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143771 -> 1746143773 00002000:00010000:3.0:1746143772.589304:0:12327:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime: 1746143771 -> 1746143772 00000100:00100000:3.0:1746143772.589319:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626669696:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143772.589344:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73a7cae lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3cf expref: 26 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.589355:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73a7cae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3cf expref: 26 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.589367:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ea00, rc 0) 00000100:00100000:3.0:1746143772.589393:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622314368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11456us (11651us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143772.589398:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11345 00000100:00100000:0.0:1746143772.589789:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622315136 00000100:00100000:0.0:1746143772.589796:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622315136 00000100:00100000:0.0:1746143772.589842:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 727 00000100:00100000:0.0:1746143772.589848:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:2009:x1830963622315136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143772.589860:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143772.589878:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d600/0x87925e4cb73a7c99 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3c8 expref: 284 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.589891:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143772.589894:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.589908:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+283:2009:x1830963622315136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 61us (4199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.589927:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 727 00000100:00100000:2.0:1746143772.594049:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622314752:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14248us (14673us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.594063:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3157 00002000:00100000:2.0:1746143772.594078:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88009c4d7800 x1830963622314752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.594087:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7800 with x1830963622314752 ext(2097152->3145727) 00002000:00010000:2.0:1746143772.594093:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d7800 00000100:00100000:0.0:1746143772.597466:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.597642:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622315264 00000100:00100000:3.0:1746143772.597652:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622315264 00000100:00100000:3.0:1746143772.597699:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11347 00000100:00100000:3.0:1746143772.597707:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:31896:x1830963622315264:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143772.597726:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.597746:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3dd expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.597778:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.597786:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143772.597787:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143772.597791:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 8 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.597821:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.597832:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 24 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746143772.597845:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626669824:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.598763:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.600276:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.600364:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622315392 00000100:00100000:1.0:1746143772.600373:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622315392 00000100:00100000:1.0:1746143772.600414:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11348 00000100:00100000:1.0:1746143772.600422:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:31899:x1830963622315392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.600438:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.600453:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3e4 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.600479:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 8 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.600487:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.600489:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.600492:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.601287:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626669824:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.601311:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 8 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.601328:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ca00, rc 0) 00000100:00100000:3.0:1746143772.601382:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:31896:x1830963622315264:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3675us (3928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.601389:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11347 00010000:00010000:1.0:1746143772.601472:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.601488:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 7 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.601501:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626669952:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.601975:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.606028:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.606142:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626669952:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143772.606174:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.606193:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e520200, rc 0) 00000100:00100000:1.0:1746143772.606242:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:31899:x1830963622315392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5820us (5971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.606252:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11348 00000100:00100000:0.0:1746143772.606349:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.606469:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622315648 00000100:00100000:2.0:1746143772.606476:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622315648 00002000:00100000:2.0:1746143772.606516:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1912832->2097151) req@ffff88009c4d6d80 x1830963622315648/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.606525:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6d80 with x1830963622315648 ext(1912832->2097151) 00010000:00010000:2.0:1746143772.606532:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 8 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.606549:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 8 pid: 1945 timeout: 931 lvb_type: 0 00002000:00010000:2.0:1746143772.606556:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d6d80 00000100:00100000:2.0:1746143772.606582:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622315520 00000100:00100000:2.0:1746143772.606584:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622315520 00002000:00100000:2.0:1746143772.606598:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2269184->2646015) req@ffff88009c4d6680 x1830963622315520/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.606605:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6680 with x1830963622315520 ext(2269184->2646015) 00010000:00010000:2.0:1746143772.606611:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 26 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.606619:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 26 pid: 1945 timeout: 931 lvb_type: 0 00002000:00010000:2.0:1746143772.606624:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d6680 00000100:00100000:3.0:1746143772.606651:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1350 00000100:00100000:2.0:1746143772.606733:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1351 00000100:00100000:3.0:1746143772.606762:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622315648:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143772.606782:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622315520:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143772.612438:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622315648:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5765us (6410us total) trans 17179872913 rc 0/0 00000100:00100000:3.0:1746143772.612452:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1350 00002000:00100000:3.0:1746143772.612464:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1912832->2097151) req@ffff88009c4d6d80 x1830963622315648/t17179872913(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.612474:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6d80 with x1830963622315648 ext(1912832->2097151) 00010000:00010000:3.0:1746143772.612487:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 10 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746143772.612803:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 10 pid: 1945 timeout: 931 lvb_type: 0 00002000:00010000:3.0:1746143772.612811:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d6d80 00000100:00100000:2.0:1746143772.613905:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622315520:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7162us (7553us total) trans 17179872914 rc 0/0 00000100:00100000:2.0:1746143772.613928:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1351 00002000:00100000:2.0:1746143772.613936:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2269184->2646015) req@ffff88009c4d6680 x1830963622315520/t17179872914(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.613942:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6680 with x1830963622315520 ext(2269184->2646015) 00010000:00010000:2.0:1746143772.613951:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 28 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.613960:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 28 pid: 1945 timeout: 931 lvb_type: 0 00002000:00010000:2.0:1746143772.613978:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d6680 00000100:00100000:0.0:1746143772.616627:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.616666:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.616747:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622315776 00000100:00100000:1.0:1746143772.616757:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622315776 00010000:00010000:1.0:1746143772.616792:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 28 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.616817:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622315904 00000100:00100000:1.0:1746143772.616819:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622315904 00010000:00010000:1.0:1746143772.616830:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 10 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.616857:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5285 00000100:00100000:1.0:1746143772.616865:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622315776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.616879:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.616899:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 28 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.616908:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 28 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.616953:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7c14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2646015) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a390 expref: 28 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.616980:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.616981:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.616988:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 10 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.617001:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 10 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.617033:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 10 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.617044:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626670080:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.617113:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fb300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.617290:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5286 00000100:00100000:2.0:1746143772.617298:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622315904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.617305:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.617316:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 10 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.617325:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 10 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.617337:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124adf600/0x87925e4cb73a7c1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a397 expref: 10 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.617352:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.617353:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.617357:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.617363:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.617385:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.617392:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626670208:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143772.617413:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.618872:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626670080:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143772.618889:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.618932:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622315776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2068us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.618941:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5285 00000100:00100000:0.0:1746143772.621648:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.621712:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622316160 00000100:00100000:3.0:1746143772.621720:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622316160 00000100:00100000:2.0:1746143772.621734:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626670208:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143772.621755:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143772.621762:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88009c4d7100 x1830963622316160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.621778:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7100 with x1830963622316160 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.621783:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7100 00000100:00100000:2.0:1746143772.621789:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622315904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4493us (5122us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.621798:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5286 00000100:00100000:3.0:1746143772.621801:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3158 00000100:00100000:3.0:1746143772.621807:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963622316160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143772.626512:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.626896:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622316416 00000100:00100000:3.0:1746143772.626906:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622316416 00002000:00100000:3.0:1746143772.626991:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88009c4d7b80 x1830963622316416/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.627001:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7b80 with x1830963622316416 ext(2097152->4194303) 00002000:00010000:3.0:1746143772.627007:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7b80 00000100:00100000:3.0:1746143772.627078:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3159 00000100:00100000:3.0:1746143772.627087:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2011:x1830963622316416:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143772.628372:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963622316160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6560us (6728us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.628380:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3158 00002000:00100000:2.0:1746143772.628387:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88009c4d7100 x1830963622316160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.628395:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7100 with x1830963622316160 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.628399:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7100 00000100:00100000:0.0:1746143772.634808:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.635008:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622316544 00000100:00100000:1.0:1746143772.635019:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622316544 00000100:00100000:1.0:1746143772.635129:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11349 00000100:00100000:1.0:1746143772.635138:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+24:31899:x1830963622316544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.635159:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.635178:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3eb expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.635208:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 9 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.635216:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.635219:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.635222:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.635256:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 9 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.635268:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 9 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.635280:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626670336:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.635371:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.639053:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.639235:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626670336:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143772.639266:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.639283:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466800, rc 0) 00000100:00100000:1.0:1746143772.639327:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:31899:x1830963622316544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4190us (4528us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.639335:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11349 00000100:00100000:2.0:1746143772.639469:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622316672 00000100:00100000:2.0:1746143772.639476:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622316672 00002000:00100000:2.0:1746143772.639942:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1662975) req@ffff88009c4d5180 x1830963622316672/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.639952:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5180 with x1830963622316672 ext(1048576->1662975) 00010000:00010000:2.0:1746143772.639958:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 10 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.639980:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 10 pid: 1945 timeout: 931 lvb_type: 0 00002000:00010000:2.0:1746143772.639986:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4d5180 00000100:00100000:2.0:1746143772.640008:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1352 00000100:00100000:2.0:1746143772.640016:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622316672:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143772.643605:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2011:x1830963622316416:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16509us (17093us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143772.643618:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3159 00002000:00100000:3.0:1746143772.643630:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88009c4d7b80 x1830963622316416/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.643639:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7b80 with x1830963622316416 ext(2097152->4194303) 00002000:00010000:3.0:1746143772.643645:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7b80 00000100:00100000:2.0:1746143772.645515:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622316672:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5493us (6466us total) trans 21474840234 rc 0/0 00000100:00100000:2.0:1746143772.645527:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1352 00002000:00100000:2.0:1746143772.645537:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1662975) req@ffff88009c4d5180 x1830963622316672/t21474840234(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.645546:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5180 with x1830963622316672 ext(1048576->1662975) 00010000:00010000:2.0:1746143772.645555:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 12 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.645569:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 12 pid: 1945 timeout: 931 lvb_type: 0 00002000:00010000:2.0:1746143772.645575:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4d5180 00000100:00100000:0.0:1746143772.649592:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.649802:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.649878:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622316800 00000100:00100000:1.0:1746143772.649890:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622316800 00000100:00100000:1.0:1746143772.649977:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622316928 00000100:00100000:1.0:1746143772.649980:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622316928 00000100:00100000:1.0:1746143772.650000:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11350 00000100:00100000:1.0:1746143772.650007:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622316800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.650026:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.650045:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a7cca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3f2 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.650069:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.650071:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.650080:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a7cca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f2 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.650096:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a7cca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f2 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.650107:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:1.0:1746143772.650150:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622316800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 143us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.650156:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11350 00000100:00100000:1.0:1746143772.650172:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11351 00000100:00100000:1.0:1746143772.650177:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622316928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.650183:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.650193:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467600/0x87925e4cb73a7cd1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a3f9 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.650229:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626670464:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143772.650284:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.651622:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.651703:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622317056 00000100:00100000:2.0:1746143772.651708:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622317056 00010000:00010000:2.0:1746143772.651734:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 14 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746143772.651762:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5287 00000100:00100000:2.0:1746143772.651768:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622317056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.651780:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.651802:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 14 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.651811:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 14 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.651830:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.651832:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.651838:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.651845:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.651872:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.651882:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626670592:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143772.652113:0:13436:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff880082ed6a00 x1830963626670464) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 14 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.652133:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7c22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1662975) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3a5 expref: 14 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.652156:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626670464:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.652187:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467600/0x87925e4cb73a7cd1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f9 expref: 13 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.652198:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467600/0x87925e4cb73a7cd1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f9 expref: 13 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.652206:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467600, rc 0) 00000100:00100000:1.0:1746143772.652268:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622316928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2087us (2463us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.652276:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11351 00000100:00100000:2.0:1746143772.653153:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.656338:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626670592:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143772.656366:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.656426:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622317056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4656us (4807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.656437:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5287 00000100:00100000:0.0:1746143772.657308:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.658158:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.658337:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622317184 00000100:00100000:1.0:1746143772.658347:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622317184 00000100:00100000:2.0:1746143772.658570:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622317440 00000100:00100000:2.0:1746143772.658575:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622317440 00002000:00100000:2.0:1746143772.658615:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880091d4d180 x1830963622317440/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.658624:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4d180 with x1830963622317440 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.658628:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4d180 00000100:00100000:1.0:1746143772.658667:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11352 00000100:00100000:1.0:1746143772.658675:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622317184:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143772.658800:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3160 00000100:00100000:2.0:1746143772.658809:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622317440:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:1.0:1746143772.660415:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.660436:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a7cd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a400 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.660616:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.660618:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.660629:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a7cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a400 expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.660647:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a7cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a400 expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.660659:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467c00, rc 0) 00000100:00100000:1.0:1746143772.660695:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622317184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2020us (3388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.660703:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11352 00000100:00100000:2.0:1746143772.666262:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622317440:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7440us (8090us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.666277:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3160 00002000:00100000:2.0:1746143772.666293:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880091d4d180 x1830963622317440/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.666301:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4d180 with x1830963622317440 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.666308:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4d180 00000100:00100000:0.0:1746143772.667048:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.667542:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622317696 00000100:00100000:1.0:1746143772.667553:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622317696 00000100:00100000:1.0:1746143772.667603:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4638 00000100:00100000:1.0:1746143772.667611:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:31896:x1830963622317696:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143772.667842:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:31896:x1830963622317696:12345-192.168.202.3@tcp:35:cat.0 Request processed in 231us (795us total) trans 8589943471 rc 0/0 00000100:00100000:1.0:1746143772.667849:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4638 00000100:00100000:0.0:1746143772.676997:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.677095:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622317824 00000100:00100000:1.0:1746143772.677106:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622317824 00000100:00100000:1.0:1746143772.677168:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11353 00000100:00100000:1.0:1746143772.677177:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+27:31899:x1830963622317824:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.677200:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.677222:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a7cdf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a407 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.677253:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.677258:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.677266:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a7cdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a407 expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.677281:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a7cdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a407 expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.677293:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467400, rc 0) 00000100:00100000:1.0:1746143772.677346:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:31899:x1830963622317824:12345-192.168.202.3@tcp:101:cat.0 Request processed in 170us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.677351:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11353 00000100:00100000:0.0:1746143772.682650:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.683615:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.683687:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622318080 00000100:00100000:2.0:1746143772.683698:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622318080 00002000:00100000:2.0:1746143772.683755:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091d4c380 x1830963622318080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.683767:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4c380 with x1830963622318080 ext(2097152->4194303) 00002000:00010000:2.0:1746143772.683773:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4c380 00000100:00100000:3.0:1746143772.684122:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622318336 00000100:00100000:3.0:1746143772.684127:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622318336 00000100:00100000:3.0:1746143772.684164:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12757 00000100:00100000:3.0:1746143772.684173:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:31905:x1830963622318336:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.684199:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.684225:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7ce6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a40e expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.684298:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3161 00000100:00100000:2.0:1746143772.684311:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622318080:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143772.684373:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684385:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684396:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684407:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7cf4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684412:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684416:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684511:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7cfb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684519:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7cfb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684523:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7cfb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143772.684530:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143772.684601:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684610:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684616:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684621:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684627:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7d800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.684630:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684636:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684645:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143772.684648:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.684651:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684656:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7ced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684725:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684732:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7cf4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684737:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684741:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7cc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.684744:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684748:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7cf4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684754:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093754d00) 00010000:00010000:3.0:1746143772.684757:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.684759:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7cf4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684763:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a7cf4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.684805:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a7ce6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a40e expref: 31 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.684817:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7cfb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a40e expref: 30 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.684823:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143772.684825:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143772.684827:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b800, rc 0) 00000100:00100000:3.0:1746143772.684887:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:31905:x1830963622318336:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 715us (1273us total) trans 8589943472 rc 0/0 00000100:00100000:3.0:1746143772.684894:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12757 00000100:00100000:0.0:1746143772.686501:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.686730:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622318464 00000100:00100000:2.0:1746143772.686738:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622318464 00000100:00100000:2.0:1746143772.686786:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 728 00000100:00100000:2.0:1746143772.686794:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622318464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.686808:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.686829:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7cfb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a40e expref: 30 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.687097:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143772.687102:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.687145:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2008:x1830963622318464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 351us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.687152:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 728 00000100:00100000:2.0:1746143772.696764:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622318080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12443us (14112us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143772.696779:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3161 00002000:00100000:2.0:1746143772.696792:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091d4c380 x1830963622318080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.696802:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4c380 with x1830963622318080 ext(2097152->4194303) 00002000:00010000:2.0:1746143772.696808:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4c380 00000100:00100000:0.0:1746143772.705068:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.705240:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622318720 00000100:00100000:1.0:1746143772.705253:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622318720 00000100:00100000:1.0:1746143772.705450:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4639 00000100:00100000:1.0:1746143772.705463:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+283:31899:x1830963622318720:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143772.705940:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+284:31899:x1830963622318720:12345-192.168.202.3@tcp:35:cat.0 Request processed in 449us (854us total) trans 8589943473 rc 0/0 00000100:00100000:1.0:1746143772.705950:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4639 00000100:00100000:0.0:1746143772.732185:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.732314:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622318848 00000100:00100000:3.0:1746143772.732325:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622318848 00000100:00100000:3.0:1746143772.732387:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11354 00000100:00100000:3.0:1746143772.732397:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31905:x1830963622318848:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.732420:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.732439:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a415 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.732469:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a7b7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a343 expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.732477:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7bc7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a374 expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.732483:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.732485:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.732489:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.732520:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7bc7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a374 expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.732531:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7bc7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a374 expref: 24 pid: 12327 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746143772.732542:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626670720:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.733005:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a7b7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a343 expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.733015:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a7b7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a343 expref: 13 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746143772.733030:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626670848:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.733071:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.737482:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626670720:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.737498:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626670848:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.737532:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.737557:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b800, rc 0) 00000100:00100000:3.0:1746143772.737634:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:31905:x1830963622318848:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5236us (5458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.737643:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11354 00000100:00100000:0.0:1746143772.737659:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.737784:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.737806:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622318976 00000100:00100000:0.0:1746143772.737812:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622318976 00010000:00010000:0.0:1746143772.737841:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7bc7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a374 expref: 25 pid: 12327 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746143772.737866:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622319104 00000100:00100000:0.0:1746143772.737868:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622319104 00010000:00010000:0.0:1746143772.737877:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a7b7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a343 expref: 13 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746143772.737904:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5288 00000100:00100000:0.0:1746143772.737932:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622318976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143772.737939:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5289 00010000:00010000:0.0:1746143772.737946:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143772.737948:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622319104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.737961:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143772.737974:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7bc7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a374 expref: 25 pid: 12327 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.737981:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a7b7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a343 expref: 13 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746143772.737990:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7bc7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a374 expref: 25 pid: 12327 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.738353:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a7b7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a343 expref: 13 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746143772.738387:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7bc7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a374 expref: 25 pid: 12327 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.738392:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73a7b7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a343 expref: 13 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.738417:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.738421:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.738428:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 12 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.738436:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 12 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.738468:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 12 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.738480:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626670976:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.738540:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00010000:00010000:0.0:1746143772.738763:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.738798:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622318976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 887us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.739036:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5288 00000100:00100000:1.0:1746143772.741795:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626670976:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143772.741818:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.741865:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622319104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3918us (4079us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.741875:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5289 00000100:00100000:0.0:1746143772.741953:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.742127:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622319360 00000100:00100000:3.0:1746143772.742134:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622319360 00002000:00100000:3.0:1746143772.742174:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (3018752->3022847) req@ffff880092b70e00 x1830963622319360/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.742184:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70e00 with x1830963622319360 ext(3018752->3022847) 00002000:00010000:3.0:1746143772.742188:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b70e00 00000100:00100000:3.0:1746143772.742204:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3162 00000100:00100000:3.0:1746143772.742211:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622319360:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143772.742323:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622319360:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 112us (371us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143772.742328:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3162 00002000:00100000:3.0:1746143772.742334:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (3018752->3022847) req@ffff880092b70e00 x1830963622319360/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.742340:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70e00 with x1830963622319360 ext(3018752->3022847) 00002000:00010000:3.0:1746143772.742343:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b70e00 00000100:00100000:0.0:1746143772.744734:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.744819:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622319488 00000100:00100000:3.0:1746143772.744826:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622319488 00000100:00100000:3.0:1746143772.744878:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11355 00000100:00100000:3.0:1746143772.744886:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31905:x1830963622319488:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.744904:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.744948:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a41c expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.744990:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.744999:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a7cdf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a407 expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.745006:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.745008:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.745012:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->2535423] (req 2097152->2535423) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.745044:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a7cdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a407 expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.745056:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a7cdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a407 expref: 27 pid: 13436 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746143772.745069:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626671104:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.745153:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.745162:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 11 pid: 12327 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746143772.745169:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626671232:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.745189:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.746638:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626671104:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.746647:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626671232:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.746673:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->2535423] (req 2097152->2535423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.746687:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7de00, rc 0) 00000100:00100000:3.0:1746143772.746718:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:31905:x1830963622319488:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1833us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.746726:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11355 00000100:00100000:0.0:1746143772.751541:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.751587:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.751637:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.751677:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622319744 00000100:00100000:0.0:1746143772.751686:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622319744 00010000:00010000:0.0:1746143772.751723:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 11 pid: 12327 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746143772.751764:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622319872 00000100:00100000:0.0:1746143772.751767:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622319872 00010000:00010000:0.0:1746143772.751779:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a7cdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a407 expref: 28 pid: 13436 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746143772.751801:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5290 00000100:00100000:2.0:1746143772.751809:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5291 00000100:00100000:0.0:1746143772.751812:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622319744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143772.751817:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622319872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.751826:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143772.751826:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.751844:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a7cdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a407 expref: 28 pid: 13436 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746143772.751845:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 11 pid: 12327 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.751856:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a7cdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a407 expref: 28 pid: 13436 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746143772.752012:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622319616 00000100:00100000:3.0:1746143772.752017:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622319616 00000100:00100000:3.0:1746143772.752041:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11356 00000100:00100000:3.0:1746143772.752047:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:31902:x1830963622319616:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.752355:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.752377:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a423 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.752403:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a7bd5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a37b expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.752412:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a7c4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ac expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.752419:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.752421:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.752424:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [716800->1048575] (req 716800->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.752535:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 11 pid: 12327 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.752557:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a7cdf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a407 expref: 28 pid: 13436 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.752767:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.752769:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7cb5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3dd expref: 11 pid: 12327 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.752780:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.752786:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 10 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.752794:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 10 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.752813:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a7c4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ac expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.752825:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a7c4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ac expref: 11 pid: 13436 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746143772.752839:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626671360:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143772.753185:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143772.753201:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 10 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.753211:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626671488:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143772.753258:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00010000:00010000:3.0:1746143772.753275:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a7bd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a37b expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.753284:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a7bd5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a37b expref: 25 pid: 1945 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746143772.753292:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626671616:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.753313:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.753534:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622319744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1721us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.753542:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5290 00000100:00100000:3.0:1746143772.756333:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626671360:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.756345:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626671616:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.756378:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [716800->1048575] (req 716800->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.756397:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4200, rc 0) 00000100:00100000:3.0:1746143772.756441:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:31902:x1830963622319616:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4391us (4910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.756450:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11356 00000100:00100000:2.0:1746143772.756573:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626671488:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143772.756589:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.756611:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622319872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4795us (4972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.756621:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5291 00000100:00100000:0.0:1746143772.757044:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.757060:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622320000 00000100:00100000:2.0:1746143772.757066:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622320000 00000100:00100000:0.0:1746143772.757070:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143772.757089:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a7c4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ac expref: 12 pid: 13436 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746143772.757486:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622320128 00000100:00100000:2.0:1746143772.757490:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622320128 00000100:00100000:1.0:1746143772.757491:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5292 00000100:00100000:1.0:1746143772.757501:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622320000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.757503:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a7bd5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a37b expref: 25 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.757514:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143772.757527:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5293 00000100:00100000:2.0:1746143772.757532:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963622320128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.757537:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a7c4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ac expref: 12 pid: 13436 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746143772.757540:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.757548:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a7bd5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a37b expref: 25 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.757554:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a7c4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ac expref: 12 pid: 13436 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746143772.757613:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a7bd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a37b expref: 25 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.757957:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a7c4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3ac expref: 12 pid: 13436 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746143772.757973:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a7bd5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a37b expref: 25 pid: 1945 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746143772.757984:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.757986:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.758005:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.758012:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143772.758052:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.758095:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622320384 00000100:00100000:3.0:1746143772.758099:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622320384 00002000:00100000:3.0:1746143772.758125:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2531328->2535423) req@ffff880092b70380 x1830963622320384/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.758134:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70380 with x1830963622320384 ext(2531328->2535423) 00002000:00010000:3.0:1746143772.758138:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b70380 00000100:00100000:3.0:1746143772.758151:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3163 00000100:00100000:3.0:1746143772.758156:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622320384:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143772.758267:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622320384:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 110us (215us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143772.758272:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3163 00002000:00100000:3.0:1746143772.758278:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2531328->2535423) req@ffff880092b70380 x1830963622320384/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.758284:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70380 with x1830963622320384 ext(2531328->2535423) 00002000:00010000:3.0:1746143772.758287:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b70380 00010000:00010000:1.0:1746143772.758384:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143772.758404:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.758415:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626671744:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.758417:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622320000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 917us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.758424:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5292 00000100:00100000:2.0:1746143772.758461:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.760224:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.760539:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626671744:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143772.760557:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.760596:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2011:x1830963622320128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3062us (3523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.760604:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5293 00000100:00100000:3.0:1746143772.760707:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622320640 00000100:00100000:3.0:1746143772.760714:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622320640 00002000:00100000:3.0:1746143772.760748:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (716800->720895) req@ffff880092b71500 x1830963622320640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.760757:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71500 with x1830963622320640 ext(716800->720895) 00002000:00010000:3.0:1746143772.760762:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b71500 00000100:00100000:3.0:1746143772.760785:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3164 00000100:00100000:3.0:1746143772.760795:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622320640:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143772.761202:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622320640:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 410us (981us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143772.761207:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3164 00002000:00100000:3.0:1746143772.761212:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (716800->720895) req@ffff880092b71500 x1830963622320640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.761218:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71500 with x1830963622320640 ext(716800->720895) 00002000:00010000:3.0:1746143772.761221:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b71500 00000100:00100000:0.0:1746143772.761360:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.761466:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622320896 00000100:00100000:1.0:1746143772.761472:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622320896 00000100:00100000:1.0:1746143772.761498:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4640 00000100:00100000:1.0:1746143772.761504:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:31905:x1830963622320896:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143772.761716:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:31905:x1830963622320896:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 212us (355us total) trans 8589943474 rc 0/0 00000100:00100000:1.0:1746143772.761723:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4640 00000100:00100000:0.0:1746143772.765279:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.765339:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622321024 00000100:00100000:3.0:1746143772.765349:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622321024 00000100:00100000:3.0:1746143772.765401:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11357 00000100:00100000:3.0:1746143772.765409:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:31902:x1830963622321024:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.765428:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.765445:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a42a expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.765475:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 9 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.765484:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4400/0x87925e4cb73a7bce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a36d expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.765490:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a7b3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a319 expref: 7 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.765495:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.765497:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.765500:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1048576->1687551] (req 1048576->1687551) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.765528:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a7b3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a319 expref: 7 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.765538:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a7b3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a319 expref: 7 pid: 1945 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746143772.765548:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626671872:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.765646:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4400/0x87925e4cb73a7bce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a36d expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.765653:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4400/0x87925e4cb73a7bce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a36d expref: 28 pid: 12327 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746143772.765661:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626672000:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.765687:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 9 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.765695:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 9 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746143772.765702:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626672128:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.765718:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.766976:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626672000:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.766987:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626672128:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143772.768423:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.768453:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626671872:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143772.768464:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143772.768488:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1048576->1687551] (req 1048576->1687551) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.768506:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ca00, rc 0) 00000100:00100000:3.0:1746143772.768558:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:31902:x1830963622321024:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3148us (3290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.768560:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622321152 00000100:00100000:1.0:1746143772.768561:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622321280 00000100:00100000:3.0:1746143772.768566:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11357 00000100:00100000:2.0:1746143772.768567:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622321152 00000100:00100000:1.0:1746143772.768567:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622321280 00010000:00010000:2.0:1746143772.768595:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4400/0x87925e4cb73a7bce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a36d expref: 28 pid: 12327 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746143772.768598:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a7b3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a319 expref: 8 pid: 1945 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746143772.768616:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5294 00000100:00100000:2.0:1746143772.768622:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622321152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.768634:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.768652:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4400/0x87925e4cb73a7bce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a36d expref: 28 pid: 12327 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746143772.768667:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4400/0x87925e4cb73a7bce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a36d expref: 28 pid: 12327 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746143772.768696:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4400/0x87925e4cb73a7bce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a36d expref: 28 pid: 12327 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746143772.768708:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.768724:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963622321152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 103us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.768729:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5294 00000100:00100000:0.0:1746143772.769159:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.769218:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622321408 00000100:00100000:2.0:1746143772.769221:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622321408 00010000:00010000:2.0:1746143772.769236:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 10 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.769247:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5295 00000100:00100000:1.0:1746143772.769254:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622321280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.769260:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143772.769271:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5296 00010000:00010000:1.0:1746143772.769273:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a7b3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a319 expref: 8 pid: 1945 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746143772.769279:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622321408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.769283:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a7b3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a319 expref: 8 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746143772.769288:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.769295:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a7b3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a319 expref: 8 pid: 1945 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746143772.769297:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 10 pid: 9587 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746143772.769303:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143772.769313:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 10 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.769326:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2010:x1830963622321280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (861us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143772.769326:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a7afc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a2ef expref: 10 pid: 9587 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746143772.769336:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5295 00010000:00010000:0.0:1746143772.769338:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.769340:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.769346:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.769353:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.769382:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143772.769394:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626672256:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143772.769588:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.772071:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626672256:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143772.772094:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.772140:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622321408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2861us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.772149:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5296 00000100:00100000:0.0:1746143772.784076:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.784180:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622321664 00000100:00100000:3.0:1746143772.784191:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622321664 00000100:00100000:3.0:1746143772.784239:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12758 00000100:00100000:3.0:1746143772.784247:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:31912:x1830963622321664:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143772.784273:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.784292:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a7d25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a431 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.784372:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784386:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784397:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784409:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7d33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784414:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784420:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784516:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7d3a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784525:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7d3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784531:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7d3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143772.784539:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143772.784613:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784620:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784629:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784634:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784639:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7da00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.784643:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784649:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784660:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143772.784662:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.784666:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784670:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a7d2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784699:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784704:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7d33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784709:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7d33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784712:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7d800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.784714:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7d33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784721:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7d33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784726:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093754000) 00010000:00010000:3.0:1746143772.784728:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.784730:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7d33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784735:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a7d33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.784772:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a7d25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a431 expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.784783:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7d3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a431 expref: 32 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.784789:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143772.784791:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143772.784793:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c000, rc 0) 00000100:00100000:3.0:1746143772.784840:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:31912:x1830963622321664:12345-192.168.202.3@tcp:101:cat.0 Request processed in 593us (775us total) trans 8589943475 rc 0/0 00000100:00100000:3.0:1746143772.784846:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12758 00000100:00100000:0.0:1746143772.786552:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.787115:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622321792 00000100:00100000:2.0:1746143772.787124:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622321792 00000100:00100000:2.0:1746143772.787178:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 729 00000100:00100000:2.0:1746143772.787186:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622321792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.787201:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.787224:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a7d3a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a431 expref: 32 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.787250:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143772.787254:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.787286:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.787318:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622321920 00000100:00100000:3.0:1746143772.787321:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622321920 00000100:00100000:3.0:1746143772.787344:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11358 00000100:00100000:3.0:1746143772.787347:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622321920:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143772.787361:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.787374:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73a7d48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a438 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.787412:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626672384:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143772.787480:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622321792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 294us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.787487:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 729 00000100:00100000:3.0:1746143772.787515:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.787519:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.787575:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622322048 00000100:00100000:1.0:1746143772.787579:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622322048 00000100:00100000:1.0:1746143772.787605:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11359 00000100:00100000:1.0:1746143772.787610:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622322048:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.787618:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.787627:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73a7d4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a43f expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.787652:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626672512:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143772.788125:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00002000:00010000:3.0:1746143772.788665:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime: 1746143772 -> 1746143773 00002000:00010000:3.0:1746143772.788669:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime: 1746143772 -> 1746143773 00002000:00010000:3.0:1746143772.788671:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime: 1746143772 -> 1746143773 00000100:00100000:3.0:1746143772.788689:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626672384:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143772.788711:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73a7d48 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a438 expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.788723:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73a7d48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a438 expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.788731:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4400, rc 0) 00000100:00100000:3.0:1746143772.788756:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622321920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1407us (1470us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143772.788761:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11358 00002000:00010000:1.0:1746143772.790086:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime: 1746143772 -> 1746143773 00002000:00010000:1.0:1746143772.790091:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143772 -> 1746143773 00002000:00010000:1.0:1746143772.790093:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime: 1746143772 -> 1746143773 00000100:00100000:1.0:1746143772.790107:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626672512:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.790128:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73a7d4f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a43f expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.790139:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73a7d4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a43f expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.790158:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084e00, rc 0) 00000100:00100000:1.0:1746143772.790195:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622322048:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2584us (2675us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.790276:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11359 00000100:00100000:0.0:1746143772.792245:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.792334:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622322176 00000100:00100000:1.0:1746143772.792342:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622322176 00000100:00100000:1.0:1746143772.792396:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11360 00000100:00100000:1.0:1746143772.792404:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:31912:x1830963622322176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.792423:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.792441:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a446 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.792477:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.792484:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.792486:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.792489:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.792519:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.792531:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 23 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143772.792544:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626672640:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.792624:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.794116:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626672640:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143772.794142:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.794156:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085000, rc 0) 00000100:00100000:1.0:1746143772.794188:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31912:x1830963622322176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1785us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.794196:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11360 00000100:00100000:0.0:1746143772.794650:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.794789:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622322304 00000100:00100000:3.0:1746143772.794796:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622322304 00002000:00100000:3.0:1746143772.794835:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (716800->1048575) req@ffff880092b72680 x1830963622322304/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.794845:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72680 with x1830963622322304 ext(716800->1048575) 00010000:00010000:3.0:1746143772.794852:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 24 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143772.794869:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 24 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143772.794875:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b72680 00000100:00100000:3.0:1746143772.794902:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1353 00000100:00100000:3.0:1746143772.794908:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622322304:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143772.798257:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622322304:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3339us (3598us total) trans 21474840235 rc 0/0 00000100:00100000:3.0:1746143772.798269:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1353 00002000:00100000:3.0:1746143772.798280:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (716800->1048575) req@ffff880092b72680 x1830963622322304/t21474840235(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.798290:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72680 with x1830963622322304 ext(716800->1048575) 00010000:00010000:3.0:1746143772.798301:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 26 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143772.798316:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 26 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143772.798323:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b72680 00000100:00100000:0.0:1746143772.800397:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.800544:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622322432 00000100:00100000:2.0:1746143772.800555:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622322432 00010000:00010000:2.0:1746143772.800594:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 26 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143772.800636:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5297 00000100:00100000:2.0:1746143772.800645:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622322432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.800659:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.800680:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 26 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.800691:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 26 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.800715:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a7d17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a423 expref: 26 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.800746:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.800748:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.800756:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.800764:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.800802:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.800815:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626672768:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143772.800989:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.802457:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626672768:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143772.802474:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.802518:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622322432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1873us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.802528:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5297 00000100:00100000:0.0:1746143772.804103:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.804179:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622322688 00000100:00100000:3.0:1746143772.804187:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622322688 00002000:00100000:3.0:1746143772.804233:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b71180 x1830963622322688/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.804243:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71180 with x1830963622322688 ext(0->1048575) 00002000:00010000:3.0:1746143772.804250:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b71180 00000100:00100000:3.0:1746143772.804269:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3165 00000100:00100000:3.0:1746143772.804276:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622322688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143772.812095:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622322688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7804us (7985us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.812109:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3165 00002000:00100000:3.0:1746143772.812122:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b71180 x1830963622322688/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.812132:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71180 with x1830963622322688 ext(0->1048575) 00002000:00010000:3.0:1746143772.812138:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b71180 00010000:00010000:3.0:1746143772.815286:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143772.817982:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.818038:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622322816 00000100:00100000:1.0:1746143772.818050:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622322816 00000100:00100000:1.0:1746143772.818105:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11361 00000100:00100000:1.0:1746143772.818111:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:31912:x1830963622322816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.818128:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.818142:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a44d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.818166:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.818178:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.818179:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.818182:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 10 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.818205:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.818215:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 26 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143772.818225:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626672896:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.818304:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.819618:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626672896:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143772.819639:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 10 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.819650:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084200, rc 0) 00000100:00100000:1.0:1746143772.819691:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:31912:x1830963622322816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1579us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.819698:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11361 00000100:00100000:0.0:1746143772.820973:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.821062:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622322944 00000100:00100000:3.0:1746143772.821071:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622322944 00002000:00100000:3.0:1746143772.821114:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1687551) req@ffff88012b1d8380 x1830963622322944/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.821124:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8380 with x1830963622322944 ext(1048576->1687551) 00010000:00010000:3.0:1746143772.821133:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 27 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143772.821146:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 27 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143772.821153:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1d8380 00000100:00100000:3.0:1746143772.821172:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1354 00000100:00100000:3.0:1746143772.821179:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963622322944:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143772.831640:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622322944:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 10448us (10667us total) trans 17179872915 rc 0/0 00000100:00100000:3.0:1746143772.831653:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1354 00002000:00100000:3.0:1746143772.831666:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1687551) req@ffff88012b1d8380 x1830963622322944/t17179872915(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.831676:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8380 with x1830963622322944 ext(1048576->1687551) 00010000:00010000:3.0:1746143772.831687:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143772.831703:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143772.831709:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1d8380 00000100:00100000:0.0:1746143772.832337:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.832659:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622323200 00000100:00100000:2.0:1746143772.832667:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622323200 00000100:00100000:2.0:1746143772.832715:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12759 00000100:00100000:2.0:1746143772.832722:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+284:31915:x1830963622323200:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143772.832745:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.832762:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7d64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a454 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.832836:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.832848:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.832858:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.832870:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7d72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.832875:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7d72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.832880:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7d72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833012:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a7d79 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833020:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a7d79 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833026:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a7d79 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143772.833033:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143772.833094:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833100:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833105:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833111:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833115:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d550600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143772.833119:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833124:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833133:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143772.833136:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143772.833140:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833148:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7d6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833173:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7d72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833178:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7d72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833183:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7d72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833187:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143772.833189:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7d72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833193:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7d72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833197:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b40f3d00) 00010000:00010000:2.0:1746143772.833199:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143772.833201:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7d72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833205:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7d72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.833236:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7d64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a454 expref: 287 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.833244:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a7d79 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a454 expref: 286 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.833255:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143772.833257:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143772.833259:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550e00, rc 0) 00000100:00100000:2.0:1746143772.833289:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+286:31915:x1830963622323200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 568us (954us total) trans 8589943476 rc 0/0 00000100:00100000:2.0:1746143772.833294:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12759 00000100:00100000:0.0:1746143772.833725:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.834022:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622323328 00000100:00100000:2.0:1746143772.834026:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622323328 00010000:00010000:2.0:1746143772.834046:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143772.834578:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5298 00000100:00100000:2.0:1746143772.834585:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622323328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.834597:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.834615:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.834625:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.834641:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73a7d1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1687551) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a42a expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.834654:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.834656:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.834664:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.834671:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.834703:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.834714:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626673024:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143772.835713:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009aec2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.836212:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.836282:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622323584 00000100:00100000:1.0:1746143772.836289:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622323584 00000100:00100000:1.0:1746143772.836336:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 730 00000100:00100000:1.0:1746143772.836343:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+286:2011:x1830963622323584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.836355:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.836370:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a7d79 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a454 expref: 286 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.836397:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143772.836401:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.836427:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+285:2011:x1830963622323584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.836432:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 730 00000100:00100000:0.0:1746143772.838626:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.838748:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.838775:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.838805:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.838868:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622323456 00000100:00100000:1.0:1746143772.838879:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622323456 00000100:00100000:2.0:1746143772.838896:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626673024:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143772.838939:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.838944:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622323712 00000100:00100000:1.0:1746143772.838946:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622323712 00000100:00100000:1.0:1746143772.838961:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622323840 00000100:00100000:1.0:1746143772.838974:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622323840 00000100:00100000:2.0:1746143772.838985:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622323328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4400us (5260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.838985:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622323968 00000100:00100000:1.0:1746143772.838987:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622323968 00000100:00100000:2.0:1746143772.838995:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5298 00000100:00100000:1.0:1746143772.839005:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11362 00000100:00100000:1.0:1746143772.839011:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622323456:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.839026:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.839040:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73a7d87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a45b expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.839059:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.839061:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.839067:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73a7d87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a45b expref: 27 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143772.839072:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11363 00010000:00010000:1.0:1746143772.839081:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73a7d87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a45b expref: 27 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143772.839083:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622323712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.839090:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084a00, rc 0) 00010000:00010000:3.0:1746143772.839096:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.839109:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7d8e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a462 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.839126:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.839128:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143772.839131:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622323456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 120us (513us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143772.839134:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7d8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a462 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143772.839137:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11362 00010000:00010000:3.0:1746143772.839146:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7d8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a462 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143772.839151:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11364 00000100:00100000:1.0:1746143772.839155:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622323840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143772.839161:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb5a00, rc 0) 00010000:00010000:1.0:1746143772.839161:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.839166:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085e00/0x87925e4cb73a7d95 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a469 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.839179:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963622323712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 100us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.839185:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11363 00000100:00100000:1.0:1746143772.839196:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626673152:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143772.839198:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11365 00000100:00100000:3.0:1746143772.839202:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622323968:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143772.839208:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.839214:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012224fc00/0x87925e4cb73a7d9c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a470 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.839248:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.839251:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626673280:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143772.839277:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00002000:00010000:3.0:1746143772.840346:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143772 -> 1746143773 00002000:00010000:3.0:1746143772.840350:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143772 -> 1746143773 00002000:00010000:3.0:1746143772.840352:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143772 -> 1746143773 00000100:00100000:3.0:1746143772.840370:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626673280:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143772.840388:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012224fc00/0x87925e4cb73a7d9c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a470 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.840399:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012224fc00/0x87925e4cb73a7d9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a470 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.840413:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012224fc00, rc 0) 00000100:00100000:3.0:1746143772.840432:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622323968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1230us (1626us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143772.840439:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11365 00002000:00010000:1.0:1746143772.840507:0:3134:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143772 -> 1746143773 00002000:00010000:1.0:1746143772.840510:0:3134:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143772 -> 1746143773 00002000:00010000:1.0:1746143772.840512:0:3134:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143772 -> 1746143773 00000100:00100000:1.0:1746143772.840522:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626673152:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.840537:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085e00/0x87925e4cb73a7d95 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a469 expref: 27 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.840546:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085e00/0x87925e4cb73a7d95 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a469 expref: 27 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.840664:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085e00, rc 0) 00000100:00100000:1.0:1746143772.841532:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622323840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2374us (2754us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.841540:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11364 00000100:00100000:0.0:1746143772.844667:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.844704:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.844733:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622324224 00000100:00100000:3.0:1746143772.844744:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622324224 00000100:00100000:0.0:1746143772.844747:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:3.0:1746143772.844790:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b1d9880 x1830963622324224/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.844806:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9880 with x1830963622324224 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.844814:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d9880 00000100:00100000:1.0:1746143772.844821:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622324480 00000100:00100000:1.0:1746143772.844826:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622324480 00000100:00100000:3.0:1746143772.844842:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622324608 00000100:00100000:3.0:1746143772.844845:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622324608 00002000:00100000:3.0:1746143772.844857:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88012b1db800 x1830963622324608/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.844863:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db800 with x1830963622324608 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.844866:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1db800 00002000:00100000:1.0:1746143772.844873:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012b1dad80 x1830963622324480/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.844881:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1dad80 with x1830963622324480 ext(1048576->2097151) 00002000:00010000:1.0:1746143772.844884:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1dad80 00000100:00100000:3.0:1746143772.844890:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3166 00000100:00100000:2.0:1746143772.845076:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3167 00000100:00100000:3.0:1746143772.845077:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622324224:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143772.845087:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622324608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143772.845092:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3168 00000100:00100000:1.0:1746143772.845098:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622324480:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143772.850299:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.850343:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.850386:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622325120 00000100:00100000:2.0:1746143772.850398:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622325248 00000100:00100000:0.0:1746143772.850398:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622325120 00000100:00100000:2.0:1746143772.850402:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622325248 00002000:00100000:2.0:1746143772.850440:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880082ed5c00 x1830963622325248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143772.850440:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880082ed6a00 x1830963622325120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.850449:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed5c00 with x1830963622325248 ext(1048576->2097151) 00002000:00100000:0.0:1746143772.850449:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed6a00 with x1830963622325120 ext(0->1048575) 00002000:00010000:2.0:1746143772.850454:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed5c00 00002000:00010000:0.0:1746143772.850454:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed6a00 00000100:00100000:0.0:1746143772.850484:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3169 00000100:00100000:0.0:1746143772.850491:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622325120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143772.851170:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3170 00000100:00100000:2.0:1746143772.851177:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622325248:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143772.853479:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622324608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8386us (8721us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.853490:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3167 00002000:00100000:3.0:1746143772.853502:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88012b1db800 x1830963622324608/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.853512:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db800 with x1830963622324608 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.853517:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1db800 00000100:00100000:1.0:1746143772.860684:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622324480:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15572us (15965us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143772.860697:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3168 00002000:00100000:1.0:1746143772.860709:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012b1dad80 x1830963622324480/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.860721:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1dad80 with x1830963622324480 ext(1048576->2097151) 00002000:00010000:1.0:1746143772.860727:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1dad80 00000100:00100000:3.0:1746143772.861014:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622324224:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15939us (16355us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.861025:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3166 00002000:00100000:3.0:1746143772.861106:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b1d9880 x1830963622324224/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.861114:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9880 with x1830963622324224 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.861118:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d9880 00000100:00100000:2.0:1746143772.864002:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622325120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13502us (13704us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.864014:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3169 00002000:00100000:2.0:1746143772.864025:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880082ed6a00 x1830963622325120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143772.864031:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622325248:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12854us (13687us total) trans 0 rc 1048576/1048576 00002000:00100000:2.0:1746143772.864034:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed6a00 with x1830963622325120 ext(0->1048575) 00000100:00100000:3.0:1746143772.864037:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3170 00002000:00010000:2.0:1746143772.864041:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed6a00 00002000:00100000:3.0:1746143772.864042:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880082ed5c00 x1830963622325248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.864048:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed5c00 with x1830963622325248 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.864051:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed5c00 00000100:00100000:0.0:1746143772.874041:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.874109:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.874210:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622325376 00000100:00100000:1.0:1746143772.874220:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622325376 00000100:00100000:1.0:1746143772.874265:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622325504 00000100:00100000:1.0:1746143772.874267:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622325504 00000100:00100000:1.0:1746143772.874686:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11366 00000100:00100000:3.0:1746143772.874692:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11367 00000100:00100000:1.0:1746143772.874695:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622325376:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143772.874698:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622325504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143772.874717:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.874717:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.874734:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73a7da3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a47e expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.874734:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c800/0x87925e4cb73a7daa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a477 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.874782:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626673408:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143772.874782:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626673536:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143772.874854:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.875472:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.875737:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.875786:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.875842:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622325888 00000100:00100000:2.0:1746143772.875847:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622325888 00002000:00100000:2.0:1746143772.875885:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880093416d80 x1830963622325888/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 504/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.875895:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416d80 with x1830963622325888 ext(2097152->4194303) 00002000:00010000:2.0:1746143772.875899:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093416d80 00000100:00100000:2.0:1746143772.875928:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622326016 00000100:00100000:2.0:1746143772.875931:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622326016 00002000:00100000:2.0:1746143772.875943:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2535424->4194303) req@ffff880093416a00 x1830963622326016/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.875950:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416a00 with x1830963622326016 ext(2535424->4194303) 00002000:00010000:2.0:1746143772.875953:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093416a00 00000100:00100000:2.0:1746143772.876326:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3171 00000100:00100000:2.0:1746143772.876335:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622325888:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143772.877775:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3172 00000100:00100000:3.0:1746143772.877788:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622326016:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143772.877940:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.878083:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622326272 00000100:00100000:3.0:1746143772.878089:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622326272 00000100:00100000:3.0:1746143772.878134:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12760 00000100:00100000:3.0:1746143772.878140:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:31917:x1830963622326272:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.878157:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.878174:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a7db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a485 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.878260:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878277:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878288:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878307:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a7dbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878312:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a7dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878318:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a7dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878410:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849c00/0x87925e4cb73a7dc6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878420:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849c00/0x87925e4cb73a7dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878425:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849c00/0x87925e4cb73a7dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143772.878437:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143772.878509:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878514:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878520:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.878526:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879043:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d848800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.879048:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879054:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879065:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143772.879067:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.879071:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879076:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848800/0x87925e4cb73a7db8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143772.879152:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626673536:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.879180:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c800/0x87925e4cb73a7daa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a477 expref: 27 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.879189:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c800/0x87925e4cb73a7daa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a477 expref: 27 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.879217:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c800, rc 0) 00000100:00100000:1.0:1746143772.879260:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622325376:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4565us (5230us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.879268:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11366 00010000:00010000:3.0:1746143772.879326:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a7dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879331:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a7dbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879339:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a7dbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879343:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d848000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.879345:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a7dbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879348:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a7dbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879614:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e629600) 00010000:00010000:3.0:1746143772.879616:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.879618:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a7dbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879623:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73a7dbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143772.879662:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a7db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a485 expref: 34 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.879672:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849c00/0x87925e4cb73a7dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a485 expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.879677:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143772.879678:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143772.879681:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849c00, rc 0) 00000100:00100000:3.0:1746143772.879717:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:31917:x1830963622326272:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1576us (1778us total) trans 8589943477 rc 0/0 00000100:00100000:3.0:1746143772.879723:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12760 00000100:00100000:3.0:1746143772.879765:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626673408:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143772.879782:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73a7da3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a47e expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.879791:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73a7da3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a47e expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.879803:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad35800, rc 0) 00000100:00100000:3.0:1746143772.880621:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622325504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5914us (6503us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143772.880629:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11367 00000100:00100000:2.0:1746143772.886818:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.886882:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.887273:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622326400 00000100:00100000:3.0:1746143772.887285:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622326400 00000100:00100000:3.0:1746143772.887361:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11368 00000100:00100000:0.0:1746143772.887365:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622326528 00000100:00100000:0.0:1746143772.887369:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622326528 00000100:00100000:3.0:1746143772.887370:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:31915:x1830963622326400:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143772.887391:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.887416:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a48c expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.887448:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.887455:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143772.887456:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143772.887460:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.887495:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.887507:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 13 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143772.887519:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626673664:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143772.887592:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.888121:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 731 00000100:00100000:0.0:1746143772.888129:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2008:x1830963622326528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143772.888141:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143772.888163:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849c00/0x87925e4cb73a7dc6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a485 expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.888194:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143772.888198:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.888226:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2008:x1830963622326528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 98us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.888232:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 731 00000100:00100000:2.0:1746143772.888882:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.889077:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622326656 00000100:00100000:1.0:1746143772.889084:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622326656 00000100:00100000:1.0:1746143772.889110:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11369 00000100:00100000:1.0:1746143772.889115:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:31917:x1830963622326656:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143772.889125:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.889138:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a493 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.889155:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.889163:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a7cd8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a400 expref: 15 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.889169:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.889170:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.889173:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1069056->1236991] (req 1069056->1236991) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 15 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.889192:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a7cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a400 expref: 15 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.889200:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a7cd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a400 expref: 15 pid: 13436 timeout: 932 lvb_type: 1 00000100:00100000:1.0:1746143772.889209:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626673792:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143772.889267:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.889274:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 27 pid: 13436 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143772.889281:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626673920:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.889295:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.895305:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626673664:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.895305:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626673792:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.895320:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626673920:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143772.895338:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.895343:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1069056->1236991] (req 1069056->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 14 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.895355:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849800, rc 0) 00010000:00010000:1.0:1746143772.895355:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408fe00, rc 0) 00000100:00100000:3.0:1746143772.895601:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:31915:x1830963622326400:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8229us (8793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.895601:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:31917:x1830963622326656:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6483us (6718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.895610:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11369 00000100:00100000:3.0:1746143772.895615:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11368 00000100:00100000:2.0:1746143772.895678:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622325888:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19345us (19941us total) trans 0 rc 1970176/1970176 00000100:00100000:2.0:1746143772.895687:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3171 00002000:00100000:2.0:1746143772.895696:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880093416d80 x1830963622325888/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 504/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1970176/1970176 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.895705:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416d80 with x1830963622325888 ext(2097152->4194303) 00010000:00010000:2.0:1746143772.895714:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 13 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.895725:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 13 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746143772.895731:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093416d80 00000100:00100000:0.0:1746143772.897349:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.897404:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622326784 00000100:00100000:2.0:1746143772.897412:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622326784 00000100:00100000:0.0:1746143772.897433:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143772.897452:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3018752->3145727) req@ffff880093415c00 x1830963622326784/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.897461:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415c00 with x1830963622326784 ext(3018752->3145727) 00010000:00010000:2.0:1746143772.897467:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 13 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.897477:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 13 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746143772.897482:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093415c00 00000100:00100000:2.0:1746143772.897513:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1355 00000100:00100000:2.0:1746143772.897521:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622326784:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143772.897725:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622326912 00000100:00100000:1.0:1746143772.897734:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622326912 00010000:00010000:1.0:1746143772.897752:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a7cd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a400 expref: 15 pid: 13436 timeout: 932 lvb_type: 1 00000100:00100000:1.0:1746143772.897782:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5299 00000100:00100000:1.0:1746143772.897787:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2010:x1830963622326912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.897797:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.897811:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a7cd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a400 expref: 15 pid: 13436 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143772.897820:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a7cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a400 expref: 15 pid: 13436 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143772.897845:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a7cd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a400 expref: 15 pid: 13436 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143772.897871:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.897897:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2010:x1830963622326912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.897903:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5299 00000100:00100000:0.0:1746143772.899994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.900230:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622326016:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22445us (24442us total) trans 0 rc 1658880/1658880 00000100:00100000:3.0:1746143772.900240:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3172 00002000:00100000:3.0:1746143772.900250:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2535424->4194303) req@ffff880093416a00 x1830963622326016/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1658880/1658880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.900259:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416a00 with x1830963622326016 ext(2535424->4194303) 00002000:00010000:3.0:1746143772.900265:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093416a00 00000100:00100000:1.0:1746143772.900595:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622327040 00000100:00100000:1.0:1746143772.900603:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622327040 00010000:00010000:1.0:1746143772.900630:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 27 pid: 13436 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143772.901315:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5300 00000100:00100000:1.0:1746143772.901325:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622327040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.901340:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.901360:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 27 pid: 13436 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143772.901372:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 27 pid: 13436 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143772.901395:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466800/0x87925e4cb73a7cc3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3eb expref: 27 pid: 13436 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143772.901412:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.901414:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.901422:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.901430:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.901471:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.901484:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626674048:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.901546:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.902995:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622326784:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5467us (5646us total) trans 21474840236 rc 0/0 00000100:00100000:3.0:1746143772.903004:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1355 00002000:00100000:3.0:1746143772.903014:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3018752->3145727) req@ffff880093415c00 x1830963622326784/t21474840236(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.903022:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415c00 with x1830963622326784 ext(3018752->3145727) 00010000:00010000:3.0:1746143772.903031:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 14 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143772.903042:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 14 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143772.903048:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093415c00 00000100:00100000:1.0:1746143772.903766:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626674048:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143772.903788:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.903815:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622327040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2492us (3828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.903824:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5300 00000100:00100000:0.0:1746143772.906038:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.906085:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.906153:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622327424 00000100:00100000:2.0:1746143772.906163:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622327424 00000100:00100000:2.0:1746143772.906226:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11370 00000100:00100000:2.0:1746143772.906233:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:31912:x1830963622327424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143772.906252:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.906269:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a49a expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.906298:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143772.906301:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143772.906304:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.906315:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.906324:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550800, rc 0) 00000100:00100000:2.0:1746143772.906375:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:31912:x1830963622327424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 142us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.906381:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11370 00000100:00100000:3.0:1746143772.906388:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622327296 00000100:00100000:3.0:1746143772.906393:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622327296 00002000:00100000:3.0:1746143772.906421:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1069056->1073151) req@ffff880093416680 x1830963622327296/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.906430:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416680 with x1830963622327296 ext(1069056->1073151) 00002000:00010000:3.0:1746143772.906434:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093416680 00000100:00100000:3.0:1746143772.906448:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3173 00000100:00100000:3.0:1746143772.906454:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622327296:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143772.906564:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622327296:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 109us (534us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143772.906569:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3173 00002000:00100000:3.0:1746143772.906574:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1069056->1073151) req@ffff880093416680 x1830963622327296/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.906581:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416680 with x1830963622327296 ext(1069056->1073151) 00002000:00010000:3.0:1746143772.906583:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093416680 00000100:00100000:0.0:1746143772.908317:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.908529:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622327552 00000100:00100000:1.0:1746143772.908537:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622327552 00010000:00010000:1.0:1746143772.908566:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 15 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143772.908632:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5301 00000100:00100000:1.0:1746143772.908639:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622327552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.908652:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.908670:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 15 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143772.908682:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 15 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143772.908710:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73a7d09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3018752->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a415 expref: 15 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143772.908860:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.908862:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.908870:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.908878:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.908885:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.908887:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.908890:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.908895:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.909053:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.909067:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626674176:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143772.909185:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.909197:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626674304:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.909218:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.909511:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.909549:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622327808 00000100:00100000:2.0:1746143772.909554:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622327808 00002000:00100000:2.0:1746143772.909585:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1232896->1236991) req@ffff880093417800 x1830963622327808/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.909599:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417800 with x1830963622327808 ext(1232896->1236991) 00002000:00010000:2.0:1746143772.909604:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093417800 00000100:00100000:2.0:1746143772.909628:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3174 00000100:00100000:2.0:1746143772.909635:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622327808:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143772.909757:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622327808:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 122us (246us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143772.909764:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3174 00002000:00100000:2.0:1746143772.909770:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1232896->1236991) req@ffff880093417800 x1830963622327808/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.909776:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417800 with x1830963622327808 ext(1232896->1236991) 00002000:00010000:2.0:1746143772.909779:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093417800 00000100:00100000:0.0:1746143772.912985:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.913021:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.913064:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622328192 00000100:00100000:2.0:1746143772.913070:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622328320 00000100:00100000:3.0:1746143772.913073:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622328192 00000100:00100000:2.0:1746143772.913074:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622328320 00000100:00100000:1.0:1746143772.913093:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626674176:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.913104:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626674304:192.168.202.3@tcp:105: 00002000:00100000:3.0:1746143772.913117:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880093414700 x1830963622328192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.913117:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880093417100 x1830963622328320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.913126:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414700 with x1830963622328192 ext(3145728->4194303) 00002000:00100000:2.0:1746143772.913126:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417100 with x1830963622328320 ext(2097152->3145727) 00010000:00010000:1.0:1746143772.913131:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1746143772.913132:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093414700 00002000:00010000:2.0:1746143772.913132:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093417100 00000100:00100000:2.0:1746143772.913163:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3175 00000100:00100000:3.0:1746143772.913168:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3176 00000100:00100000:2.0:1746143772.913172:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622328320:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143772.913173:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622328192:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143772.913523:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622327552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4883us (5209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.913532:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5301 00000100:00100000:0.0:1746143772.914946:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.915190:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622328576 00000100:00100000:1.0:1746143772.915198:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622328576 00000100:00100000:1.0:1746143772.915244:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4641 00000100:00100000:1.0:1746143772.915252:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:31917:x1830963622328576:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143772.915462:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:31917:x1830963622328576:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 211us (520us total) trans 8589943478 rc 0/0 00000100:00100000:1.0:1746143772.915469:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4641 00000100:00100000:3.0:1746143772.921753:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622328192:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8568us (8765us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.921766:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3176 00002000:00100000:3.0:1746143772.921779:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880093414700 x1830963622328192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.921788:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414700 with x1830963622328192 ext(3145728->4194303) 00002000:00010000:3.0:1746143772.921794:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093414700 00000100:00100000:2.0:1746143772.925201:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622328320:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12017us (12164us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.925215:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3175 00002000:00100000:2.0:1746143772.925228:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880093417100 x1830963622328320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.925238:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417100 with x1830963622328320 ext(2097152->3145727) 00002000:00010000:2.0:1746143772.925246:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093417100 00000100:00100000:0.0:1746143772.931832:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.931891:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.932041:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622328832 00000100:00100000:1.0:1746143772.932052:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622328832 00000100:00100000:1.0:1746143772.932116:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11371 00000100:00100000:1.0:1746143772.932124:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:31915:x1830963622328832:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.932145:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143772.932199:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622328960 00000100:00100000:2.0:1746143772.932203:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622328960 00002000:00100000:2.0:1746143772.932236:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880093414a80 x1830963622328960/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.932247:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414a80 with x1830963622328960 ext(4194304->4780031) 00002000:00010000:2.0:1746143772.932253:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093414a80 00000100:00100000:2.0:1746143772.932279:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3177 00000100:00100000:2.0:1746143772.932286:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622328960:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:1.0:1746143772.932764:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4a1 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.932796:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 9 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.932804:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.932806:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.932810:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 30 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.932843:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 9 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.932855:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 9 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143772.932867:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626674432:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143772.933014:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.937139:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626674432:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143772.937179:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 30 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.937199:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717a00, rc 0) 00000100:00100000:1.0:1746143772.937257:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+30:31915:x1830963622328832:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5131us (5434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.937266:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11371 00000100:00100000:3.0:1746143772.937679:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622328960:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5392us (5785us total) trans 0 rc 585728/585728 00000100:00100000:3.0:1746143772.937688:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3177 00002000:00100000:3.0:1746143772.937697:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880093414a80 x1830963622328960/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.937705:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414a80 with x1830963622328960 ext(4194304->4780031) 00002000:00010000:3.0:1746143772.937710:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093414a80 00000100:00100000:0.0:1746143772.937974:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.938055:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622329088 00000100:00100000:3.0:1746143772.938062:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622329088 00002000:00100000:3.0:1746143772.938093:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2535423) req@ffff880096fdaa00 x1830963622329088/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.938101:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fdaa00 with x1830963622329088 ext(2097152->2535423) 00010000:00010000:3.0:1746143772.938107:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 10 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143772.938120:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 10 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143772.938126:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096fdaa00 00000100:00100000:3.0:1746143772.938148:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1356 00000100:00100000:3.0:1746143772.938155:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622329088:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143772.942299:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.942745:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622329088:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4588us (4783us total) trans 17179872916 rc 0/0 00000100:00100000:3.0:1746143772.942757:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1356 00002000:00100000:3.0:1746143772.942769:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2535423) req@ffff880096fdaa00 x1830963622329088/t17179872916(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.942779:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fdaa00 with x1830963622329088 ext(2097152->2535423) 00010000:00010000:3.0:1746143772.942790:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 12 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143772.942803:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 12 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143772.942811:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096fdaa00 00000100:00100000:1.0:1746143772.943173:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622329216 00000100:00100000:1.0:1746143772.943185:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622329216 00000100:00100000:1.0:1746143772.943379:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11372 00000100:00100000:1.0:1746143772.943387:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622329216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.943404:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.943418:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a7df0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4a8 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.943463:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626674560:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143772.943632:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.945991:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626674560:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.946020:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a7df0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a8 expref: 13 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.946033:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a7df0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a8 expref: 13 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.946105:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717800, rc 0) 00000100:00100000:1.0:1746143772.946148:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622329216:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2762us (3858us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.946155:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11372 00000100:00100000:0.0:1746143772.947667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.947734:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622329344 00000100:00100000:1.0:1746143772.947740:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622329344 00010000:00010000:1.0:1746143772.947763:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 12 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143772.947797:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5302 00000100:00100000:1.0:1746143772.947803:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622329344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.947815:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.947825:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 12 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143772.947835:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 12 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143772.947850:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a7d10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2535423) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a41c expref: 12 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143772.947861:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.947863:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.947868:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.947875:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.947899:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.947908:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626674688:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143772.948597:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.950864:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.952138:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626674688:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143772.952160:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.952242:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622329472 00000100:00100000:1.0:1746143772.952247:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622329472 00000100:00100000:1.0:1746143772.952404:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11373 00000100:00100000:1.0:1746143772.952412:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622329472:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143772.952427:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.952440:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a7df7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4af expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.952456:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.952458:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.952465:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a7df7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4af expref: 13 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.952479:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a7df7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4af expref: 13 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.952488:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716200, rc 0) 00000100:00100000:2.0:1746143772.952555:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622329344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4750us (4889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.952564:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5302 00000100:00100000:1.0:1746143772.952858:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622329472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 447us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.952864:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11373 00000100:00100000:0.0:1746143772.956743:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.956819:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622329728 00000100:00100000:3.0:1746143772.956831:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622329728 00000100:00100000:3.0:1746143772.956937:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4642 00000100:00100000:3.0:1746143772.956945:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137358450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:31912:x1830963622329728:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143772.957115:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137358450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:31912:x1830963622329728:12345-192.168.202.3@tcp:35:cat.0 Request processed in 170us (379us total) trans 8589943479 rc 0/0 00000100:00100000:3.0:1746143772.957121:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4642 00000100:00100000:0.0:1746143772.961047:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.961090:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143772.961510:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622330112 00000100:00100000:3.0:1746143772.961517:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622330112 00002000:00100000:3.0:1746143772.961551:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880096fd9c00 x1830963622330112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.961559:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd9c00 with x1830963622330112 ext(3145728->4194303) 00002000:00010000:3.0:1746143772.961564:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd9c00 00000100:00100000:3.0:1746143772.961585:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622330240 00000100:00100000:3.0:1746143772.961587:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622330240 00002000:00100000:3.0:1746143772.961598:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880096fdb800 x1830963622330240/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.961604:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fdb800 with x1830963622330240 ext(2097152->4194303) 00002000:00010000:3.0:1746143772.961607:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fdb800 00000100:00100000:3.0:1746143772.961618:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3178 00000100:00100000:3.0:1746143772.961624:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622330112:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143772.962078:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3179 00000100:00100000:1.0:1746143772.962086:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622330240:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143772.974298:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.974363:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622330368 00000100:00100000:0.0:1746143772.974372:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622330368 00000100:00100000:0.0:1746143772.974427:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12761 00000100:00100000:0.0:1746143772.974433:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:31919:x1830963622330368:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143772.974455:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.974470:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a7dfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4b6 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.974518:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143772.974528:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143772.974538:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143772.974550:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049800/0x87925e4cb73a7e0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143772.974556:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082049800/0x87925e4cb73a7e0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143772.974562:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049800/0x87925e4cb73a7e0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143772.974622:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143772.974633:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a389 expref: 284 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.974639:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143772.974667:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a389 expref: 284 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.974678:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a389 expref: 284 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746143772.974689:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626674816:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143772.974775:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.977344:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622330112:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15710us (16294us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.977356:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3178 00002000:00100000:3.0:1746143772.977366:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880096fd9c00 x1830963622330112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.977374:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd9c00 with x1830963622330112 ext(3145728->4194303) 00002000:00010000:3.0:1746143772.977379:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd9c00 00000100:00100000:2.0:1746143772.979934:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626674816:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143772.979971:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746143772.980271:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622330240:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18184us (19179us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143772.980282:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3179 00002000:00100000:1.0:1746143772.980295:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880096fdb800 x1830963622330240/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.980304:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fdb800 with x1830963622330240 ext(2097152->4194303) 00002000:00010000:1.0:1746143772.980310:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fdb800 00000100:00100000:0.0:1746143772.982239:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.982669:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622330624 00000100:00100000:1.0:1746143772.982679:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622330624 00000100:00100000:1.0:1746143772.982729:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4643 00000100:00100000:1.0:1746143772.982736:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+285:30659:x1830963622330624:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143772.983092:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+286:30659:x1830963622330624:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 355us (1226us total) trans 8589943480 rc 0/0 00000100:00100000:1.0:1746143772.983099:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4643 00000100:00100000:0.0:1746143772.985290:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.985354:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622330752 00000100:00100000:2.0:1746143772.985363:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622330752 00010000:00010000:2.0:1746143772.985400:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a389 expref: 286 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143772.985439:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5303 00000100:00100000:2.0:1746143772.985447:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+286:2008:x1830963622330752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.985465:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.985470:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a389 expref: 286 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.985482:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a389 expref: 286 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.985505:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124adfc00/0x87925e4cb73a7c06 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a389 expref: 286 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143772.985535:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143772.985540:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.985550:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.985557:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143772.985588:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.985665:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+285:2008:x1830963622330752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 217us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.985672:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5303 00010000:00010000:3.0:1746143772.985868:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.985879:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143772.985992:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:3.0:1746143772.985996:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143772.986017:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986030:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986040:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986046:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986051:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986056:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986062:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082048600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.986066:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986072:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986085:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143772.986087:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.986090:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986095:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a7e05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986120:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049800/0x87925e4cb73a7e0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986124:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082049800/0x87925e4cb73a7e0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986128:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082049800/0x87925e4cb73a7e0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986132:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082049800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.986134:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049800/0x87925e4cb73a7e0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986138:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049800/0x87925e4cb73a7e0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986143:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008219ea00) 00010000:00010000:3.0:1746143772.986145:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.986147:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082049800/0x87925e4cb73a7e0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986154:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049800/0x87925e4cb73a7e0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.986440:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a7dfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4b6 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.986451:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4b6 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.986456:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143772.986458:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143772.986460:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048e00, rc 0) 00000100:00100000:3.0:1746143772.986531:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:31919:x1830963622330368:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 12095us (12238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.986539:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12761 00000100:00100000:0.0:1746143772.991293:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.991326:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.991406:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.991445:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622331008 00000100:00100000:0.0:1746143772.991453:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.991458:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622331008 00000100:00100000:0.0:1746143772.991471:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622331264 00000100:00100000:0.0:1746143772.991478:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622331264 00000100:00100000:1.0:1746143772.991730:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622331520 00000100:00100000:1.0:1746143772.991734:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622331520 00000100:00100000:0.0:1746143772.991749:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622330880 00000100:00100000:0.0:1746143772.991753:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622330880 00000100:00100000:1.0:1746143772.991758:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11374 00000100:00100000:1.0:1746143772.991766:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622331008:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143772.991779:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11375 00000100:00100000:0.0:1746143772.991786:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2011:x1830963622331264:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:1.0:1746143772.991793:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11376 00000100:00100000:1.0:1746143772.991798:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622331520:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143772.991801:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.991808:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.991816:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73a7e1a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4d2 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.991823:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73a7e21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4e0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.991844:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.991846:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.991855:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73a7e21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e0 expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143772.991861:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626674944:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143772.991870:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73a7e21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e0 expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.991886:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635000, rc 0) 00000100:00100000:1.0:1746143772.991981:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622331520:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 181us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.991986:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11376 00000100:00100000:1.0:1746143772.992005:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11377 00000100:00100000:1.0:1746143772.992011:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622330880:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143772.992018:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.992027:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73a7e28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4bd expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.992038:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.992040:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.992044:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73a7e28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4bd expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.992054:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73a7e28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4bd expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.992061:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634800, rc 0) 00000100:00100000:0.0:1746143772.992067:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.992079:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622330880:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 69us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.992084:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11377 00010000:00010000:1.0:1746143772.992104:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.992112:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73a7e2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4c4 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.992127:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.992128:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.992133:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73a7e2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4c4 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.992142:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73a7e2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4c4 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143772.992144:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143772.992149:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634400, rc 0) 00000100:00100000:1.0:1746143772.992168:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622331008:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 403us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.992174:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11374 00000100:00100000:0.0:1746143772.992183:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143772.993033:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143772.993062:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622331136 00000100:00100000:1.0:1746143772.993067:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622331136 00000100:00100000:1.0:1746143772.993078:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622331392 00000100:00100000:1.0:1746143772.993079:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622331392 00000100:00100000:2.0:1746143772.993097:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11378 00000100:00100000:2.0:1746143772.993107:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622331392:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143772.993116:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143772.993117:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11379 00000100:00100000:1.0:1746143772.993123:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622331136:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143772.993125:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73a7e36 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4d9 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.993130:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.993138:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a7e3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4cb expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.993142:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.993144:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.993148:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.993150:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.993151:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73a7e36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d9 expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.993155:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a7e3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4cb expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.993165:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73a7e36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d9 expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.993168:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a7e3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4cb expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.993173:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551600, rc 0) 00010000:00010000:1.0:1746143772.993176:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634e00, rc 0) 00000100:00100000:1.0:1746143772.993195:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622331136:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 73us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.993201:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622331392:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 96us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.993201:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11379 00000100:00100000:2.0:1746143772.993207:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11378 00000100:00100000:3.0:1746143772.993934:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622331648 00000100:00100000:3.0:1746143772.993939:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622331648 00000100:00100000:3.0:1746143772.993972:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11380 00000100:00100000:3.0:1746143772.993977:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622331648:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143772.993984:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.994031:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73a7e44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4e7 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.994059:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626675072:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143772.994120:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.996304:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143772.996384:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime: 1746143772 -> 1746143773 00002000:00010000:0.0:1746143772.996387:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime: 1746143772 -> 1746143773 00000100:00100000:0.0:1746143772.996401:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626674944:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143772.996422:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73a7e1a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d2 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.996433:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73a7e1a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d2 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.996446:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049400, rc 0) 00000100:00100000:0.0:1746143772.996474:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622331264:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4688us (5146us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143772.996481:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11375 00000100:00100000:3.0:1746143772.996599:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622331904 00000100:00100000:3.0:1746143772.996604:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622331904 00000100:00100000:3.0:1746143772.996641:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12762 00000100:00100000:3.0:1746143772.996646:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+285:31923:x1830963622331904:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.996659:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.996671:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097369e00/0x87925e4cb73a7e4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4ee expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.996720:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996730:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996739:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996748:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73a7e59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996753:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73a7e59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996758:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73a7e59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996828:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996836:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996841:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143772.996848:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143772.996897:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996902:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996907:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996930:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996935:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097368200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.996938:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996943:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996951:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143772.996954:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.996957:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996972:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097368200/0x87925e4cb73a7e52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996981:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73a7e59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996985:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73a7e59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996990:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73a7e59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.996997:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097369800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143772.997000:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73a7e59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.997004:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73a7e59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.997009:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800922cc900) 00010000:00010000:3.0:1746143772.997010:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143772.997012:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73a7e59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.997016:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73a7e59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143772.997042:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097369e00/0x87925e4cb73a7e4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4ee expref: 288 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.997050:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4ee expref: 287 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.997055:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143772.997056:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143772.997058:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369a00, rc 0) 00000100:00100000:3.0:1746143772.997085:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+287:31923:x1830963622331904:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 439us (786us total) trans 8589943481 rc 0/0 00000100:00100000:3.0:1746143772.997090:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12762 00000100:00100000:3.0:1746143772.998663:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626675072:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143772.998686:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73a7e44 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e7 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.998697:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73a7e44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e7 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.998706:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087000, rc 0) 00000100:00100000:3.0:1746143772.998745:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622331648:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4767us (5712us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143772.998751:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11380 00000100:00100000:0.0:1746143772.999172:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143772.999235:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622332160 00000100:00100000:2.0:1746143772.999241:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622332160 00000100:00100000:2.0:1746143772.999279:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12763 00000100:00100000:2.0:1746143772.999285:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:31919:x1830963622332160:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143772.999297:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.999308:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a7e6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4f5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.999372:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.999384:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4b6 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.999394:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4ee expref: 286 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.999400:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143772.999423:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4ee expref: 286 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.999433:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4ee expref: 286 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143772.999442:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626675200:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143772.999507:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4b6 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.999513:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4b6 expref: 12 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143772.999520:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626675328:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143772.999537:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009aec2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.002554:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.002576:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.002625:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626675200:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.002637:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626675328:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.002659:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143773.002750:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622332288 00000100:00100000:1.0:1746143773.002757:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622332288 00000100:00100000:0.0:1746143773.002782:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143773.002787:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4b6 expref: 13 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.002834:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622332544 00000100:00100000:3.0:1746143773.002838:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622332544 00000100:00100000:1.0:1746143773.002906:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622332416 00000100:00100000:1.0:1746143773.002909:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622332416 00000100:00100000:0.0:1746143773.002944:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5304 00000100:00100000:0.0:1746143773.002970:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622332288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143773.002988:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143773.002998:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4b6 expref: 13 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.003009:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11381 00010000:00010000:0.0:1746143773.003011:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4b6 expref: 13 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.003017:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:31923:x1830963622332544:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143773.003032:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143773.003037:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a7e13 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4b6 expref: 13 pid: 7245 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.003047:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a4fc expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.003051:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143773.003056:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143773.003065:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143773.003070:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143773.003071:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.003079:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73a7e28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4bd expref: 7 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.003090:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73a7d87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a45b expref: 27 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.003095:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.003097:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.003099:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [831488->974847] (req 831488->974847) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.003113:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622332288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 154us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143773.003119:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5304 00010000:00010000:3.0:1746143773.003125:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73a7d87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a45b expref: 27 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.003134:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73a7d87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a45b expref: 27 pid: 3134 timeout: 932 lvb_type: 1 00000100:00100000:3.0:1746143773.003143:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626675456:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.003209:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73a7e28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4bd expref: 7 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.003217:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73a7e28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4bd expref: 7 pid: 1947 timeout: 932 lvb_type: 1 00000100:00100000:3.0:1746143773.003224:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626675584:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.003249:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.003260:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 13 pid: 13436 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.003267:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626675712:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.003283:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00010000:00010000:1.0:1746143773.003317:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4ee expref: 287 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.003337:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5305 00000100:00100000:1.0:1746143773.003342:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+287:2010:x1830963622332416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.003350:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.003354:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4ee expref: 287 pid: 7245 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.003362:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4ee expref: 287 pid: 7245 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.003380:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73a7e60 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4ee expref: 287 pid: 7245 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.003403:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143773.003407:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.003414:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.003419:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.003432:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143773.003442:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.003450:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143773.003451:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+286:2010:x1830963622332416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 108us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.003457:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5305 00000004:00200000:2.0:1746143773.003472:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00080000:3.0:1746143773.003638:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1746143773.003641:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746143773.003754:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a7e6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4f5 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.003771:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4f5 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.003777:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.003780:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143773.003782:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551200, rc 0) 00000100:00100000:2.0:1746143773.003938:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31919:x1830963622332160:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4653us (4766us total) trans 8589943482 rc 0/0 00000100:00100000:2.0:1746143773.003944:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12763 00000100:00100000:0.0:1746143773.004023:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.004163:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622332800 00000100:00100000:1.0:1746143773.004168:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622332800 00002000:00100000:1.0:1746143773.004189:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880095c69c00 x1830963622332800/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.004197:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69c00 with x1830963622332800 ext(4194304->4780031) 00002000:00010000:1.0:1746143773.004201:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c69c00 00000100:00100000:1.0:1746143773.004212:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3180 00000100:00100000:1.0:1746143773.004216:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622332800:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143773.007838:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.007953:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622332928 00000100:00100000:2.0:1746143773.007970:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622332928 00000100:00100000:2.0:1746143773.008029:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12764 00000100:00100000:2.0:1746143773.008037:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31919:x1830963622332928:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143773.008109:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.008128:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7e8a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a503 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.008238:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626675456:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.008249:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626675584:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.008396:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.008409:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4f5 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.008416:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.008443:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4f5 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.008453:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4f5 expref: 13 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.008464:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626675840:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.008844:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.009252:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626675712:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.009283:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [831488->974847] (req 831488->974847) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 29 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.009297:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086e00, rc 0) 00000100:00100000:3.0:1746143773.009327:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:31923:x1830963622332544:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6311us (6545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.009334:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11381 00000100:00100000:0.0:1746143773.009435:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.009553:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963622332800:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 5335us (5529us total) trans 0 rc 585728/585728 00000100:00100000:1.0:1746143773.009564:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3180 00002000:00100000:1.0:1746143773.009572:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880095c69c00 x1830963622332800/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 585728/585728 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.009580:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69c00 with x1830963622332800 ext(4194304->4780031) 00002000:00010000:1.0:1746143773.009585:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c69c00 00000100:00100000:2.0:1746143773.009638:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622333056 00000100:00100000:2.0:1746143773.009644:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622333056 00010000:00010000:2.0:1746143773.009671:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73a7e28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4bd expref: 8 pid: 1947 timeout: 932 lvb_type: 1 00000100:00100000:2.0:1746143773.009689:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5306 00000100:00100000:2.0:1746143773.009695:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622333056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.009704:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.009718:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73a7e28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4bd expref: 8 pid: 1947 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.009727:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73a7e28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4bd expref: 8 pid: 1947 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.009742:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73a7e28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4bd expref: 8 pid: 1947 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.009755:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.009771:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2010:x1830963622333056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 77us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.009776:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5306 00000100:00080000:3.0:1746143773.009996:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143773.010322:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626675840:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.010334:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143773.010721:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.010769:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622333184 00000100:00100000:1.0:1746143773.010773:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622333184 00010000:00010000:1.0:1746143773.010788:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4f5 expref: 14 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.010813:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5307 00000100:00100000:1.0:1746143773.010818:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622333184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.010826:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.010832:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4f5 expref: 14 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.010839:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4f5 expref: 14 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.010852:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7e75 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4f5 expref: 14 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.010875:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143773.010880:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.010887:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.010894:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.010935:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143773.010957:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622333184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 138us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.010976:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5307 00010000:00010000:3.0:1746143773.011012:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143773.011019:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143773.011172:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:3.0:1746143773.011177:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143773.011193:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143773.011220:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7e8a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a503 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.011242:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a503 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.011248:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143773.011250:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143773.011252:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551e00, rc 0) 00000100:00100000:3.0:1746143773.011279:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31919:x1830963622332928:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3244us (3453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.011285:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12764 00000100:00100000:0.0:1746143773.013245:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.013280:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.013338:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622333568 00000100:00100000:3.0:1746143773.013346:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622333568 00000100:00100000:0.0:1746143773.013354:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.013385:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11382 00000100:00100000:3.0:1746143773.013393:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622333568:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143773.013396:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622333312 00000100:00100000:2.0:1746143773.013399:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622333312 00000100:00100000:1.0:1746143773.013437:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622333440 00000100:00100000:1.0:1746143773.013441:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622333440 00010000:00010000:1.0:1746143773.013472:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 14 pid: 13436 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.013497:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5308 00000100:00100000:1.0:1746143773.013502:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622333440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.013516:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.013535:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 14 pid: 13436 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.013546:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 14 pid: 13436 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.013565:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a7d56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a446 expref: 14 pid: 13436 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.013579:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143773.013611:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622333440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.013621:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5308 00010000:00010000:3.0:1746143773.013665:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.013672:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73a7d87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a45b expref: 28 pid: 3134 timeout: 932 lvb_type: 1 00010000:00010000:3.0:1746143773.013675:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73a7e98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a50a expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.013687:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5309 00010000:00010000:3.0:1746143773.013690:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143773.013692:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622333312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.013696:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73a7e98 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a50a expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.013697:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.013704:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73a7d87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a45b expref: 29 pid: 3134 timeout: 932 lvb_type: 1 00010000:00010000:3.0:1746143773.013705:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73a7e98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a50a expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.013712:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73a7d87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a45b expref: 28 pid: 3134 timeout: 932 lvb_type: 1 00010000:00010000:3.0:1746143773.013713:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3000, rc 0) 00010000:00010000:2.0:1746143773.013722:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73a7d87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a45b expref: 28 pid: 3134 timeout: 932 lvb_type: 1 00000100:00100000:3.0:1746143773.013730:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622333568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 338us (493us total) trans 0 rc 301/301 00010000:00010000:2.0:1746143773.013730:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.013731:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143773.013734:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11382 00010000:00010000:2.0:1746143773.013738:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.013745:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 26 pid: 9839 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746143773.013750:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746143773.013779:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 26 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.013795:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626675968:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.013861:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.014874:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.015036:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622333696 00000100:00100000:3.0:1746143773.015042:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622333696 00000100:00100000:3.0:1746143773.015072:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11383 00000100:00100000:3.0:1746143773.015077:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622333696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.015088:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.015099:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a7e9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a511 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.015136:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626676096:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143773.015193:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.017272:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.017306:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.017431:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622333824 00000100:00100000:2.0:1746143773.017439:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622333824 00000100:00100000:3.0:1746143773.017674:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626676096:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143773.017704:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a7e9f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a511 expref: 28 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.017718:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a7e9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a511 expref: 28 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.017730:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2c00, rc 0) 00000100:00100000:3.0:1746143773.017769:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622333696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2691us (2897us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143773.017779:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11383 00000100:00100000:3.0:1746143773.017798:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622333952 00000100:00100000:3.0:1746143773.017801:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622333952 00000100:00100000:2.0:1746143773.017854:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11384 00000100:00100000:2.0:1746143773.017863:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622333824:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143773.017877:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.017890:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a7ea6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a518 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.017978:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626676224:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143773.018023:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.018043:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626675968:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.018054:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.018073:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622333312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4381us (4792us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.018081:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5309 00000100:00100000:1.0:1746143773.018139:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11385 00000100:00100000:1.0:1746143773.018147:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622333952:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143773.018153:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.018159:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a7ead lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a51f expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.018183:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626676352:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143773.018203:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.018818:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.018861:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622334208 00000100:00100000:1.0:1746143773.018865:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622334208 00002000:00100000:1.0:1746143773.018893:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b3:0x0] (831488->835583) req@ffff88009391ce00 x1830963622334208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.018902:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ce00 with x1830963622334208 ext(831488->835583) 00002000:00010000:1.0:1746143773.018906:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ce00 00000100:00100000:1.0:1746143773.018952:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3181 00000100:00100000:1.0:1746143773.018957:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622334208:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143773.019082:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622334208:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 125us (266us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143773.019088:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3181 00002000:00100000:1.0:1746143773.019093:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b3:0x0] (831488->835583) req@ffff88009391ce00 x1830963622334208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.019099:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ce00 with x1830963622334208 ext(831488->835583) 00002000:00010000:1.0:1746143773.019103:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ce00 00000100:00100000:2.0:1746143773.019405:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626676224:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143773.019423:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a7ea6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a518 expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.019438:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a7ea6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a518 expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.019446:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550600, rc 0) 00000100:00100000:2.0:1746143773.019469:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622333824:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1608us (2206us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143773.019474:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11384 00000100:00100000:2.0:1746143773.019605:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626676352:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143773.019619:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a7ead lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a51f expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.019628:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a7ead lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a51f expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.019635:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635800, rc 0) 00000100:00100000:2.0:1746143773.019652:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622333952:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1506us (2345us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143773.019657:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11385 00000100:00100000:2.0:1746143773.022447:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.022492:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.022563:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.022660:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622334336 00000100:00100000:3.0:1746143773.022679:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622334336 00000100:00100000:3.0:1746143773.022722:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11386 00000100:00100000:3.0:1746143773.022730:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622334336:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.022748:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.022832:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a7eb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a526 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.022891:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626676480:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143773.023153:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622334592 00000100:00100000:2.0:1746143773.023157:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622334592 00000100:00100000:2.0:1746143773.023185:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12765 00000100:00100000:2.0:1746143773.023190:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31919:x1830963622334592:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143773.023200:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.023211:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a7ebb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a52d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.023302:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ec2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.023316:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.023327:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.023340:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.023346:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ec2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.023352:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.023357:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d429600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.023361:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.023367:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ec2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.023376:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.023378:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143773.023381:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ec2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.023390:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ec2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.023413:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a7ebb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a52d expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.023420:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a7ebb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a52d expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.023426:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429400, rc 0) 00000100:00100000:3.0:1746143773.023492:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.023511:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31919:x1830963622334592:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 320us (1017us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143773.023517:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12765 00000100:00100000:2.0:1746143773.023542:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622334848 00000100:00100000:2.0:1746143773.023545:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622334848 00002000:00100000:2.0:1746143773.023567:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (970752->974847) req@ffff88009c4d5500 x1830963622334848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.023576:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5500 with x1830963622334848 ext(970752->974847) 00002000:00010000:2.0:1746143773.023580:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5500 00000100:00100000:2.0:1746143773.024099:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3182 00000100:00100000:2.0:1746143773.024106:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622334848:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.024229:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622334848:12345-192.168.202.3@tcp:3:cat.0 Request processed in 123us (1665us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143773.024235:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3182 00002000:00100000:2.0:1746143773.024240:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (970752->974847) req@ffff88009c4d5500 x1830963622334848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.024253:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5500 with x1830963622334848 ext(970752->974847) 00002000:00010000:2.0:1746143773.024256:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5500 00000100:00100000:3.0:1746143773.025210:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626676480:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143773.025239:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a7eb4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a526 expref: 27 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.025251:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a7eb4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a526 expref: 27 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.025262:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2e00, rc 0) 00000100:00100000:3.0:1746143773.026502:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622334336:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3764us (4056us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143773.026512:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11386 00000100:00100000:0.0:1746143773.027252:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.027299:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.028059:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622335104 00000100:00100000:1.0:1746143773.028067:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622335104 00000100:00100000:1.0:1746143773.028101:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622335360 00000100:00100000:1.0:1746143773.028103:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622335360 00000100:00100000:1.0:1746143773.028113:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4644 00000100:00100000:1.0:1746143773.028118:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31919:x1830963622335104:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1746143773.028119:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4645 00000100:00100000:0.0:1746143773.028128:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:31923:x1830963622335360:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143773.028282:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:31919:x1830963622335104:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 164us (1034us total) trans 8589943483 rc 0/0 00000100:00100000:1.0:1746143773.028286:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4644 00000100:00100000:0.0:1746143773.028320:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+287:31923:x1830963622335360:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 193us (1019us total) trans 8589943484 rc 0/0 00000100:00100000:0.0:1746143773.028327:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4645 00000100:00100000:0.0:1746143773.030007:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.030138:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622335616 00000100:00100000:2.0:1746143773.030146:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622335616 00000100:00100000:2.0:1746143773.030194:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4646 00000100:00100000:2.0:1746143773.030355:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+287:31915:x1830963622335616:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143773.030535:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+288:31915:x1830963622335616:12345-192.168.202.3@tcp:35:cat.0 Request processed in 184us (535us total) trans 8589943485 rc 0/0 00000100:00100000:2.0:1746143773.030541:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4646 00000100:00100000:0.0:1746143773.043049:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.043114:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622335872 00000100:00100000:2.0:1746143773.043125:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622335872 00000100:00100000:2.0:1746143773.043414:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12766 00000100:00100000:2.0:1746143773.044608:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:31926:x1830963622335872:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143773.044639:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.044664:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a7ec9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a534 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746143773.044686:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746143773.044753:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.044767:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.044778:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.044792:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a7ed7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.044798:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a7ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.044803:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a7ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.044908:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.044932:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.044937:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143773.044946:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143773.045030:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045036:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045041:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045046:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045051:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d428400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.045055:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045061:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045075:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143773.045078:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.045082:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045086:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428400/0x87925e4cb73a7ed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045108:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a7ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045112:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a7ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045116:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a7ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045120:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d428600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.045122:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a7ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045126:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a7ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045132:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b40f3800) 00010000:00010000:2.0:1746143773.045134:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.045136:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a7ed7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045140:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a7ed7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.045176:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a7ec9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a534 expref: 37 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.045187:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a534 expref: 36 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.045192:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.045337:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143773.045341:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428e00, rc 0) 00000100:00100000:2.0:1746143773.045583:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:31926:x1830963622335872:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2157us (2540us total) trans 8589943486 rc 0/0 00000100:00100000:2.0:1746143773.045592:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12766 00000100:00100000:0.0:1746143773.076971:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.077126:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622336000 00000100:00100000:3.0:1746143773.077137:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622336000 00000100:00100000:3.0:1746143773.077205:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11387 00000100:00100000:3.0:1746143773.077215:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31926:x1830963622336000:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143773.077236:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.077254:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a53b expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.077286:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.077294:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a7e3d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4cb expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.077300:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a7cca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f2 expref: 13 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.077307:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.077308:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.077312:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1826816->2097151] (req 1826816->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.077345:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a7cca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f2 expref: 13 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.077356:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a7cca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f2 expref: 13 pid: 13436 timeout: 932 lvb_type: 1 00000100:00100000:3.0:1746143773.077368:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626676608:192.168.202.3@tcp:104: 00000100:00080000:0.0:1746143773.077443:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746143773.077465:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a7e3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4cb expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.077473:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a7e3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4cb expref: 9 pid: 3134 timeout: 932 lvb_type: 1 00000100:00100000:3.0:1746143773.077481:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626676736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.077505:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.077513:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 29 pid: 13436 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.077519:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626676864:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.077537:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.078545:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.078592:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622336256 00000100:00100000:2.0:1746143773.078599:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622336256 00000100:00100000:2.0:1746143773.078642:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12767 00000100:00100000:2.0:1746143773.078649:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:31931:x1830963622336256:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.078666:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.078686:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a542 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.078782:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.078795:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.078805:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143773.078815:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143773.078900:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a7ef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a542 expref: 39 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.078954:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a542 expref: 38 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.078969:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.078972:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143773.078975:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429e00, rc 0) 00000100:00100000:2.0:1746143773.079011:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:31931:x1830963622336256:12345-192.168.202.3@tcp:101:cat.0 Request processed in 362us (469us total) trans 8589943487 rc 0/0 00000100:00100000:2.0:1746143773.079017:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12767 00000100:00100000:3.0:1746143773.080455:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626676608:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.080465:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626676736:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.080472:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626676864:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.080500:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1826816->2097151] (req 1826816->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.080515:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3a00, rc 0) 00000100:00100000:3.0:1746143773.080544:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:31926:x1830963622336000:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3331us (3638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.080554:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11387 00000100:00100000:0.0:1746143773.081044:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.081122:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622336384 00000100:00100000:2.0:1746143773.081130:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622336384 00010000:00010000:2.0:1746143773.081166:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a7e3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4cb expref: 10 pid: 3134 timeout: 932 lvb_type: 1 00000100:00100000:2.0:1746143773.081198:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5310 00000100:00100000:2.0:1746143773.081206:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622336384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.081219:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.081239:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a7e3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4cb expref: 10 pid: 3134 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.081248:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a7e3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4cb expref: 10 pid: 3134 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.081267:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a7e3d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4cb expref: 10 pid: 3134 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.081286:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.081323:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622336384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 118us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.081329:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5310 00000100:00080000:0.0:1746143773.081470:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143773.083130:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.083175:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.085123:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622336512 00000100:00100000:3.0:1746143773.085135:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622336512 00010000:00010000:3.0:1746143773.085183:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 30 pid: 13436 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.085211:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622336640 00000100:00100000:3.0:1746143773.085214:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622336640 00010000:00010000:3.0:1746143773.085224:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a7cca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f2 expref: 13 pid: 13436 timeout: 932 lvb_type: 1 00000100:00100000:3.0:1746143773.085297:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5311 00000100:00100000:3.0:1746143773.085306:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622336512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.085322:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.085343:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 30 pid: 13436 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.085354:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 30 pid: 13436 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.085378:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a7cbc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3e4 expref: 30 pid: 13436 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.085396:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.085448:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622336512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 143us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.085458:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5311 00000100:00100000:3.0:1746143773.085474:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5312 00000100:00100000:3.0:1746143773.085478:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622336640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.085484:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.085490:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a7cca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f2 expref: 13 pid: 13436 timeout: 932 lvb_type: 1 00010000:00010000:3.0:1746143773.085498:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a7cca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f2 expref: 13 pid: 13436 timeout: 932 lvb_type: 1 00010000:00010000:3.0:1746143773.085510:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a7cca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a3f2 expref: 13 pid: 13436 timeout: 932 lvb_type: 1 00010000:00010000:3.0:1746143773.085519:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.085521:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.085528:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.085535:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.085565:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.085578:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626676992:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143773.085633:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00080000:0.0:1746143773.085770:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143773.085811:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.085935:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.086341:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622336768 00000100:00100000:3.0:1746143773.086346:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622336768 00000100:00100000:3.0:1746143773.086371:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622336896 00000100:00100000:3.0:1746143773.086372:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622336896 00000100:00100000:3.0:1746143773.086391:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11388 00000100:00100000:3.0:1746143773.086396:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622336768:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.086411:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.086425:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f08 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a549 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.086459:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626677120:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143773.086741:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11389 00000100:00100000:2.0:1746143773.086750:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622336896:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.086759:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.086768:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73a7f0f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a550 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.086792:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626677248:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143773.087133:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.087175:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.088735:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626676992:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143773.088755:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.088832:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622336640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3351us (5655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.088842:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5312 00000100:00100000:0.0:1746143773.089058:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.089069:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626677120:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143773.089091:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f08 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a549 expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.089104:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f08 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a549 expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.089117:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2e00, rc 0) 00000100:00100000:1.0:1746143773.089139:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622337152 00000100:00100000:2.0:1746143773.089141:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622336768:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2744us (3329us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143773.089146:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622337152 00000100:00100000:2.0:1746143773.089147:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11388 00002000:00010000:3.0:1746143773.089158:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime: 1746143772 -> 1746143773 00002000:00010000:3.0:1746143773.089162:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime: 1746143772 -> 1746143773 00000100:00100000:3.0:1746143773.089173:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626677248:192.168.202.3@tcp:106: 00002000:00100000:1.0:1746143773.089186:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1826816->1830911) req@ffff8801373bad80 x1830963622337152/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746143773.089189:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73a7f0f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a550 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746143773.089194:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bad80 with x1830963622337152 ext(1826816->1830911) 00010000:00010000:3.0:1746143773.089198:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73a7f0f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a550 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746143773.089199:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373bad80 00010000:00010000:3.0:1746143773.089206:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429000, rc 0) 00000100:00100000:3.0:1746143773.089225:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622336896:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2477us (3289us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143773.089226:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3183 00000100:00100000:3.0:1746143773.089230:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11389 00000100:00100000:1.0:1746143773.089233:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622337152:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143773.089605:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622337152:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 371us (547us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143773.089611:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3183 00002000:00100000:1.0:1746143773.089617:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1826816->1830911) req@ffff8801373bad80 x1830963622337152/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.089625:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bad80 with x1830963622337152 ext(1826816->1830911) 00002000:00010000:1.0:1746143773.089628:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373bad80 00000100:00100000:0.0:1746143773.091084:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.091170:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622337280 00000100:00100000:3.0:1746143773.091177:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622337280 00000100:00100000:3.0:1746143773.091215:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11390 00000100:00100000:3.0:1746143773.091221:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:31931:x1830963622337280:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.091235:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.091249:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a557 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.091273:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.091280:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.091282:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.091286:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 14 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.091313:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.091324:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 25 pid: 9839 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.091335:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626677376:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.091400:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.095301:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.095499:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622337536 00000100:00100000:2.0:1746143773.095510:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622337536 00000100:00100000:2.0:1746143773.095633:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4647 00000100:00100000:2.0:1746143773.095642:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:31926:x1830963622337536:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143773.096033:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+39:31926:x1830963622337536:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 390us (741us total) trans 8589943488 rc 0/0 00000100:00100000:2.0:1746143773.096039:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4647 00000100:00100000:2.0:1746143773.096214:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626677376:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.096241:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 14 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.096257:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3e00, rc 0) 00000100:00100000:2.0:1746143773.096276:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:31931:x1830963622337280:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5056us (5196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.096283:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11390 00000100:00100000:0.0:1746143773.096455:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.096560:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622337664 00000100:00100000:1.0:1746143773.096564:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622337664 00002000:00100000:1.0:1746143773.096593:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b3:0x0] (831488->974847) req@ffff8801373b8700 x1830963622337664/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.096602:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8700 with x1830963622337664 ext(831488->974847) 00010000:00010000:1.0:1746143773.096608:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 26 pid: 9839 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.096620:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 26 pid: 9839 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746143773.096626:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801373b8700 00000100:00100000:1.0:1746143773.096653:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1357 00000100:00100000:1.0:1746143773.096659:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622337664:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143773.100740:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622337664:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4070us (4274us total) trans 21474840237 rc 0/0 00000100:00100000:2.0:1746143773.100752:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1357 00002000:00100000:2.0:1746143773.100764:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b3:0x0] (831488->974847) req@ffff8801373b8700 x1830963622337664/t21474840237(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.100774:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8700 with x1830963622337664 ext(831488->974847) 00010000:00010000:2.0:1746143773.100785:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 28 pid: 9839 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.100799:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 28 pid: 9839 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746143773.100811:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801373b8700 00000100:00100000:0.0:1746143773.105237:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.105361:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622337792 00000100:00100000:3.0:1746143773.105372:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622337792 00010000:00010000:3.0:1746143773.105412:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 28 pid: 9839 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.105453:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5313 00000100:00100000:3.0:1746143773.105463:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622337792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.105478:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.105501:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 28 pid: 9839 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.105513:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 28 pid: 9839 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.105537:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082086e00/0x87925e4cb73a7e7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->974847) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4fc expref: 28 pid: 9839 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.105565:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.105567:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.105575:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.105588:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.105624:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.105644:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626677504:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143773.105726:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.108287:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626677504:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143773.108315:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.108371:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963622337792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2908us (3144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.108382:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5313 00000100:00100000:0.0:1746143773.114212:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.114251:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.114292:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.114605:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622338048 00000100:00100000:3.0:1746143773.114618:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622338048 00000100:00100000:2.0:1746143773.114621:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622338304 00000100:00100000:2.0:1746143773.114629:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622338304 00002000:00100000:2.0:1746143773.114668:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1826815) req@ffff8800939a6680 x1830963622338304/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.114673:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8801373bbb80 x1830963622338048/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.114677:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a6680 with x1830963622338304 ext(1048576->1826815) 00002000:00010000:2.0:1746143773.114682:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a6680 00002000:00100000:3.0:1746143773.114683:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bbb80 with x1830963622338048 ext(0->1048575) 00002000:00010000:3.0:1746143773.114688:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373bbb80 00000100:00100000:2.0:1746143773.114709:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622338560 00000100:00100000:2.0:1746143773.114711:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622338560 00002000:00100000:2.0:1746143773.114725:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1236992->2097151) req@ffff8800939a5f80 x1830963622338560/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.114730:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5f80 with x1830963622338560 ext(1236992->2097151) 00002000:00010000:2.0:1746143773.114733:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a5f80 00000100:00100000:3.0:1746143773.114735:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3184 00000100:00100000:3.0:1746143773.114745:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622338304:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.114800:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3185 00000100:00100000:1.0:1746143773.114805:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3186 00000100:00100000:2.0:1746143773.114808:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622338048:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143773.114812:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622338560:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143773.122124:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622338304:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7367us (7858us total) trans 0 rc 778240/778240 00000100:00100000:3.0:1746143773.122137:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3184 00002000:00100000:3.0:1746143773.122152:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1826815) req@ffff8800939a6680 x1830963622338304/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.122162:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a6680 with x1830963622338304 ext(1048576->1826815) 00002000:00010000:3.0:1746143773.122168:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a6680 00000100:00100000:2.0:1746143773.123907:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622338560:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9089us (9607us total) trans 0 rc 860160/860160 00000100:00100000:2.0:1746143773.123941:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3186 00002000:00100000:2.0:1746143773.123951:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1236992->2097151) req@ffff8800939a5f80 x1830963622338560/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 860160/860160 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.123970:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5f80 with x1830963622338560 ext(1236992->2097151) 00002000:00010000:2.0:1746143773.123975:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a5f80 00000100:00100000:2.0:1746143773.127670:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622338048:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12851us (13451us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143773.127684:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3185 00002000:00100000:2.0:1746143773.127701:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8801373bbb80 x1830963622338048/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.127710:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bbb80 with x1830963622338048 ext(0->1048575) 00002000:00010000:2.0:1746143773.127716:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373bbb80 00000100:00100000:0.0:1746143773.139907:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.140033:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.140120:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622338944 00000100:00100000:3.0:1746143773.140131:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622338944 00002000:00100000:3.0:1746143773.140179:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800939a5880 x1830963622338944/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.140190:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5880 with x1830963622338944 ext(2097152->4194303) 00002000:00010000:3.0:1746143773.140196:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a5880 00000100:00100000:3.0:1746143773.140227:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622339072 00000100:00100000:3.0:1746143773.140230:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622339072 00002000:00100000:3.0:1746143773.140243:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff8800939a6300 x1830963622339072/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.140250:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a6300 with x1830963622339072 ext(2097152->3145727) 00002000:00010000:3.0:1746143773.140253:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a6300 00000100:00100000:3.0:1746143773.140267:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3187 00000100:00100000:3.0:1746143773.140275:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622338944:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.140496:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3188 00000100:00100000:2.0:1746143773.140506:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622339072:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143773.146264:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.146340:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622339328 00000100:00100000:2.0:1746143773.146354:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622339328 00000100:00100000:2.0:1746143773.146417:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12768 00000100:00100000:2.0:1746143773.146426:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+288:31937:x1830963622339328:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.146457:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.146476:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7f1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a55e expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.146551:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146563:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146573:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146586:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146591:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146596:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146690:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146698:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146704:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143773.146712:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143773.146785:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146791:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146796:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146802:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146807:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.146811:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146817:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146827:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143773.146830:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.146834:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146839:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7f24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146870:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146875:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146879:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146883:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.146884:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146888:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146893:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b40f3200) 00010000:00010000:2.0:1746143773.146894:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.146896:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146899:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.146977:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7f1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a55e expref: 291 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.146990:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a55e expref: 290 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.146996:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.146998:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143773.147000:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551a00, rc 0) 00000100:00100000:2.0:1746143773.147050:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+290:31937:x1830963622339328:12345-192.168.202.3@tcp:101:cat.0 Request processed in 625us (798us total) trans 8589943489 rc 0/0 00000100:00100000:2.0:1746143773.147057:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12768 00000100:00100000:2.0:1746143773.149950:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622339072:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9435us (9905us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143773.149971:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3188 00002000:00100000:2.0:1746143773.149984:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff8800939a6300 x1830963622339072/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.149994:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a6300 with x1830963622339072 ext(2097152->3145727) 00002000:00010000:2.0:1746143773.150001:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a6300 00000100:00100000:3.0:1746143773.152771:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622338944:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12485us (12866us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143773.152781:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3187 00002000:00100000:3.0:1746143773.152792:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800939a5880 x1830963622338944/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.152800:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5880 with x1830963622338944 ext(2097152->4194303) 00002000:00010000:3.0:1746143773.152806:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a5880 00000100:00100000:2.0:1746143773.155006:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.155046:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.155069:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622339712 00000100:00100000:2.0:1746143773.155078:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622339712 00000100:00100000:2.0:1746143773.155118:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622339840 00000100:00100000:2.0:1746143773.155120:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622339840 00000100:00100000:2.0:1746143773.155138:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11391 00000100:00100000:2.0:1746143773.155145:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963622339712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.155166:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.155185:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a56c expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.155215:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.155217:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.155226:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a56c expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.155242:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a56c expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.155253:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551c00, rc 0) 00000100:00100000:2.0:1746143773.155306:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622339712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 161us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.155313:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11391 00000100:00100000:2.0:1746143773.155328:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11392 00000100:00100000:2.0:1746143773.155333:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622339840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.155339:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.155349:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a7f47 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a573 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.155390:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626677632:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143773.155455:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.155489:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.155552:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622339968 00000100:00100000:2.0:1746143773.155554:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622339968 00000100:00100000:2.0:1746143773.155571:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11393 00000100:00100000:2.0:1746143773.155575:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622339968:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.155583:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.155590:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd87200/0x87925e4cb73a7f4e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a57a expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.155615:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626677760:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143773.155637:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.156323:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.156932:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622339584 00000100:00100000:2.0:1746143773.156938:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622339584 00000100:00100000:2.0:1746143773.156986:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12769 00000100:00100000:2.0:1746143773.156993:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+290:31934:x1830963622339584:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143773.157010:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.157026:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a7f55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a565 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.157128:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143773.157142:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a503 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.157149:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a534 expref: 38 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.157154:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a55e expref: 291 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.157159:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143773.157187:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a55e expref: 291 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.157199:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a55e expref: 291 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.157208:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626677888:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.157290:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a534 expref: 38 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.157297:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a534 expref: 38 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.157305:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626678016:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.157329:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a503 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.157336:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a503 expref: 12 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.157343:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626678144:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.157357:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dd42300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.159518:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.159535:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.159574:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626677632:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143773.159613:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a7f47 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a573 expref: 30 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.159635:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a7f47 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a573 expref: 30 pid: 12327 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143773.159636:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626677760:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143773.159658:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd87200/0x87925e4cb73a7f4e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a57a expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.159659:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550e00, rc 0) 00010000:00010000:3.0:1746143773.159670:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd87200/0x87925e4cb73a7f4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a57a expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.159679:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd87200, rc 0) 00000100:00100000:2.0:1746143773.159702:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622339840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4368us (4654us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143773.159711:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11392 00000100:00100000:1.0:1746143773.159747:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622340096 00000100:00100000:2.0:1746143773.159752:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626677888:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143773.159754:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622340096 00000100:00100000:2.0:1746143773.159760:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626678016:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143773.159786:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a55e expref: 292 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.159812:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622340224 00000100:00100000:1.0:1746143773.159814:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622340224 00010000:00010000:1.0:1746143773.159823:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a534 expref: 39 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.159835:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5314 00000100:00100000:1.0:1746143773.159841:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+292:2010:x1830963622340096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143773.159874:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622339968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4298us (4384us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143773.159879:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11393 00000100:00100000:3.0:1746143773.159898:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5315 00000100:00100000:3.0:1746143773.159902:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+39:2010:x1830963622340224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.159909:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.159938:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a534 expref: 39 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.159946:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a534 expref: 39 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.159973:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73a7ede lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a534 expref: 39 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.159983:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143773.159988:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143773.159996:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143773.160004:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.160018:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:2010:x1830963622340224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 116us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.160023:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5315 00010000:00010000:1.0:1746143773.160069:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.160073:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a55e expref: 292 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.160080:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a55e expref: 292 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.160091:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73a7f32 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a55e expref: 292 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.160192:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143773.160195:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.160200:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.160204:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143773.160219:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+291:2010:x1830963622340096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 377us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.160224:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5314 00000100:00100000:2.0:1746143773.160356:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626678144:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.160376:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746143773.160378:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.160391:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622340352 00000100:00100000:2.0:1746143773.160393:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622340352 00010000:00010000:2.0:1746143773.160404:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a503 expref: 13 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.160417:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5316 00000100:00100000:2.0:1746143773.160422:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622340352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.160428:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.160431:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a503 expref: 13 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.160439:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a503 expref: 13 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.160451:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73a7e91 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a503 expref: 13 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.160459:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.160462:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143773.160468:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143773.160475:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143773.160499:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.160523:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622340352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 100us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.160528:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5316 00010000:00010000:0.0:1746143773.160600:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143773.160606:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746143773.160625:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143773.160750:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73a7f55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a565 expref: 292 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.160766:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a565 expref: 291 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.160772:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143773.160774:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143773.160776:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d66400, rc 0) 00000100:00100000:0.0:1746143773.160799:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+291:31934:x1830963622339584:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3807us (4477us total) trans 8589943490 rc 0/0 00000100:00100000:0.0:1746143773.160805:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12769 00000100:00100000:2.0:1746143773.165507:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.165791:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622340608 00000100:00100000:3.0:1746143773.165802:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622340608 00002000:00100000:3.0:1746143773.165857:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880091bdf100 x1830963622340608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.165868:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf100 with x1830963622340608 ext(0->1048575) 00002000:00010000:3.0:1746143773.165874:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdf100 00000100:00100000:3.0:1746143773.165956:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3189 00000100:00100000:3.0:1746143773.165980:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622340608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143773.173533:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622340608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7543us (8027us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143773.173549:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3189 00002000:00100000:3.0:1746143773.173566:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880091bdf100 x1830963622340608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.173576:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf100 with x1830963622340608 ext(0->1048575) 00002000:00010000:3.0:1746143773.173583:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdf100 00000100:00100000:0.0:1746143773.180876:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.181072:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622340736 00000100:00100000:3.0:1746143773.181082:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622340736 00000100:00100000:3.0:1746143773.181172:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11394 00000100:00100000:3.0:1746143773.181181:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:31937:x1830963622340736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.181202:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.181221:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a581 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.181253:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.181261:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.181262:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.181266:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.181300:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.181312:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 11 pid: 1945 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.181324:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626678272:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.181429:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.183363:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626678272:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.183390:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.183400:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143773.183406:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2e00, rc 0) 00000100:00100000:3.0:1746143773.183461:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:31937:x1830963622340736:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2280us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.183758:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11394 00000100:00100000:2.0:1746143773.184525:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622340864 00000100:00100000:2.0:1746143773.184534:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622340864 00002000:00100000:2.0:1746143773.184583:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1826816->2097151) req@ffff88009719f480 x1830963622340864/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.184595:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f480 with x1830963622340864 ext(1826816->2097151) 00010000:00010000:2.0:1746143773.184603:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 12 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.184616:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 12 pid: 1945 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746143773.184627:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009719f480 00000100:00100000:2.0:1746143773.184650:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1358 00000100:00100000:2.0:1746143773.184659:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622340864:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143773.190369:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622340864:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5700us (6960us total) trans 17179872917 rc 0/0 00000100:00100000:2.0:1746143773.190382:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1358 00002000:00100000:2.0:1746143773.190395:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1826816->2097151) req@ffff88009719f480 x1830963622340864/t17179872917(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.190404:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f480 with x1830963622340864 ext(1826816->2097151) 00010000:00010000:2.0:1746143773.190415:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 14 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.190431:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 14 pid: 1945 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746143773.190437:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009719f480 00000100:00100000:0.0:1746143773.193517:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.193589:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622340992 00000100:00100000:2.0:1746143773.193599:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622340992 00010000:00010000:2.0:1746143773.193649:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 14 pid: 1945 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.193700:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5317 00000100:00100000:2.0:1746143773.193710:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622340992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.193727:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.193752:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 14 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.193765:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 14 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.193790:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73a7eec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a53b expref: 14 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.193832:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.193834:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.193842:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.193851:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.193890:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.193903:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626678400:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.194463:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dd42300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.198121:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626678400:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143773.198145:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143773.198204:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622340992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4495us (4698us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143773.198216:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5317 00000100:00100000:0.0:1746143773.198854:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.198938:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622341248 00000100:00100000:2.0:1746143773.198947:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622341248 00002000:00100000:2.0:1746143773.198998:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88009719ce00 x1830963622341248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.199008:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ce00 with x1830963622341248 ext(1048576->2097151) 00002000:00010000:2.0:1746143773.199012:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719ce00 00000100:00100000:2.0:1746143773.199033:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3190 00000100:00100000:2.0:1746143773.199040:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622341248:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143773.203044:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.203887:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622341376 00000100:00100000:2.0:1746143773.203898:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622341376 00000100:00100000:2.0:1746143773.203987:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11395 00000100:00100000:2.0:1746143773.203996:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:31934:x1830963622341376:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143773.204017:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.204035:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a588 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.204064:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 33 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.204073:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73a7e21 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e0 expref: 8 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.204081:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a7df7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4af expref: 12 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.204087:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.204089:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.204093:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.204127:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a7df7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4af expref: 12 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.204142:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a7df7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4af expref: 12 pid: 3134 timeout: 932 lvb_type: 1 00000100:00100000:2.0:1746143773.204155:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626678528:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.204259:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73a7e21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e0 expref: 8 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.204266:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73a7e21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e0 expref: 8 pid: 1947 timeout: 932 lvb_type: 1 00000100:00100000:2.0:1746143773.204274:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626678656:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.204295:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 33 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.204302:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 33 pid: 3134 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.204308:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626678784:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.204321:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dd42300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.210028:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626678528:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143773.210028:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.210041:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626678656:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.210048:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626678784:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143773.210053:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143773.210083:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.210083:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963622341248:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11042us (11229us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143773.210096:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3190 00010000:00010000:3.0:1746143773.210100:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7000, rc 0) 00002000:00100000:2.0:1746143773.210107:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88009719ce00 x1830963622341248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143773.210119:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:31934:x1830963622341376:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6126us (7086us total) trans 0 rc 0/0 00002000:00100000:2.0:1746143773.210121:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ce00 with x1830963622341248 ext(1048576->2097151) 00000100:00100000:3.0:1746143773.210126:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11395 00002000:00010000:2.0:1746143773.210127:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719ce00 00000100:00100000:1.0:1746143773.210210:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622341504 00000100:00100000:1.0:1746143773.210217:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622341504 00010000:00010000:1.0:1746143773.210242:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73a7e21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e0 expref: 9 pid: 1947 timeout: 932 lvb_type: 1 00000100:00100000:1.0:1746143773.210270:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622341632 00000100:00100000:1.0:1746143773.210272:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622341632 00000100:00100000:0.0:1746143773.210272:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143773.210285:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a7df7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4af expref: 13 pid: 3134 timeout: 932 lvb_type: 1 00000100:00100000:1.0:1746143773.210297:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622341760 00000100:00100000:1.0:1746143773.210300:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622341760 00010000:00010000:1.0:1746143773.210308:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 31 pid: 3134 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.210320:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5318 00000100:00100000:1.0:1746143773.210325:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622341504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.210338:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143773.210350:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5319 00010000:00010000:1.0:1746143773.210356:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73a7e21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e0 expref: 9 pid: 1947 timeout: 932 lvb_type: 1 00000100:00100000:2.0:1746143773.210357:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622341632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.210365:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.210366:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73a7e21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e0 expref: 9 pid: 1947 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.210376:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a7df7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4af expref: 13 pid: 3134 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143773.210389:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73a7e21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4e0 expref: 9 pid: 1947 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.210394:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a7df7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4af expref: 13 pid: 3134 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.210407:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a7df7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4af expref: 13 pid: 3134 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143773.210419:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143773.210420:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143773.210436:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622341504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 111us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.210438:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622341632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 83us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.210441:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5320 00000100:00100000:1.0:1746143773.210445:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5318 00000100:00100000:3.0:1746143773.210448:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622341760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.210455:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.210465:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 31 pid: 3134 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.210475:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 31 pid: 3134 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.210487:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73a7de9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4a1 expref: 31 pid: 3134 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.210500:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.210502:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.210509:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.210518:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.210553:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.210564:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626678912:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143773.210621:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.210647:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5319 00000100:00100000:3.0:1746143773.213678:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626678912:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143773.213702:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.213834:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622341760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3384us (3559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.213845:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5320 00000100:00100000:0.0:1746143773.214146:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.214227:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622342016 00000100:00100000:2.0:1746143773.214234:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622342016 00002000:00100000:2.0:1746143773.214279:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (4136960->4141055) req@ffff88009719c000 x1830963622342016/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.214289:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c000 with x1830963622342016 ext(4136960->4141055) 00002000:00010000:2.0:1746143773.214293:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719c000 00000100:00100000:2.0:1746143773.216796:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3191 00000100:00100000:2.0:1746143773.216819:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622342016:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143773.217038:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622342016:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 230us (2892us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143773.217044:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3191 00002000:00100000:2.0:1746143773.217052:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (4136960->4141055) req@ffff88009719c000 x1830963622342016/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.217061:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c000 with x1830963622342016 ext(4136960->4141055) 00002000:00010000:2.0:1746143773.217067:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719c000 00000100:00100000:0.0:1746143773.217892:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.218471:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622342144 00000100:00100000:3.0:1746143773.218481:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622342144 00000100:00100000:3.0:1746143773.219098:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11396 00000100:00100000:3.0:1746143773.219107:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:31937:x1830963622342144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.219125:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.219145:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a58f expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.219177:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.219184:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.219186:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.219190:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.219224:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.219236:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 13 pid: 3134 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.219249:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626679040:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.219344:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.221057:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626679040:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.221088:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.221103:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f800, rc 0) 00000100:00100000:3.0:1746143773.221156:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:31937:x1830963622342144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2050us (3266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.221164:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11396 00000100:00100000:0.0:1746143773.223867:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.223981:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.224014:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622342656 00000100:00100000:0.0:1746143773.224023:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622342656 00000100:00100000:0.0:1746143773.224075:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12770 00000100:00100000:0.0:1746143773.224084:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:31940:x1830963622342656:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:3.0:1746143773.224105:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622342272 00000100:00100000:3.0:1746143773.224111:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622342272 00010000:00010000:0.0:1746143773.224113:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143773.224133:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73a7f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a59d expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.224137:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11397 00000100:00100000:3.0:1746143773.224143:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:31934:x1830963622342272:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143773.224152:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.224169:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a596 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.224196:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.224204:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73a7e36 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d9 expref: 6 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.224212:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.224217:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.224219:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.224223:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->4677631] (req 4194304->4677631) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.224245:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143773.224253:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.224258:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143773.224265:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 13 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143773.224268:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746143773.224277:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:3.0:1746143773.224278:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626679168:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.224357:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73a7e36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d9 expref: 6 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.224365:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73a7e36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d9 expref: 6 pid: 13430 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143773.224365:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73a7f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a59d expref: 41 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.224374:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626679296:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143773.224391:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a59d expref: 40 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.224398:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143773.224401:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143773.224402:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.224403:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9200, rc 0) 00010000:00010000:3.0:1746143773.224409:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.224417:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626679424:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143773.224428:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+40:31940:x1830963622342656:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 346us (446us total) trans 8589943491 rc 0/0 00000100:00100000:0.0:1746143773.224433:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12770 00000100:00100000:3.0:1746143773.224436:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.224493:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.224592:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622342400 00000100:00100000:3.0:1746143773.224596:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622342400 00002000:00100000:3.0:1746143773.224622:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1236991) req@ffff880095e33100 x1830963622342400/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.224630:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33100 with x1830963622342400 ext(1048576->1236991) 00010000:00010000:3.0:1746143773.224635:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 14 pid: 3134 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.224644:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 14 pid: 3134 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143773.224649:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e33100 00000100:00100000:3.0:1746143773.224662:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1359 00000100:00100000:3.0:1746143773.224667:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622342400:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143773.229337:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622342400:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4658us (4832us total) trans 21474840238 rc 0/0 00000100:00100000:3.0:1746143773.229351:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1359 00002000:00100000:3.0:1746143773.229364:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1236991) req@ffff880095e33100 x1830963622342400/t21474840238(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.229374:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33100 with x1830963622342400 ext(1048576->1236991) 00010000:00010000:3.0:1746143773.229385:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 16 pid: 3134 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.229398:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 16 pid: 3134 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143773.229404:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e33100 00000100:00100000:0.0:1746143773.233475:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.233514:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.233635:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626679168:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.233645:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626679296:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.233651:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626679424:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.233687:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->4677631] (req 4194304->4677631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.233704:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fc00, rc 0) 00000100:00100000:3.0:1746143773.233745:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:31934:x1830963622342272:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9603us (9889us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.233754:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11397 00000100:00100000:2.0:1746143773.233832:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622342912 00000100:00100000:2.0:1746143773.233840:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622342912 00010000:00010000:2.0:1746143773.233871:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 16 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.233891:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622342784 00000100:00100000:2.0:1746143773.233893:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622342784 00010000:00010000:2.0:1746143773.233903:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73a7e36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d9 expref: 7 pid: 13430 timeout: 932 lvb_type: 1 00000100:00100000:2.0:1746143773.233942:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5321 00000100:00100000:2.0:1746143773.233949:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622342912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.233973:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.233997:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 16 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.234007:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 16 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.234034:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a7de2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a49a expref: 16 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.234052:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.234070:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2010:x1830963622342912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 122us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.234076:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5321 00000100:00100000:2.0:1746143773.234087:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5322 00000100:00100000:2.0:1746143773.234093:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2010:x1830963622342784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.234099:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.234105:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73a7e36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d9 expref: 7 pid: 13430 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.234113:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73a7e36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d9 expref: 7 pid: 13430 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.234122:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73a7e36 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4d9 expref: 7 pid: 13430 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.234128:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.234141:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2010:x1830963622342784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 48us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.234146:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5322 00000100:00100000:0.0:1746143773.234476:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.234573:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.235255:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622343040 00000100:00100000:3.0:1746143773.235262:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622343040 00010000:00010000:3.0:1746143773.235282:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 15 pid: 3134 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.235299:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622343168 00000100:00100000:3.0:1746143773.235301:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622343168 00010000:00010000:3.0:1746143773.235307:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.235316:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5323 00000100:00100000:3.0:1746143773.235320:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622343040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.235329:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.235340:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 15 pid: 3134 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.235348:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 15 pid: 3134 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.235361:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73a7ddb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a493 expref: 15 pid: 3134 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.235374:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.235376:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.235382:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.235389:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.235418:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.235431:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626679552:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143773.235480:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.235497:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5324 00000100:00100000:3.0:1746143773.235502:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622343168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.235508:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.235517:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.235526:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.235537:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d849800/0x87925e4cb73a7dd4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a48c expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.235545:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.235546:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.235550:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.235557:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.235572:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.235583:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626679680:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143773.235601:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.240405:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626679680:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.240406:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626679552:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143773.240430:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143773.240430:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.240488:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622343168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4983us (5912us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.240488:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622343040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5164us (6009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.240499:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5323 00000100:00100000:3.0:1746143773.240508:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5324 00000100:00100000:0.0:1746143773.241647:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.241782:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622343424 00000100:00100000:3.0:1746143773.241789:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622343424 00002000:00100000:3.0:1746143773.241822:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095e32680 x1830963622343424/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.241830:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32680 with x1830963622343424 ext(1048576->2097151) 00002000:00010000:3.0:1746143773.241834:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e32680 00000100:00100000:3.0:1746143773.241847:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3192 00000100:00100000:3.0:1746143773.241852:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622343424:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143773.249568:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.249634:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622343680 00000100:00100000:2.0:1746143773.249645:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622343680 00002000:00100000:2.0:1746143773.249694:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4673536->4677631) req@ffff880095e31c00 x1830963622343680/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.249704:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31c00 with x1830963622343680 ext(4673536->4677631) 00002000:00010000:2.0:1746143773.249709:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e31c00 00000100:00100000:2.0:1746143773.249732:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3193 00000100:00100000:2.0:1746143773.249740:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622343680:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143773.249859:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622343680:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 120us (301us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143773.249866:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3193 00002000:00100000:2.0:1746143773.249871:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4673536->4677631) req@ffff880095e31c00 x1830963622343680/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.249878:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31c00 with x1830963622343680 ext(4673536->4677631) 00002000:00010000:2.0:1746143773.249881:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e31c00 00000100:00100000:3.0:1746143773.250035:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622343424:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8181us (8389us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143773.250043:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3192 00002000:00100000:3.0:1746143773.250049:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095e32680 x1830963622343424/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.250057:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32680 with x1830963622343424 ext(1048576->2097151) 00002000:00010000:3.0:1746143773.250060:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e32680 00000100:00100000:0.0:1746143773.252162:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.252228:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622343808 00000100:00100000:3.0:1746143773.252237:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622343808 00000100:00100000:3.0:1746143773.252281:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11398 00000100:00100000:3.0:1746143773.252287:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:31940:x1830963622343808:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143773.252304:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.252319:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5a4 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.252347:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.252353:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.252354:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.252357:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1925120->2097151] (req 1925120->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.252381:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.252389:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.252398:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626679808:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.253075:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.256071:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.256145:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622343936 00000100:00100000:2.0:1746143773.256155:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622343936 00010000:00010000:2.0:1746143773.256196:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.256229:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5325 00000100:00100000:2.0:1746143773.256238:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963622343936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.256253:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.256276:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.256939:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626679808:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.256975:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1925120->2097151] (req 1925120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.256996:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fe00, rc 0) 00000100:00100000:3.0:1746143773.257062:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:31940:x1830963622343808:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4774us (4909us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.257069:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11398 00010000:00010000:2.0:1746143773.257156:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.257181:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2e00/0x87925e4cb73a7f6a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a581 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.257206:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.257208:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.257216:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 12 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.257223:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 12 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.257255:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 12 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.257268:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626679936:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.257350:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.259998:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.260123:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626679936:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.260247:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.260301:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622343936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4064us (4241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.260313:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5325 00000100:00100000:3.0:1746143773.260508:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622344192 00000100:00100000:3.0:1746143773.260520:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622344192 00002000:00100000:3.0:1746143773.260561:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1925120->1929215) req@ffff880095e33b80 x1830963622344192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.260570:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33b80 with x1830963622344192 ext(1925120->1929215) 00002000:00010000:3.0:1746143773.260575:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e33b80 00000100:00100000:3.0:1746143773.260591:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3194 00000100:00100000:3.0:1746143773.260597:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622344192:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143773.260727:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622344192:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 131us (898us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143773.260733:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3194 00002000:00100000:3.0:1746143773.260737:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1925120->1929215) req@ffff880095e33b80 x1830963622344192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.260743:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33b80 with x1830963622344192 ext(1925120->1929215) 00002000:00010000:3.0:1746143773.260746:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e33b80 00000100:00100000:0.0:1746143773.263601:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.263688:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622344320 00000100:00100000:3.0:1746143773.263696:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622344320 00000100:00100000:3.0:1746143773.263752:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11399 00000100:00100000:3.0:1746143773.263759:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:31940:x1830963622344320:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143773.263782:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.263806:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5ab expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.263839:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.263847:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.263848:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.263851:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->1277951] (req 1048576->1277951) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.263885:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.263896:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 28 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.263907:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626680064:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.264699:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.264752:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.264800:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.264823:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622344832 00000100:00100000:3.0:1746143773.264828:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622344832 00002000:00100000:3.0:1746143773.264861:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4136959) req@ffff880095e30000 x1830963622344832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143773.264864:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622344576 00000100:00100000:2.0:1746143773.264869:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622344576 00002000:00100000:3.0:1746143773.264870:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30000 with x1830963622344832 ext(2097152->4136959) 00002000:00010000:3.0:1746143773.264875:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e30000 00002000:00100000:2.0:1746143773.264889:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012b7a8a80 x1830963622344576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.264897:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8a80 with x1830963622344576 ext(2097152->4194303) 00002000:00010000:2.0:1746143773.264901:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a8a80 00000100:00100000:3.0:1746143773.264903:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3195 00000100:00100000:3.0:1746143773.264930:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622344832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.264957:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3196 00000100:00100000:2.0:1746143773.264979:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622344576:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143773.266787:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626680064:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.266817:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->1277951] (req 1048576->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.266832:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ea00, rc 0) 00000100:00100000:3.0:1746143773.267179:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:31940:x1830963622344320:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3418us (3584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.267188:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11399 00000100:00100000:1.0:1746143773.267505:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.267530:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622344960 00000100:00100000:1.0:1746143773.267536:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622344960 00010000:00010000:1.0:1746143773.267563:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 31 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.267589:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5326 00000100:00100000:1.0:1746143773.267596:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622344960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.267609:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.267631:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 31 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.267642:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 31 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.267668:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f800/0x87925e4cb73a7f78 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a58f expref: 31 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.267694:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.267697:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.267704:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.267712:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.267748:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.267761:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626680192:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143773.267825:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.274217:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626680192:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.274240:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.274299:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622344960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6702us (6794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.274312:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5326 00000100:00100000:0.0:1746143773.276255:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.276967:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622345216 00000100:00100000:2.0:1746143773.276978:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622345216 00002000:00100000:2.0:1746143773.277027:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1273856->1277951) req@ffff88012b7a9880 x1830963622345216/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.277037:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9880 with x1830963622345216 ext(1273856->1277951) 00002000:00010000:2.0:1746143773.277043:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a9880 00000100:00100000:2.0:1746143773.277131:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3197 00000100:00100000:2.0:1746143773.277139:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622345216:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143773.277505:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622345216:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 365us (1258us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143773.277513:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3197 00002000:00100000:2.0:1746143773.277518:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1273856->1277951) req@ffff88012b7a9880 x1830963622345216/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.277525:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9880 with x1830963622345216 ext(1273856->1277951) 00002000:00010000:2.0:1746143773.277528:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a9880 00000100:00100000:3.0:1746143773.278802:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622344832:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13886us (14044us total) trans 0 rc 2039808/2039808 00000100:00100000:3.0:1746143773.278811:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3195 00002000:00100000:3.0:1746143773.278819:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4136959) req@ffff880095e30000 x1830963622344832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 2039808/2039808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.278827:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30000 with x1830963622344832 ext(2097152->4136959) 00002000:00010000:3.0:1746143773.278831:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e30000 00000100:00100000:2.0:1746143773.283020:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622344576:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18035us (18206us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143773.283034:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3196 00002000:00100000:2.0:1746143773.283045:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012b7a8a80 x1830963622344576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.283055:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8a80 with x1830963622344576 ext(2097152->4194303) 00002000:00010000:2.0:1746143773.283062:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a8a80 00000100:00100000:0.0:1746143773.290471:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.290670:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.290768:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622345344 00000100:00100000:3.0:1746143773.290778:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622345344 00000100:00100000:3.0:1746143773.290832:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622345472 00000100:00100000:3.0:1746143773.290835:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622345472 00000100:00100000:3.0:1746143773.290888:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11400 00000100:00100000:3.0:1746143773.290899:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622345344:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.290951:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.290981:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a7fa9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5b2 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.291041:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626680320:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143773.291115:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11401 00000100:00100000:0.0:1746143773.291122:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622345472:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143773.291125:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143773.291130:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143773.291140:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e513a00/0x87925e4cb73a7fb0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5b9 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.291166:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626680448:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143773.291188:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.293114:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626680320:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143773.293146:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a7fa9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5b2 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.293159:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a7fa9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5b2 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.293187:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f800, rc 0) 00000100:00100000:3.0:1746143773.293234:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622345344:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2335us (2772us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143773.293243:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11400 00000100:00100000:1.0:1746143773.293459:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626680448:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143773.293481:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e513a00/0x87925e4cb73a7fb0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5b9 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.293489:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e513a00/0x87925e4cb73a7fb0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5b9 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.293500:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513a00, rc 0) 00000100:00100000:1.0:1746143773.293519:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622345472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2398us (2849us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143773.293525:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11401 00000100:00100000:0.0:1746143773.297238:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.297417:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622345728 00000100:00100000:2.0:1746143773.297429:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622345728 00002000:00100000:2.0:1746143773.297496:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4677632->4780031) req@ffff88012b7aa300 x1830963622345728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.297507:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7aa300 with x1830963622345728 ext(4677632->4780031) 00002000:00010000:2.0:1746143773.297513:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7aa300 00000100:00100000:2.0:1746143773.297548:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3198 00000100:00100000:2.0:1746143773.297557:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622345728:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.301321:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622345728:12345-192.168.202.3@tcp:3:cat.0 Request processed in 3751us (4082us total) trans 0 rc 102400/102400 00000100:00100000:2.0:1746143773.301350:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3198 00002000:00100000:2.0:1746143773.301362:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4677632->4780031) req@ffff88012b7aa300 x1830963622345728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 102400/102400 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.301372:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7aa300 with x1830963622345728 ext(4677632->4780031) 00002000:00010000:2.0:1746143773.301378:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7aa300 00000100:00100000:0.0:1746143773.307144:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.308194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.309350:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622345856 00000100:00100000:1.0:1746143773.309364:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622345856 00000100:00100000:1.0:1746143773.309477:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622345984 00000100:00100000:1.0:1746143773.309480:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622345984 00000100:00100000:3.0:1746143773.309494:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11402 00000100:00100000:3.0:1746143773.309506:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622345856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.309528:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.309547:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73a7fb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5c0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.309551:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11403 00000100:00100000:1.0:1746143773.309557:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622345984:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143773.309565:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.309575:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a7fbe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5c7 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.309604:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626680576:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143773.309605:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626680704:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143773.310062:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.310106:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.311909:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626680576:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143773.311909:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626680704:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143773.311976:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73a7fb7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5c0 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.311976:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a7fbe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5c7 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.311990:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73a7fb7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5c0 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.311990:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a7fbe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5c7 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.312009:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0ba00, rc 0) 00010000:00010000:3.0:1746143773.312014:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fa00, rc 0) 00000100:00100000:1.0:1746143773.312050:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622345984:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2493us (3858us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143773.312060:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11403 00000100:00100000:3.0:1746143773.312167:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622345856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2663us (5035us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143773.312173:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11402 00000100:00100000:0.0:1746143773.315144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.315188:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.315245:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622346112 00000100:00100000:3.0:1746143773.315259:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622346112 00000100:00100000:1.0:1746143773.315289:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622346240 00000100:00100000:1.0:1746143773.315293:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622346240 00000100:00100000:3.0:1746143773.315395:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11404 00000100:00100000:3.0:1746143773.315405:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622346112:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143773.315422:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11405 00010000:00010000:3.0:1746143773.315427:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143773.315428:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622346240:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143773.315435:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.315447:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a7fc5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5ce expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.315447:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0b400/0x87925e4cb73a7fcc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5d5 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.315500:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626680960:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143773.315500:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626680832:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143773.315816:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.315985:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143773.317215:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626680832:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143773.317248:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0b400/0x87925e4cb73a7fcc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5d5 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.317260:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0b400/0x87925e4cb73a7fcc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5d5 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.317272:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b400, rc 0) 00000100:00100000:1.0:1746143773.317320:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622346240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1891us (2130us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143773.317328:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11405 00000100:00100000:3.0:1746143773.317332:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626680960:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143773.317350:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a7fc5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ce expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.317359:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a7fc5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ce expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.317374:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f800, rc 0) 00000100:00100000:3.0:1746143773.317393:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622346112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1990us (2259us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143773.317398:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11404 00000100:00100000:0.0:1746143773.321095:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.321171:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622346496 00000100:00100000:2.0:1746143773.321181:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622346496 00000100:00100000:2.0:1746143773.321241:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4648 00000100:00100000:2.0:1746143773.321250:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137358050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+291:31937:x1830963622346496:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143773.321510:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137358050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+292:31937:x1830963622346496:12345-192.168.202.3@tcp:35:cat.0 Request processed in 261us (425us total) trans 8589943492 rc 0/0 00000100:00100000:2.0:1746143773.321517:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4648 00000100:00100000:0.0:1746143773.368435:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.368648:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622346752 00000100:00100000:2.0:1746143773.368659:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622346752 00000100:00100000:2.0:1746143773.368718:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12771 00000100:00100000:2.0:1746143773.368727:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+292:31945:x1830963622346752:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143773.368758:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.368779:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7fd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5dc expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.368860:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.368874:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.368885:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.368898:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a7fe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.368904:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a7fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.368910:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a7fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.369047:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7fe8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.369057:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.369063:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143773.369073:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143773.369148:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.369154:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.369159:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.369165:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.369170:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d550600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.369174:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.369180:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.369193:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143773.369197:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.369201:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.369205:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a7fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.370232:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a7fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.370240:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a7fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.370246:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a7fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.370250:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d550800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.370252:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a7fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.370257:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a7fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.370378:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b40f3200) 00010000:00010000:2.0:1746143773.370380:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.370383:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a7fe1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.370388:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a7fe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.370439:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a7fd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5dc expref: 295 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.370451:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5dc expref: 294 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.370457:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.370459:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143773.370461:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551200, rc 0) 00000100:00100000:2.0:1746143773.371223:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+294:31945:x1830963622346752:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2494us (2798us total) trans 8589943493 rc 0/0 00000100:00100000:2.0:1746143773.371233:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12771 00000100:00100000:0.0:1746143773.374615:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.374675:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.374803:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622346880 00000100:00100000:2.0:1746143773.374815:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622346880 00000100:00100000:2.0:1746143773.374872:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 732 00000100:00100000:2.0:1746143773.374881:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+294:2009:x1830963622346880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.374898:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.374948:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a7fe8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5dc expref: 294 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.374980:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.374985:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.375046:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+293:2009:x1830963622346880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 165us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.375052:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 732 00000100:00100000:3.0:1746143773.375120:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622347136 00000100:00100000:3.0:1746143773.375124:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622347136 00000100:00100000:3.0:1746143773.375150:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4649 00000100:00100000:3.0:1746143773.375156:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+293:31945:x1830963622347136:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143773.375355:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+294:31945:x1830963622347136:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 199us (679us total) trans 8589943494 rc 0/0 00000100:00100000:3.0:1746143773.375361:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4649 00000100:00100000:0.0:1746143773.381782:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.381834:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.381850:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622347264 00000100:00100000:3.0:1746143773.381861:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622347264 00000100:00100000:3.0:1746143773.381950:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622347392 00000100:00100000:3.0:1746143773.381953:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622347392 00000100:00100000:1.0:1746143773.381974:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11406 00000100:00100000:1.0:1746143773.381989:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622347264:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143773.382011:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.382030:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a7ff6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5e3 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.382084:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626681088:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143773.382171:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.382323:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11407 00000100:00100000:3.0:1746143773.382329:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622347392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.382341:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.382351:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73a7ffd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5ea expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.382379:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626681216:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143773.382406:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143773.384699:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626681088:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143773.384731:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a7ff6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5e3 expref: 16 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.384744:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a7ff6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5e3 expref: 16 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143773.385129:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626681216:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143773.385157:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73a7ffd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ea expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.385167:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73a7ffd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ea expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.385180:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fa00, rc 0) 00000100:00100000:3.0:1746143773.385221:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622347392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2891us (3385us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143773.385230:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11407 00010000:00010000:1.0:1746143773.385320:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0ba00, rc 0) 00000100:00100000:1.0:1746143773.385339:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622347264:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3352us (3569us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143773.385345:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11406 00000100:00100000:1.0:1746143773.395386:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.395709:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.395773:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622347904 00000100:00100000:2.0:1746143773.395775:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622347776 00000100:00100000:3.0:1746143773.395784:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622347904 00000100:00100000:2.0:1746143773.395784:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622347776 00002000:00100000:3.0:1746143773.395831:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1277952->2097151) req@ffff880082ed5880 x1830963622347904/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.395831:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1925119) req@ffff880082ed7100 x1830963622347776/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.395840:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed5880 with x1830963622347904 ext(1277952->2097151) 00002000:00010000:3.0:1746143773.395846:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed5880 00002000:00100000:2.0:1746143773.395846:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed7100 with x1830963622347776 ext(1048576->1925119) 00002000:00010000:2.0:1746143773.395849:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed7100 00000100:00100000:3.0:1746143773.395873:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3199 00000100:00100000:3.0:1746143773.395880:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2010:x1830963622347904:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.395880:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3200 00000100:00100000:2.0:1746143773.395887:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622347776:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143773.399332:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626681344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1746143773.399393:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143773.400124:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626681344 00000100:00100000:0.0:1746143773.400134:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626681344 00000100:00100000:0.0:1746143773.400411:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1746143773.400419:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626681344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746143773.400445:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 761856 granted 1014799552 pending 2707456 free 3913007104 avail 3681484800 00000100:00080000:2.0:1746143773.400524:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143773.400842:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626681344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 423us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143773.400849:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1746143773.400981:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626681344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746143773.408774:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622347776:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12875us (13052us total) trans 0 rc 876544/876544 00000100:00100000:2.0:1746143773.408787:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3200 00002000:00100000:2.0:1746143773.408799:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1925119) req@ffff880082ed7100 x1830963622347776/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 876544/876544 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.408808:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed7100 with x1830963622347776 ext(1048576->1925119) 00002000:00010000:2.0:1746143773.408814:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed7100 00000100:00100000:3.0:1746143773.409237:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2010:x1830963622347904:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13356us (13861us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746143773.409244:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3199 00002000:00100000:3.0:1746143773.409250:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1277952->2097151) req@ffff880082ed5880 x1830963622347904/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.409256:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed5880 with x1830963622347904 ext(1277952->2097151) 00002000:00010000:3.0:1746143773.409259:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed5880 00000100:00100000:0.0:1746143773.419202:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.419258:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.419479:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622348032 00000100:00100000:1.0:1746143773.419498:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622348032 00000100:00100000:1.0:1746143773.419551:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622348160 00000100:00100000:1.0:1746143773.419553:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622348160 00000100:00100000:1.0:1746143773.419581:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11408 00000100:00100000:1.0:1746143773.419589:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622348032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143773.419611:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143773.419623:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11409 00010000:00010000:1.0:1746143773.419631:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73a8004 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5f1 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.419649:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622348160:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.419656:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.419683:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28e00/0x87925e4cb73a800b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5f8 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.419760:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626681472:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143773.419882:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143773.420455:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626681600:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143773.420499:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.425823:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626681472:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143773.425838:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626681600:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143773.425862:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73a8004 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5f1 expref: 16 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.425863:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e28e00/0x87925e4cb73a800b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5f8 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.425876:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e28e00/0x87925e4cb73a800b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5f8 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.425876:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73a8004 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5f1 expref: 16 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.425902:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28e00, rc 0) 00010000:00010000:1.0:1746143773.425902:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b800, rc 0) 00000100:00100000:3.0:1746143773.425985:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622348160:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6335us (6725us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143773.425985:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622348032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6395us (6794us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143773.425994:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11409 00000100:00100000:1.0:1746143773.425998:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11408 00000100:00100000:0.0:1746143773.429739:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.430171:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622348288 00000100:00100000:3.0:1746143773.430184:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622348288 00000100:00100000:3.0:1746143773.430266:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11410 00000100:00100000:3.0:1746143773.430276:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:31948:x1830963622348288:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.430300:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.430321:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a5ff expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.430356:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.430364:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.430366:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.430369:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 16 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.430406:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.430420:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 27 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.430433:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626681728:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.431900:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.436480:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626681728:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.436517:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 16 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.436537:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28000, rc 0) 00000100:00100000:3.0:1746143773.436589:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:31948:x1830963622348288:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6314us (6860us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.436597:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11410 00000100:00100000:1.0:1746143773.436806:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.436977:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622348416 00000100:00100000:3.0:1746143773.436984:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622348416 00002000:00100000:3.0:1746143773.437020:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4677631) req@ffff880082ed4e00 x1830963622348416/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.437029:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed4e00 with x1830963622348416 ext(4194304->4677631) 00010000:00010000:3.0:1746143773.437035:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 28 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.437047:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 28 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143773.437052:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880082ed4e00 00000100:00100000:3.0:1746143773.437079:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1360 00000100:00100000:3.0:1746143773.437085:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622348416:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143773.443796:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622348416:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6698us (6977us total) trans 21474840239 rc 0/0 00000100:00100000:3.0:1746143773.443810:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1360 00002000:00100000:3.0:1746143773.443824:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4677631) req@ffff880082ed4e00 x1830963622348416/t21474840239(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.443834:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed4e00 with x1830963622348416 ext(4194304->4677631) 00010000:00010000:3.0:1746143773.443844:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.443865:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143773.443872:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880082ed4e00 00000100:00100000:0.0:1746143773.450315:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.450435:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622348544 00000100:00100000:2.0:1746143773.450446:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622348544 00010000:00010000:2.0:1746143773.450490:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.450522:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5327 00000100:00100000:2.0:1746143773.450531:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622348544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.450547:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.450570:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.450583:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.450609:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a7f86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a596 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.451302:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.451305:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.451314:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.451324:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.451363:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.451377:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626681856:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.451561:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.454928:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626681856:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.454955:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.455023:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622348544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4491us (4719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.455036:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5327 00000100:00100000:0.0:1746143773.456100:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.456299:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622348800 00000100:00100000:3.0:1746143773.456309:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622348800 00002000:00100000:3.0:1746143773.456360:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880095cb5180 x1830963622348800/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.456371:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5180 with x1830963622348800 ext(2097152->3145727) 00002000:00010000:3.0:1746143773.456377:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb5180 00000100:00100000:3.0:1746143773.457567:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3201 00000100:00100000:3.0:1746143773.457580:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622348800:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143773.457863:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.457903:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622349056 00000100:00100000:2.0:1746143773.457927:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622349056 00000100:00100000:2.0:1746143773.457975:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12772 00000100:00100000:2.0:1746143773.457982:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+294:31951:x1830963622349056:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.458002:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.458022:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a8019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a606 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.458101:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458114:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458124:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458137:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a8027 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458142:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a8027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458147:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a8027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458247:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a802e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458256:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a802e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458262:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a802e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143773.458270:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143773.458348:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458363:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458369:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458374:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458380:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.458383:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458393:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458404:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143773.458407:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.458411:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458416:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73a8020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458429:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a8027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458433:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a8027 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458437:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a8027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458441:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d550800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.458444:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a8027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458448:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a8027 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458454:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b40f3d00) 00010000:00010000:2.0:1746143773.458456:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.458458:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a8027 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458462:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a8027 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.458498:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73a8019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a606 expref: 297 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.458508:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a802e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a606 expref: 296 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.458514:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.458516:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143773.458518:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550600, rc 0) 00000100:00100000:2.0:1746143773.458545:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+296:31951:x1830963622349056:12345-192.168.202.3@tcp:101:cat.0 Request processed in 563us (682us total) trans 8589943495 rc 0/0 00000100:00100000:2.0:1746143773.458551:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12772 00000100:00100000:3.0:1746143773.464493:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622348800:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6904us (8386us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143773.464506:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3201 00002000:00100000:3.0:1746143773.464519:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880095cb5180 x1830963622348800/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.464529:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5180 with x1830963622348800 ext(2097152->3145727) 00002000:00010000:3.0:1746143773.464536:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb5180 00000100:00100000:0.0:1746143773.466187:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.466228:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.466254:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.466299:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.466322:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622349312 00000100:00100000:0.0:1746143773.466331:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622349312 00000100:00100000:0.0:1746143773.466370:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622349440 00000100:00100000:0.0:1746143773.466372:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622349440 00000100:00100000:0.0:1746143773.466382:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622349568 00000100:00100000:0.0:1746143773.466384:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622349568 00000100:00100000:0.0:1746143773.466396:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11411 00000100:00100000:0.0:1746143773.466403:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622349312:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143773.466404:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11412 00000100:00100000:3.0:1746143773.466413:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11413 00000100:00100000:1.0:1746143773.466413:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622349440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143773.466422:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143773.466423:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622349568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143773.466423:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.466431:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.466439:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a804a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a61b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.466439:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7ca00/0x87925e4cb73a803c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a614 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.466439:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a8043 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a60d expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.466463:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.466466:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.466475:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a804a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a61b expref: 32 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143773.466490:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626681984:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143773.466490:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626682112:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143773.466491:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a804a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a61b expref: 32 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.466502:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e29a00, rc 0) 00000100:00100000:2.0:1746143773.467092:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622349184 00000100:00100000:2.0:1746143773.467101:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622349184 00000100:00100000:2.0:1746143773.467138:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 733 00000100:00100000:2.0:1746143773.467143:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+296:2009:x1830963622349184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.467157:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.467175:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a802e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a606 expref: 296 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.467190:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.467194:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143773.467829:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.467829:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.468190:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+295:2009:x1830963622349184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1044us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.468198:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 733 00000100:00100000:3.0:1746143773.468281:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963622349568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1859us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.468289:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11413 00000100:00100000:0.0:1746143773.468726:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.468770:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622349696 00000100:00100000:3.0:1746143773.468776:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622349696 00000100:00100000:3.0:1746143773.468802:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11414 00000100:00100000:3.0:1746143773.468807:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:31948:x1830963622349696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.468820:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.468833:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a622 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.468856:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.468863:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.468865:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.468869:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.468894:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.468905:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.468940:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626682240:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.468997:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.469807:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626682112:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143773.469833:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a8043 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a60d expref: 30 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.469850:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x87925e4cb73a8043 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a60d expref: 30 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.469861:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107800, rc 0) 00000100:00100000:2.0:1746143773.469889:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622349312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3486us (3659us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143773.469896:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11411 00000100:00100000:1.0:1746143773.470012:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626681984:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143773.470033:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ca00/0x87925e4cb73a803c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a614 expref: 31 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.470043:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ca00/0x87925e4cb73a803c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a614 expref: 31 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.470065:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ca00, rc 0) 00000100:00100000:1.0:1746143773.470083:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622349440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3672us (3828us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143773.470089:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11412 00000100:00100000:0.0:1746143773.470536:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.470593:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622349824 00000100:00100000:2.0:1746143773.470599:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622349824 00002000:00100000:2.0:1746143773.470633:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (4136960->4194303) req@ffff880095cb4a80 x1830963622349824/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.470644:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4a80 with x1830963622349824 ext(4136960->4194303) 00010000:00010000:2.0:1746143773.470651:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.470663:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746143773.470669:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb4a80 00000100:00100000:2.0:1746143773.470683:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1361 00000100:00100000:2.0:1746143773.470689:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622349824:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143773.470978:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626682240:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.470997:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.471008:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fc00, rc 0) 00000100:00100000:3.0:1746143773.471027:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:31948:x1830963622349696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2219us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.471032:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11414 00000100:00100000:0.0:1746143773.476026:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.476173:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622349824:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5482us (5635us total) trans 17179872918 rc 0/0 00000100:00100000:2.0:1746143773.476186:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1361 00002000:00100000:2.0:1746143773.476200:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (4136960->4194303) req@ffff880095cb4a80 x1830963622349824/t17179872918(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.476210:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4a80 with x1830963622349824 ext(4136960->4194303) 00010000:00010000:2.0:1746143773.476222:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 31 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.476236:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 31 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746143773.476244:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb4a80 00000100:00100000:3.0:1746143773.476413:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622349952 00000100:00100000:3.0:1746143773.476421:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622349952 00000100:00100000:3.0:1746143773.476455:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11415 00000100:00100000:3.0:1746143773.476461:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+31:31951:x1830963622349952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.476476:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.476490:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a629 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.476522:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.476529:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.476531:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.476534:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.476563:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.476573:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 13 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.476584:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626682368:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.476636:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.482429:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.482474:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.482491:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622350080 00000100:00100000:2.0:1746143773.482502:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622350080 00000100:00100000:2.0:1746143773.482517:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622350208 00000100:00100000:2.0:1746143773.482520:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622350208 00010000:00010000:2.0:1746143773.482563:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 33 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.482593:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626682368:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.482600:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5328 00000100:00100000:2.0:1746143773.482608:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622350208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.482626:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.482629:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.482643:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f800, rc 0) 00010000:00010000:2.0:1746143773.482650:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 33 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.482661:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 33 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.482685:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a7f71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a588 expref: 33 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.482698:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:31951:x1830963622349952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6237us (6682us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143773.482703:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143773.482705:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11415 00010000:00010000:2.0:1746143773.482705:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.482712:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.482720:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.483159:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.483173:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626682496:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.484301:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b43c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746143773.484352:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1925120->2097151) req@ffff880095cb5880 x1830963622350080/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.484363:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5880 with x1830963622350080 ext(1925120->2097151) 00010000:00010000:2.0:1746143773.484372:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 14 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.484384:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 14 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746143773.484390:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb5880 00000100:00100000:2.0:1746143773.484411:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1362 00000100:00100000:2.0:1746143773.484417:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622350080:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143773.493572:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622350080:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9142us (11142us total) trans 17179872919 rc 0/0 00000100:00100000:2.0:1746143773.493587:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1362 00002000:00100000:2.0:1746143773.493602:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1925120->2097151) req@ffff880095cb5880 x1830963622350080/t17179872919(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.493612:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5880 with x1830963622350080 ext(1925120->2097151) 00010000:00010000:2.0:1746143773.493624:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 16 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.493639:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 16 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746143773.493646:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb5880 00000100:00100000:2.0:1746143773.494954:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626682496:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.494984:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.495046:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622350208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 12438us (12570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.495056:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5328 00000100:00100000:0.0:1746143773.497100:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.497146:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.497488:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622350592 00000100:00100000:1.0:1746143773.497492:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622350720 00000100:00100000:2.0:1746143773.497497:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622350592 00000100:00100000:1.0:1746143773.497497:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622350720 00002000:00100000:2.0:1746143773.497540:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095cb6a00 x1830963622350592/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.497540:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095cb7480 x1830963622350720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.497549:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7480 with x1830963622350720 ext(2097152->4194303) 00002000:00100000:2.0:1746143773.497550:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6a00 with x1830963622350592 ext(3145728->4194303) 00002000:00010000:2.0:1746143773.497554:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb6a00 00002000:00010000:1.0:1746143773.497554:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb7480 00000100:00100000:1.0:1746143773.497604:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3202 00000100:00100000:1.0:1746143773.497612:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622350592:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143773.497623:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3203 00000100:00100000:0.0:1746143773.497631:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622350720:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143773.499599:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.499628:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622350848 00000100:00100000:3.0:1746143773.499634:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622350848 00000100:00100000:3.0:1746143773.499682:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11416 00000100:00100000:3.0:1746143773.499689:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:31945:x1830963622350848:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143773.499704:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.499722:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a630 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.499749:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 17 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.499756:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a804a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a61b expref: 31 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.499762:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.499763:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.499766:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2347008->3145727] (req 2347008->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.499793:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a804a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a61b expref: 31 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.499802:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a804a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a61b expref: 31 pid: 3135 timeout: 932 lvb_type: 1 00000100:00100000:3.0:1746143773.499813:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626682624:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.499883:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 17 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.499891:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 17 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.499898:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626682752:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.500288:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.507635:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.508427:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622350976 00000100:00100000:2.0:1746143773.508439:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622350976 00010000:00010000:2.0:1746143773.508481:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 18 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.508719:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5329 00000100:00100000:2.0:1746143773.508730:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622350976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.508745:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.508768:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 18 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.508781:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 18 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.508806:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73a7f9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5a4 expref: 18 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.508837:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.508840:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.508847:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.508856:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.508894:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.508909:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626682880:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.509035:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143773.510247:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622350592:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12632us (13148us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143773.510261:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3202 00002000:00100000:1.0:1746143773.510271:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095cb6a00 x1830963622350592/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.510280:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6a00 with x1830963622350592 ext(3145728->4194303) 00010000:00010000:1.0:1746143773.510289:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 16 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.510299:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 16 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746143773.510306:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cb6a00 00000100:00100000:3.0:1746143773.512049:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626682624:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143773.512196:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.512224:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.512283:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622351232 00000100:00100000:0.0:1746143773.512289:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622351232 00000100:00100000:2.0:1746143773.512315:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622351104 00010000:00010000:0.0:1746143773.512316:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a804a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a61b expref: 32 pid: 3135 timeout: 932 lvb_type: 1 00000100:00100000:2.0:1746143773.512319:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622351104 00000100:00100000:0.0:1746143773.512341:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5330 00000100:00100000:2.0:1746143773.512344:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11417 00000100:00100000:0.0:1746143773.512348:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963622351232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143773.512350:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:31953:x1830963622351104:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143773.512361:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.512365:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.512379:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a637 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.512381:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a804a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a61b expref: 32 pid: 3135 timeout: 932 lvb_type: 1 00010000:00010000:2.0:1746143773.512404:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.512412:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f40 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a56c expref: 32 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.512423:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.512424:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.512427:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [233472->270335] (req 233472->270335) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 17 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.512454:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a56c expref: 32 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.512464:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a56c expref: 32 pid: 12327 timeout: 932 lvb_type: 1 00000100:00100000:2.0:1746143773.512476:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626683008:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.512546:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.512554:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 17 pid: 9587 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.512562:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626683136:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.512581:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4480 going to sleep for 11 seconds 00010000:00010000:0.0:1746143773.512637:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a804a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a61b expref: 32 pid: 3135 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143773.512656:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73a804a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a61b expref: 32 pid: 3135 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143773.512672:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143773.512726:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622351232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 344us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143773.512732:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5330 00000100:00100000:2.0:1746143773.513621:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626682880:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.513636:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.513660:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622350976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4931us (6037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.513666:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5329 00000100:00100000:1.0:1746143773.513809:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622350720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16178us (16661us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143773.513818:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3203 00002000:00100000:1.0:1746143773.513827:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095cb7480 x1830963622350720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.513835:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7480 with x1830963622350720 ext(2097152->4194303) 00002000:00010000:1.0:1746143773.513840:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb7480 00000100:00100000:3.0:1746143773.513900:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626682752:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.513938:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2347008->3145727] (req 2347008->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.513948:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fa00, rc 0) 00000100:00100000:3.0:1746143773.513975:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:31945:x1830963622350848:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 14287us (14383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.513981:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11416 00000100:00100000:2.0:1746143773.516272:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626683008:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.516578:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626683136:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.516606:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [233472->270335] (req 233472->270335) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 17 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.516622:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7c600, rc 0) 00000100:00100000:2.0:1746143773.516667:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:31953:x1830963622351104:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4316us (4470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.516674:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11417 00000100:00100000:0.0:1746143773.517429:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.517479:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622351360 00000100:00100000:2.0:1746143773.517487:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622351360 00010000:00010000:2.0:1746143773.517512:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 17 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.517543:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5331 00000100:00100000:2.0:1746143773.517550:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622351360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.517565:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.517585:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 17 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.517594:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 17 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.517616:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a8012 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ff expref: 17 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.517636:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.517638:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.517645:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.517653:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.517681:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.517691:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626683264:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.517752:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.518022:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.518259:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622351744 00000100:00100000:1.0:1746143773.518263:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622351744 00002000:00100000:1.0:1746143773.518295:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095cb7100 x1830963622351744/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.518311:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7100 with x1830963622351744 ext(1048576->2097151) 00002000:00010000:1.0:1746143773.518316:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb7100 00000100:00100000:1.0:1746143773.518332:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3204 00000100:00100000:1.0:1746143773.518338:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622351744:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143773.518604:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.518665:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.518683:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622351616 00000100:00100000:0.0:1746143773.518685:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622351616 00010000:00010000:0.0:1746143773.518702:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 17 pid: 9587 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746143773.518720:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622351872 00000100:00100000:0.0:1746143773.518722:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622351872 00010000:00010000:0.0:1746143773.518731:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a56c expref: 30 pid: 12327 timeout: 932 lvb_type: 1 00000100:00100000:0.0:1746143773.518755:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5332 00000100:00100000:0.0:1746143773.518761:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622351616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143773.519049:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5333 00000100:00100000:3.0:1746143773.519058:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622351872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.519067:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.519082:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a56c expref: 30 pid: 12327 timeout: 932 lvb_type: 1 00010000:00010000:3.0:1746143773.519091:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a56c expref: 30 pid: 12327 timeout: 932 lvb_type: 1 00010000:00010000:3.0:1746143773.519112:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551c00/0x87925e4cb73a7f40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a56c expref: 30 pid: 12327 timeout: 932 lvb_type: 1 00010000:00010000:3.0:1746143773.519130:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.519165:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622351872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.519171:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5333 00010000:00010000:0.0:1746143773.519508:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143773.519519:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 17 pid: 9587 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143773.519528:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 17 pid: 9587 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143773.519538:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a7f16 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a557 expref: 17 pid: 9587 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143773.519565:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143773.519566:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143773.519572:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 16 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.519579:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 16 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.519611:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 16 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.519622:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092a50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626683392:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143773.519671:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.519712:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.519888:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626683264:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.519904:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.519937:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622351360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2387us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.519943:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5331 00000100:00100000:2.0:1746143773.520006:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622352000 00000100:00100000:2.0:1746143773.520011:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622352000 00000100:00100000:2.0:1746143773.520032:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11418 00000100:00100000:2.0:1746143773.520038:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:31948:x1830963622352000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.520050:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.520062:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a63e expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.520084:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.520089:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143773.520091:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143773.520093:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 17 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.520111:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.520121:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 28 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.520130:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626683520:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.520161:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.521747:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.521972:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622352256 00000100:00100000:3.0:1746143773.521979:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622352256 00002000:00100000:3.0:1746143773.522016:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2347008->2351103) req@ffff880091bddc00 x1830963622352256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.522025:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddc00 with x1830963622352256 ext(2347008->2351103) 00010000:00010000:3.0:1746143773.522033:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.522044:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143773.522050:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bddc00 00000100:00100000:3.0:1746143773.522066:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1363 00000100:00100000:3.0:1746143773.522071:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622352256:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143773.522324:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092a50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626683392:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143773.522337:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143773.522356:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622351616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3596us (3753us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143773.522365:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5332 00000100:00100000:3.0:1746143773.522530:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622352256:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 111us (1271us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143773.522536:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1363 00002000:00100000:3.0:1746143773.522542:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2347008->2351103) req@ffff880091bddc00 x1830963622352256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.522548:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddc00 with x1830963622352256 ext(2347008->2351103) 00010000:00010000:3.0:1746143773.522553:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.522562:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 29 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143773.522567:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bddc00 00000100:00100000:2.0:1746143773.522621:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626683520:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.522639:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 16 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.522652:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db03200, rc 0) 00000100:00100000:2.0:1746143773.522671:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:31948:x1830963622352000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2634us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.522678:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11418 00000100:00100000:0.0:1746143773.523859:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.523903:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622352512 00000100:00100000:3.0:1746143773.523909:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622352512 00002000:00100000:3.0:1746143773.523970:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (233472->237567) req@ffff880092a50380 x1830963622352512/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.523978:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a50380 with x1830963622352512 ext(233472->237567) 00002000:00010000:3.0:1746143773.523982:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a50380 00000100:00100000:3.0:1746143773.523996:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3205 00000100:00100000:3.0:1746143773.524002:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622352512:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143773.524098:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622352512:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 96us (243us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143773.524104:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3205 00002000:00100000:3.0:1746143773.524108:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (233472->237567) req@ffff880092a50380 x1830963622352512/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.524114:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a50380 with x1830963622352512 ext(233472->237567) 00002000:00010000:3.0:1746143773.524117:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a50380 00000100:00100000:1.0:1746143773.525196:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622351744:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 6855us (7171us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143773.525203:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3204 00002000:00100000:1.0:1746143773.525210:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095cb7100 x1830963622351744/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.525218:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7100 with x1830963622351744 ext(1048576->2097151) 00002000:00010000:1.0:1746143773.525222:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb7100 00000100:00100000:1.0:1746143773.527164:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.527272:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622352768 00000100:00100000:0.0:1746143773.527281:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622352768 00002000:00100000:0.0:1746143773.527318:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (266240->270335) req@ffff880082ed6d80 x1830963622352768/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143773.527327:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed6d80 with x1830963622352768 ext(266240->270335) 00002000:00010000:0.0:1746143773.527331:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed6d80 00000100:00100000:0.0:1746143773.527358:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3206 00000100:00100000:0.0:1746143773.527365:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622352768:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143773.527440:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.527459:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622352896 00000100:00100000:3.0:1746143773.527463:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622352896 00000100:00100000:0.0:1746143773.527481:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622352768:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 116us (323us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143773.527487:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3206 00000100:00100000:3.0:1746143773.527489:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11419 00002000:00100000:0.0:1746143773.527492:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (266240->270335) req@ffff880082ed6d80 x1830963622352768/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143773.527494:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:31951:x1830963622352896:12345-192.168.202.3@tcp:101:cat.0 00002000:00100000:0.0:1746143773.527499:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed6d80 with x1830963622352768 ext(266240->270335) 00002000:00010000:0.0:1746143773.527502:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed6d80 00010000:00010000:3.0:1746143773.527504:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.527521:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a645 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.527544:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.527550:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.527552:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.527555:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.527581:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.527589:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 15 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.527599:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626683648:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.527670:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.529545:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.529631:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622353024 00000100:00100000:1.0:1746143773.529637:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622353024 00000100:00100000:3.0:1746143773.529645:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626683648:192.168.202.3@tcp:104: 00002000:00100000:1.0:1746143773.529674:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1277951) req@ffff880092a53b80 x1830963622353024/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746143773.529675:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143773.529687:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a53b80 with x1830963622353024 ext(1048576->1277951) 00010000:00010000:3.0:1746143773.529695:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84e00, rc 0) 00010000:00010000:1.0:1746143773.529695:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 16 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.529705:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 16 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746143773.529711:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a53b80 00000100:00100000:3.0:1746143773.529739:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:31951:x1830963622352896:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2244us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.529742:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1364 00000100:00100000:1.0:1746143773.529748:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622353024:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143773.529750:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11419 00000100:00100000:1.0:1746143773.533321:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622353024:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3547us (3755us total) trans 21474840240 rc 0/0 00000100:00100000:1.0:1746143773.533334:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1364 00002000:00100000:1.0:1746143773.533356:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1277951) req@ffff880092a53b80 x1830963622353024/t21474840240(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.533365:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a53b80 with x1830963622353024 ext(1048576->1277951) 00010000:00010000:1.0:1746143773.533383:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 18 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.533438:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 18 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746143773.533462:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a53b80 00000100:00100000:0.0:1746143773.535363:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.535472:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622353280 00000100:00100000:1.0:1746143773.535482:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622353280 00000100:00100000:0.0:1746143773.535750:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:1.0:1746143773.536058:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2347008->3145727) req@ffff880092a50e00 x1830963622353280/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.536068:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a50e00 with x1830963622353280 ext(2347008->3145727) 00010000:00010000:1.0:1746143773.536076:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.536088:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 30 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746143773.536100:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a50e00 00000100:00100000:3.0:1746143773.536129:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622353408 00000100:00100000:1.0:1746143773.536131:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1365 00000100:00100000:3.0:1746143773.536134:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622353408 00000100:00100000:1.0:1746143773.536139:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622353280:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143773.536162:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11420 00000100:00100000:3.0:1746143773.536167:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:31945:x1830963622353408:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143773.536177:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.536192:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a64c expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.536216:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.536223:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.536225:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.536229:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.536258:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.536268:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 14 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.536286:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626683776:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.536346:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.540117:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.540932:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622353536 00000100:00100000:1.0:1746143773.540941:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622353536 00000100:00100000:3.0:1746143773.540967:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626683776:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143773.540988:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 18 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.541001:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.541016:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5334 00010000:00010000:3.0:1746143773.541018:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84800, rc 0) 00000100:00100000:1.0:1746143773.541024:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622353536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.541039:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.541063:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 18 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.541065:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:31945:x1830963622353408:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4897us (5314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.541073:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11420 00010000:00010000:1.0:1746143773.541073:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 18 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.541094:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a7fa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1277951) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a5ab expref: 18 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.541374:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.541376:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.541384:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.541396:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.541405:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143773.541426:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.541437:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626683904:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143773.541491:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143773.541613:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622353664 00000100:00100000:1.0:1746143773.541616:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622353664 00010000:00010000:1.0:1746143773.541629:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 15 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.541853:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5335 00000100:00100000:3.0:1746143773.541885:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622353664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.541895:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.541909:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 15 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.541940:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 15 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.541954:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73a8051 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a622 expref: 15 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.541986:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.541988:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.541992:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.541998:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.542016:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.542024:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626684032:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143773.542058:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.543199:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622353280:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7056us (7838us total) trans 21474840241 rc 0/0 00000100:00100000:0.0:1746143773.543212:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1365 00002000:00100000:0.0:1746143773.543222:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2347008->3145727) req@ffff880092a50e00 x1830963622353280/t21474840241(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143773.543231:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a50e00 with x1830963622353280 ext(2347008->3145727) 00010000:00010000:0.0:1746143773.543238:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 32 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143773.543249:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 32 pid: 3135 timeout: 932 lvb_type: 0 00002000:00010000:0.0:1746143773.543256:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092a50e00 00000100:00100000:2.0:1746143773.545226:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626683904:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.545250:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143773.545546:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.545559:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622353536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4533us (5450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.545568:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5334 00000100:00100000:3.0:1746143773.545796:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626684032:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143773.545802:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143773.545812:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.545836:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622353664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3951us (4431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.545843:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5335 00000100:00100000:3.0:1746143773.545856:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622354048 00000100:00100000:3.0:1746143773.545862:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622354048 00000100:00100000:0.0:1746143773.545864:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622353920 00000100:00100000:0.0:1746143773.545868:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622353920 00010000:00010000:3.0:1746143773.545885:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 33 pid: 3135 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.545927:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5336 00000100:00100000:3.0:1746143773.545933:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622354048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.545944:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.545973:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 33 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.545998:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 33 pid: 3135 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.546022:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73a805f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a630 expref: 33 pid: 3135 timeout: 932 lvb_type: 0 00002000:00100000:0.0:1746143773.546022:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880082ed6300 x1830963622353920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143773.546032:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed6300 with x1830963622353920 ext(1048576->2097151) 00002000:00010000:0.0:1746143773.546036:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed6300 00010000:00010000:3.0:1746143773.546040:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.546042:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.546049:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 16 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.546058:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 16 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.546061:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3207 00000100:00100000:0.0:1746143773.546067:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963622353920:12345-192.168.202.3@tcp:3:multiop.0 00010000:00010000:3.0:1746143773.546088:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 16 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.546102:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626684160:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143773.546154:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.547547:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.547745:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622354304 00000100:00100000:3.0:1746143773.547751:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622354304 00002000:00100000:3.0:1746143773.547786:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2134016->2138111) req@ffff880091bddf80 x1830963622354304/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.547794:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddf80 with x1830963622354304 ext(2134016->2138111) 00002000:00010000:3.0:1746143773.547798:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bddf80 00000100:00100000:3.0:1746143773.547815:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3208 00000100:00100000:3.0:1746143773.547821:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622354304:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143773.547908:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622354304:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 86us (365us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143773.547935:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3208 00002000:00100000:3.0:1746143773.547941:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2134016->2138111) req@ffff880091bddf80 x1830963622354304/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.547947:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddf80 with x1830963622354304 ext(2134016->2138111) 00002000:00010000:3.0:1746143773.547950:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bddf80 00000100:00100000:3.0:1746143773.549816:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626684160:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143773.549841:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.549987:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622354048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4052us (4182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.549997:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5336 00000100:00100000:0.0:1746143773.550426:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.550497:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622354560 00000100:00100000:2.0:1746143773.550505:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622354560 00002000:00100000:2.0:1746143773.550543:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092a53100 x1830963622354560/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.550552:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a53100 with x1830963622354560 ext(3145728->4194303) 00002000:00010000:2.0:1746143773.550557:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a53100 00000100:00100000:2.0:1746143773.550585:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3209 00000100:00100000:2.0:1746143773.550593:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622354560:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143773.554994:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622353920:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8915us (9436us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143773.555008:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3207 00002000:00100000:0.0:1746143773.555021:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880082ed6300 x1830963622353920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143773.555031:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed6300 with x1830963622353920 ext(1048576->2097151) 00002000:00010000:0.0:1746143773.555036:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed6300 00000100:00100000:0.0:1746143773.559195:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.559248:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622354560:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8653us (8821us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143773.559260:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3209 00002000:00100000:2.0:1746143773.559273:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092a53100 x1830963622354560/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.559283:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a53100 with x1830963622354560 ext(3145728->4194303) 00002000:00010000:2.0:1746143773.559289:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a53100 00000100:00100000:3.0:1746143773.559864:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622354688 00000100:00100000:3.0:1746143773.559873:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622354688 00000100:00100000:3.0:1746143773.559945:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11421 00000100:00100000:3.0:1746143773.559953:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:31951:x1830963622354688:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.559978:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.559996:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8082 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a653 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.560021:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.560023:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.560030:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8082 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a653 expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.560050:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8082 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a653 expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.560060:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467c00, rc 0) 00000100:00100000:3.0:1746143773.560110:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:31951:x1830963622354688:12345-192.168.202.3@tcp:101:cat.0 Request processed in 158us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.560116:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11421 00000100:00100000:0.0:1746143773.562648:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.562736:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622354816 00000100:00100000:3.0:1746143773.562746:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622354816 00000100:00100000:3.0:1746143773.563643:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11422 00000100:00100000:3.0:1746143773.563654:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:31948:x1830963622354816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.563674:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.563692:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a65a expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.563723:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.563730:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.563731:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.563735:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 15 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.563764:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.563781:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 31 pid: 1945 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.563794:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626684288:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.563969:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.566040:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.566114:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626684288:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.566133:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622354944 00000100:00100000:2.0:1746143773.566141:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622354944 00010000:00010000:3.0:1746143773.566147:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 15 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.566165:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467400, rc 0) 00002000:00100000:2.0:1746143773.566184:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2138111) req@ffff880092a51500 x1830963622354944/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.566193:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a51500 with x1830963622354944 ext(2097152->2138111) 00010000:00010000:2.0:1746143773.566200:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 32 pid: 1945 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.566201:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:31948:x1830963622354816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2549us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.566209:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11422 00010000:00010000:2.0:1746143773.566212:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 32 pid: 1945 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746143773.566218:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a51500 00000100:00100000:1.0:1746143773.566281:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1366 00000100:00100000:1.0:1746143773.566290:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963622354944:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143773.567320:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.567427:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.567533:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622355200 00000100:00100000:3.0:1746143773.567540:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622355200 00002000:00100000:3.0:1746143773.567568:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880092a50700 x1830963622355200/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.567577:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a50700 with x1830963622355200 ext(2097152->4194303) 00002000:00010000:3.0:1746143773.567581:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a50700 00000100:00100000:3.0:1746143773.567594:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622355456 00000100:00100000:3.0:1746143773.567596:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622355456 00002000:00100000:3.0:1746143773.567606:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2138112->4194303) req@ffff880092a52a00 x1830963622355456/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.567613:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a52a00 with x1830963622355456 ext(2138112->4194303) 00010000:00010000:3.0:1746143773.567620:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 34 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.567632:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 34 pid: 1945 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143773.567638:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a52a00 00000100:00100000:3.0:1746143773.567650:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1367 00000100:00100000:3.0:1746143773.567656:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622355456:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.567662:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3210 00000100:00100000:2.0:1746143773.567671:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622355200:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143773.569266:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622354944:12345-192.168.202.3@tcp:4:cat.0 Request processed in 2971us (3226us total) trans 17179872920 rc 0/0 00000100:00100000:1.0:1746143773.569277:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1366 00002000:00100000:1.0:1746143773.569287:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2138111) req@ffff880092a51500 x1830963622354944/t17179872920(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.569296:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a51500 with x1830963622354944 ext(2097152->2138111) 00010000:00010000:1.0:1746143773.569305:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 36 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.569319:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 36 pid: 1945 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746143773.569326:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a51500 00000100:00100000:3.0:1746143773.585077:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622355456:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17409us (17637us total) trans 0 rc 2056192/2056192 00000100:00100000:3.0:1746143773.585091:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1367 00002000:00100000:3.0:1746143773.585105:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2138112->4194303) req@ffff880092a52a00 x1830963622355456/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 2056192/2056192 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.585115:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a52a00 with x1830963622355456 ext(2138112->4194303) 00010000:00010000:3.0:1746143773.585125:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 34 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.585142:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 34 pid: 1945 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746143773.585149:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092a52a00 00000100:00100000:2.0:1746143773.586280:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622355200:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18605us (18956us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143773.586290:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3210 00002000:00100000:2.0:1746143773.586301:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880092a50700 x1830963622355200/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.586310:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a50700 with x1830963622355200 ext(2097152->4194303) 00002000:00010000:2.0:1746143773.586314:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a50700 00000100:00100000:0.0:1746143773.592258:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.592360:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622355584 00000100:00100000:3.0:1746143773.592371:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622355584 00000100:00100000:3.0:1746143773.592417:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11423 00000100:00100000:3.0:1746143773.592425:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:31951:x1830963622355584:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.592447:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.592465:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a661 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.592495:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.592498:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.592502:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.592515:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.592526:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467600, rc 0) 00000100:00100000:3.0:1746143773.592594:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:31951:x1830963622355584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 169us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.592601:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11423 00000100:00100000:0.0:1746143773.593174:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.593547:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622355712 00000100:00100000:3.0:1746143773.593553:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622355712 00010000:00010000:3.0:1746143773.593572:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 35 pid: 1945 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.593610:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5337 00000100:00100000:3.0:1746143773.593616:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622355712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.593626:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.593646:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 35 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.593660:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 35 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.593679:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73a807b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a64c expref: 35 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.593704:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.593706:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.593712:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 14 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.593719:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 14 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.593726:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.593727:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.593730:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 34 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.593737:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 34 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.593768:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 34 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.593779:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626684416:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143773.593868:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 14 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.593877:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626684544:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143773.593896:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.598526:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626684416:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143773.598540:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626684544:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143773.598565:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.598608:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622355712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4991us (5432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.598618:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5337 00000100:00100000:1.0:1746143773.600419:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.600760:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.600819:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622355968 00000100:00100000:3.0:1746143773.600828:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622355968 00000100:00100000:2.0:1746143773.600871:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622356224 00000100:00100000:2.0:1746143773.600876:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622356224 00002000:00100000:3.0:1746143773.600882:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880082ed4000 x1830963622355968/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.600892:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed4000 with x1830963622355968 ext(3145728->4194303) 00002000:00100000:2.0:1746143773.600894:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880082ed7b80 x1830963622356224/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746143773.600897:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed4000 00002000:00100000:2.0:1746143773.600902:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed7b80 with x1830963622356224 ext(2097152->4194303) 00002000:00010000:2.0:1746143773.600905:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed7b80 00000100:00100000:2.0:1746143773.600950:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3211 00000100:00100000:2.0:1746143773.600965:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622355968:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143773.600969:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3212 00000100:00100000:3.0:1746143773.600976:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622356224:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.615130:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622355968:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 14160us (14705us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143773.615144:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3211 00002000:00100000:2.0:1746143773.615157:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880082ed4000 x1830963622355968/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.615168:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed4000 with x1830963622355968 ext(3145728->4194303) 00002000:00010000:2.0:1746143773.615175:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed4000 00000100:00100000:3.0:1746143773.616447:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622356224:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15465us (15680us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143773.616458:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3212 00002000:00100000:3.0:1746143773.616466:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880082ed7b80 x1830963622356224/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.616482:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed7b80 with x1830963622356224 ext(2097152->4194303) 00002000:00010000:3.0:1746143773.616486:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed7b80 00000100:00100000:0.0:1746143773.622889:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.622994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.623132:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622356480 00000100:00100000:3.0:1746143773.623138:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622356352 00000100:00100000:3.0:1746143773.623142:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622356352 00000100:00100000:2.0:1746143773.623142:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622356480 00000100:00100000:3.0:1746143773.623303:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11424 00000100:00100000:3.0:1746143773.623314:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622356352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.623335:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143773.623347:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11425 00010000:00010000:3.0:1746143773.623354:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8097 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a668 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.623355:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622356480:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.623362:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.623373:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a809e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a66f expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.623381:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.623383:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.623386:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.623387:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.623392:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8097 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a668 expref: 16 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.623392:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a809e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a66f expref: 18 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.623406:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8097 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a668 expref: 16 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.623406:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a809e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a66f expref: 18 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.623415:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466200, rc 0) 00010000:00010000:2.0:1746143773.623415:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3dc00, rc 0) 00000100:00100000:3.0:1746143773.623535:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622356352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 222us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.623542:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11424 00000100:00100000:2.0:1746143773.623659:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622356480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 305us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.623665:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11425 00000100:00100000:0.0:1746143773.627018:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.627189:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622356608 00000100:00100000:2.0:1746143773.627200:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622356608 00000100:00100000:2.0:1746143773.627454:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11426 00000100:00100000:2.0:1746143773.627464:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622356608:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.627485:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.627505:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a80a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a676 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.627564:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626684672:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143773.628053:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b43c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746143773.629967:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime: 1746143773 -> 1746143774 00000100:00100000:2.0:1746143773.629995:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626684672:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143773.630031:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a80a5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a676 expref: 33 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.630046:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a80a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a676 expref: 33 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.630063:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3d400, rc 0) 00000100:00100000:2.0:1746143773.630547:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622356608:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3080us (3537us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143773.630556:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11426 00000100:00100000:0.0:1746143773.631629:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.631756:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622356864 00000100:00100000:3.0:1746143773.631766:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622356864 00002000:00100000:3.0:1746143773.631812:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88012457e680 x1830963622356864/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.631827:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457e680 with x1830963622356864 ext(4194304->4780031) 00002000:00010000:3.0:1746143773.631832:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457e680 00000100:00100000:3.0:1746143773.631851:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3213 00000100:00100000:3.0:1746143773.631858:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622356864:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143773.641744:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.642170:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622357120 00000100:00100000:2.0:1746143773.642183:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622357120 00002000:00100000:2.0:1746143773.642232:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88012457c000 x1830963622357120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.642242:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c000 with x1830963622357120 ext(4194304->4780031) 00002000:00010000:2.0:1746143773.642247:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457c000 00000100:00100000:2.0:1746143773.642537:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3214 00000100:00100000:2.0:1746143773.642547:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622357120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143773.644459:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622356864:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12592us (12827us total) trans 0 rc 585728/585728 00000100:00100000:3.0:1746143773.644470:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3213 00002000:00100000:3.0:1746143773.644482:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88012457e680 x1830963622356864/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.644490:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457e680 with x1830963622356864 ext(4194304->4780031) 00002000:00010000:3.0:1746143773.644496:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457e680 00000100:00100000:2.0:1746143773.648563:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622357120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6005us (6818us total) trans 0 rc 585728/585728 00000100:00100000:2.0:1746143773.648577:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3214 00002000:00100000:2.0:1746143773.648590:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88012457c000 x1830963622357120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.648599:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c000 with x1830963622357120 ext(4194304->4780031) 00002000:00010000:2.0:1746143773.648606:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457c000 00000100:00100000:0.0:1746143773.656172:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.656367:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622357248 00000100:00100000:2.0:1746143773.656378:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622357248 00000100:00100000:2.0:1746143773.656442:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11427 00000100:00100000:2.0:1746143773.656452:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963622357248:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.656474:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.656493:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a80ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a67d expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.656555:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626684800:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143773.656659:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.659782:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.659990:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622357376 00000100:00100000:1.0:1746143773.659998:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622357376 00000100:00100000:2.0:1746143773.660062:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626684800:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143773.660099:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a80ac lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a67d expref: 33 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.660113:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a80ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a67d expref: 33 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.660136:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3d400, rc 0) 00000100:00100000:2.0:1746143773.660183:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963622357248:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3733us (4021us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143773.660191:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11427 00000100:00100000:1.0:1746143773.660835:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11428 00000100:00100000:1.0:1746143773.660843:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:31957:x1830963622357376:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143773.660862:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.660877:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a684 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.660908:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.660949:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8082 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a653 expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.660963:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.660965:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.660968:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 19 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.661004:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8082 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a653 expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.661018:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8082 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a653 expref: 31 pid: 1945 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.661035:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626684928:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143773.661112:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.661120:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 19 pid: 1945 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.661128:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626685056:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143773.661157:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.666078:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.666189:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626684928:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143773.666202:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626685056:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143773.666235:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 19 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.666255:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c528400, rc 0) 00000100:00100000:1.0:1746143773.666302:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31957:x1830963622357376:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5460us (6529us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.666312:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11428 00000100:00100000:2.0:1746143773.666318:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622357504 00000100:00100000:2.0:1746143773.666326:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622357504 00000100:00100000:2.0:1746143773.666364:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11429 00000100:00100000:2.0:1746143773.666371:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:31951:x1830963622357504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.666388:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.666406:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a80ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a68b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.666426:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.666428:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.666436:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a80ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a68b expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.666885:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a80ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3342336->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a68b expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.666895:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ecd800, rc 0) 00000100:00100000:2.0:1746143773.666945:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:31951:x1830963622357504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 574us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.666951:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11429 00000100:00100000:1.0:1746143773.669180:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.669219:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.669260:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.669288:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622357760 00000100:00100000:2.0:1746143773.669297:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622357760 00000100:00100000:3.0:1746143773.669303:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622357632 00000100:00100000:3.0:1746143773.669308:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622357632 00000100:00100000:2.0:1746143773.669331:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622357888 00000100:00100000:2.0:1746143773.669333:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622357888 00010000:00010000:3.0:1746143773.669334:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 19 pid: 1945 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.669352:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11430 00000100:00100000:3.0:1746143773.669364:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5338 00000100:00100000:3.0:1746143773.669372:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622357632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143773.669376:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622357760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.669384:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.669392:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.669404:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 19 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.669406:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a80c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a692 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.669416:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 19 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.669436:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db03200/0x87925e4cb73a806d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a63e expref: 19 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.669454:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.669457:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626685184:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143773.669490:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622357632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 119us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.669497:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5338 00000100:00100000:2.0:1746143773.669512:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.669528:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11431 00000100:00100000:0.0:1746143773.669536:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622357888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143773.669543:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143773.669550:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a80c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a699 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.669561:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143773.669567:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a80c8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a699 expref: 36 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143773.669581:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a80c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a699 expref: 36 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143773.669592:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7dc00, rc 0) 00000100:00100000:0.0:1746143773.669611:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622357888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 77us (350us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143773.669616:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11431 00000100:00100000:0.0:1746143773.670852:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.670966:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622358016 00000100:00100000:3.0:1746143773.670971:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622358016 00010000:00010000:3.0:1746143773.670991:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8082 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a653 expref: 35 pid: 1945 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746143773.671017:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5339 00000100:00100000:3.0:1746143773.671022:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622358016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.671031:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.671043:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8082 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a653 expref: 35 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.671054:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8082 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a653 expref: 35 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.671072:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8082 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a653 expref: 35 pid: 1945 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746143773.671085:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.671088:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.671095:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.671102:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.671129:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.671140:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626685312:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143773.671417:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.672283:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626685184:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143773.672309:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a80c1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a692 expref: 34 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.672319:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a80c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a692 expref: 34 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.672327:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3ce00, rc 0) 00000100:00100000:3.0:1746143773.673657:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622357760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4287us (4427us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143773.673667:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11430 00000100:00100000:3.0:1746143773.675481:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626685312:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143773.675504:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.675548:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622358016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4524us (4697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.675562:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5339 00000100:00100000:0.0:1746143773.676205:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.676242:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.676326:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622358272 00000100:00100000:2.0:1746143773.676334:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622358272 00002000:00100000:2.0:1746143773.676381:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3174400->3178495) req@ffff88012457ce00 x1830963622358272/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.676389:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ce00 with x1830963622358272 ext(3174400->3178495) 00002000:00010000:2.0:1746143773.676394:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457ce00 00000100:00100000:0.0:1746143773.676672:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.676778:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622358784 00000100:00100000:2.0:1746143773.676782:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622358784 00000100:00100000:2.0:1746143773.676822:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12773 00000100:00100000:2.0:1746143773.676830:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+295:31960:x1830963622358784:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143773.676850:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.676868:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73a80cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6a0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.676974:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.676987:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.676998:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677011:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73a80dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677016:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73a80dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677020:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73a80dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677115:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a80e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677124:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a80e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677129:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a80e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143773.677137:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:3.0:1746143773.677179:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622358528 00000100:00100000:3.0:1746143773.677182:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622358528 00002000:00100000:3.0:1746143773.677200:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4775936->4780031) req@ffff88012457ed80 x1830963622358528/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.677206:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ed80 with x1830963622358528 ext(4775936->4780031) 00002000:00010000:3.0:1746143773.677209:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457ed80 00010000:00010000:2.0:1746143773.677211:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677216:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677225:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143773.677227:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3215 00010000:00010000:2.0:1746143773.677232:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143773.677233:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622358272:12345-192.168.202.3@tcp:3:multiop.0 00010000:00010000:2.0:1746143773.677237:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090fc2c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.677241:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677248:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143773.677253:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3216 00010000:00010000:2.0:1746143773.677258:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143773.677260:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746143773.677262:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622358528:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143773.677263:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677478:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a80d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677953:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73a80dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677967:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73a80dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677971:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73a80dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677975:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090fc2600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.677977:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73a80dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677985:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73a80dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.677991:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d700) 00010000:00010000:2.0:1746143773.677993:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.677995:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73a80dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.678000:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73a80dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.678032:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73a80cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a0 expref: 298 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.678066:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622358272:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 832us (1861us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143773.678069:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622358528:12345-192.168.202.3@tcp:3:cat.0 Request processed in 808us (1825us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143773.678073:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3215 00000100:00100000:1.0:1746143773.678076:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3216 00002000:00100000:3.0:1746143773.678079:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (3174400->3178495) req@ffff88012457ce00 x1830963622358272/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.678081:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4775936->4780031) req@ffff88012457ed80 x1830963622358528/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.678086:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ce00 with x1830963622358272 ext(3174400->3178495) 00002000:00010000:3.0:1746143773.678088:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457ce00 00002000:00100000:1.0:1746143773.678089:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ed80 with x1830963622358528 ext(4775936->4780031) 00002000:00010000:1.0:1746143773.678092:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457ed80 00010000:00010000:2.0:1746143773.678142:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a80e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a0 expref: 297 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.678150:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.678152:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143773.678154:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3600, rc 0) 00000100:00100000:2.0:1746143773.678173:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+297:31960:x1830963622358784:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1344us (1501us total) trans 8589943496 rc 0/0 00000100:00100000:2.0:1746143773.678178:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12773 00000100:00100000:0.0:1746143773.681446:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.681672:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622359040 00000100:00100000:2.0:1746143773.681682:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622359040 00002000:00100000:2.0:1746143773.681723:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3338240->3342335) req@ffff88012457c700 x1830963622359040/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.681732:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c700 with x1830963622359040 ext(3338240->3342335) 00002000:00010000:2.0:1746143773.681738:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457c700 00000100:00100000:2.0:1746143773.681759:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3217 00000100:00100000:2.0:1746143773.681767:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622359040:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143773.681904:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622359040:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 137us (467us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143773.681909:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3217 00002000:00100000:2.0:1746143773.681930:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3338240->3342335) req@ffff88012457c700 x1830963622359040/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.681937:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c700 with x1830963622359040 ext(3338240->3342335) 00002000:00010000:2.0:1746143773.681940:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457c700 00000100:00100000:1.0:1746143773.682012:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.682079:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.682139:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.682203:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622359296 00000100:00100000:3.0:1746143773.682207:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622359296 00000100:00100000:3.0:1746143773.682229:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622359680 00000100:00100000:3.0:1746143773.682230:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622359680 00000100:00100000:3.0:1746143773.682239:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4650 00000100:00100000:3.0:1746143773.682247:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+298:31951:x1830963622359296:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143773.682395:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+299:31951:x1830963622359296:12345-192.168.202.3@tcp:35:cat.0 Request processed in 151us (382us total) trans 8589943497 rc 0/0 00000100:00100000:3.0:1746143773.682403:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4650 00000100:00100000:3.0:1746143773.682413:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4651 00000100:00100000:3.0:1746143773.682417:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+298:31960:x1830963622359680:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143773.682463:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+299:31960:x1830963622359680:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 45us (383us total) trans 8589943498 rc 0/0 00000100:00100000:3.0:1746143773.682468:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4651 00000100:00100000:3.0:1746143773.682481:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622359424 00000100:00100000:3.0:1746143773.682483:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622359424 00000100:00100000:3.0:1746143773.682501:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 734 00000100:00100000:3.0:1746143773.682506:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+299:2009:x1830963622359424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.682515:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.682539:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a80e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a0 expref: 299 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.682552:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143773.682557:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.682569:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+298:2009:x1830963622359424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 63us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.682574:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 734 00000100:00100000:0.0:1746143773.745070:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.745225:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622359808 00000100:00100000:2.0:1746143773.745235:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622359808 00000100:00100000:2.0:1746143773.745295:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12774 00000100:00100000:2.0:1746143773.745305:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:31963:x1830963622359808:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143773.745362:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.745383:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fa00/0x87925e4cb73a80f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6a7 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.745453:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.745467:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.745479:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.745492:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a8100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.745498:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a8100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.745503:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a8100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.745575:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.745586:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a565 expref: 297 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.745594:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a59d expref: 39 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.745600:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.745632:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a59d expref: 39 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.745644:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a59d expref: 39 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.745656:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626685440:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.749210:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a565 expref: 297 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.749228:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a565 expref: 297 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.749249:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626685568:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.749309:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.754397:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.754521:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626685440:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.754533:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626685568:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.754562:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143773.754638:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622360064 00000100:00100000:3.0:1746143773.754646:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622360064 00000100:00100000:3.0:1746143773.754706:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4652 00000100:00100000:3.0:1746143773.754714:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+40:16365:x1830963622360064:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143773.754997:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+41:16365:x1830963622360064:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 283us (610us total) trans 8589943499 rc 0/0 00000100:00100000:3.0:1746143773.755003:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4652 00000100:00100000:0.0:1746143773.756696:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.761191:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622360192 00000100:00100000:2.0:1746143773.761207:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622360192 00010000:00010000:2.0:1746143773.761254:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a565 expref: 298 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.761285:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5340 00000100:00100000:2.0:1746143773.761292:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+298:2008:x1830963622360192:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.761306:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.761311:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a565 expref: 298 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746143773.761312:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143773.761321:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a565 expref: 298 pid: 7245 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.761344:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a7f5c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a565 expref: 298 pid: 7245 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746143773.761366:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.761370:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761379:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761383:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761388:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.761432:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+297:2008:x1830963622360192:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 140us (4741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.761438:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5340 00000100:00100000:1.0:1746143773.761444:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622360320 00000100:00100000:1.0:1746143773.761448:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622360320 00010000:00010000:1.0:1746143773.761463:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a59d expref: 41 pid: 7245 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.761485:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5341 00000100:00100000:1.0:1746143773.761489:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+41:2008:x1830963622360320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.761496:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.761499:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a59d expref: 41 pid: 7245 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.761507:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a59d expref: 41 pid: 7245 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.761522:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73a7f8d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a59d expref: 41 pid: 7245 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.761535:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143773.761538:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.761544:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.761551:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.761571:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143773.761579:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761586:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143773.761588:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+40:2008:x1830963622360320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.761593:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5341 00000004:00200000:2.0:1746143773.761640:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:2.0:1746143773.761645:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143773.761727:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761738:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761749:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761755:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761760:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761770:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761775:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ee00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.761778:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761785:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761794:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143773.761796:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.761800:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761804:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a80f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761813:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a8100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761818:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a8100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761822:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a8100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761826:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408fc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143773.761828:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a8100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761833:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a8100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761842:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9df00) 00010000:00010000:2.0:1746143773.761844:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.761846:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a8100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761851:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73a8100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.761881:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fa00/0x87925e4cb73a80f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a7 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.761892:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a7 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.761897:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.761899:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143773.761901:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408fe00, rc 0) 00000100:00100000:2.0:1746143773.761967:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:31963:x1830963622359808:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 16650us (16897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.761973:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12774 00000100:00100000:2.0:1746143773.764346:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.764383:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.764410:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.764432:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622360448 00000100:00100000:2.0:1746143773.764440:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622360448 00000100:00100000:2.0:1746143773.766048:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622360576 00000100:00100000:2.0:1746143773.766055:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622360576 00000100:00100000:0.0:1746143773.766123:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622360704 00000100:00100000:0.0:1746143773.766127:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622360704 00000100:00100000:0.0:1746143773.766156:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11432 00000100:00100000:0.0:1746143773.766165:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2011:x1830963622360448:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143773.766184:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143773.766203:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d800/0x87925e4cb73a810e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6ae expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.766262:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626685696:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143773.766343:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143773.766440:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11433 00000100:00100000:1.0:1746143773.766449:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622360576:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143773.766456:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.766468:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a8115 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6b5 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.766482:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.766484:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.766493:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a8115 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6b5 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.766511:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a8115 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6b5 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.766521:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c529c00, rc 0) 00000100:00100000:1.0:1746143773.766546:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622360576:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 99us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.766552:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11433 00000100:00100000:1.0:1746143773.766569:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11434 00000100:00100000:1.0:1746143773.766574:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622360704:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143773.766580:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.766587:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a811c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6bc expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.766601:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.766602:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.766607:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a811c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6bc expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.766617:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a811c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6bc expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.766623:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c528000, rc 0) 00000100:00100000:3.0:1746143773.766675:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.766695:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622360832 00000100:00100000:3.0:1746143773.766697:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622360832 00000100:00100000:3.0:1746143773.766714:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11435 00000100:00100000:3.0:1746143773.766719:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622360832:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143773.766725:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.766732:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a8123 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6c3 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.766781:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622360704:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 63us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.766787:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11434 00000100:00100000:1.0:1746143773.766834:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.766929:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622360960 00000100:00100000:2.0:1746143773.766933:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622360960 00010000:00010000:3.0:1746143773.767012:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a8123 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6c3 expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.767022:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a8123 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6c3 expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.767036:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:3.0:1746143773.767052:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622360832:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 333us (378us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143773.767058:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11435 00000100:00100000:3.0:1746143773.767069:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11436 00000100:00100000:3.0:1746143773.767074:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622360960:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143773.767081:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.767087:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a812a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6ca expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.767101:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.767103:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.767107:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a812a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ca expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.767116:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a812a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ca expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.767122:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466c00, rc 0) 00000100:00100000:3.0:1746143773.767136:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622360960:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 62us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.767141:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11436 00002000:00010000:2.0:1746143773.769996:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime: 1746143773 -> 1746143774 00002000:00010000:2.0:1746143773.770004:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime: 1746143773 -> 1746143774 00000100:00100000:2.0:1746143773.770029:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626685696:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143773.770062:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d800/0x87925e4cb73a810e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ae expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.770076:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d800/0x87925e4cb73a810e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ae expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.770087:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d800, rc 0) 00000100:00100000:2.0:1746143773.770147:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2011:x1830963622360448:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 3982us (5809us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143773.770155:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11432 00000100:00100000:0.0:1746143773.771691:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.771868:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622361216 00000100:00100000:2.0:1746143773.771875:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622361216 00000100:00100000:2.0:1746143773.771974:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12775 00000100:00100000:2.0:1746143773.771982:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:31963:x1830963622361216:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143773.772002:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.772020:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a8131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6d1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.772126:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a8138 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.772141:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a7 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.772148:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a8138 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.772181:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a7 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.772192:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a7 expref: 14 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746143773.772205:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626685824:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.772286:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.773973:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626685824:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.773997:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a8138 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143773.775747:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.775805:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622361344 00000100:00100000:1.0:1746143773.775812:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622361344 00010000:00010000:1.0:1746143773.775843:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a7 expref: 15 pid: 6587 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143773.775875:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5342 00000100:00100000:1.0:1746143773.775880:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622361344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.775890:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.775894:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a7 expref: 15 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.775903:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a7 expref: 15 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.775939:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73a8107 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6a7 expref: 15 pid: 6587 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143773.775964:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143773.775969:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a8138 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.775982:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a8138 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.775988:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a8138 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.776010:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143773.776048:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622361344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 167us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.776058:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5342 00010000:00010000:2.0:1746143773.776082:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a8138 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.776090:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a8138 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143773.776110:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143773.776235:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a8131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6d1 expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.776246:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a8138 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6d1 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.776252:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.776254:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143773.776256:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096fcf200, rc 0) 00000100:00100000:2.0:1746143773.776295:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:31963:x1830963622361216:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 4314us (4608us total) trans 8589943500 rc 0/0 00000100:00100000:2.0:1746143773.776301:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12775 00000100:00100000:2.0:1746143773.779472:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.779545:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622361600 00000100:00100000:0.0:1746143773.779555:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622361600 00000100:00100000:0.0:1746143773.779744:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12776 00000100:00100000:0.0:1746143773.779754:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:31963:x1830963622361600:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143773.780199:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.780203:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143773.780233:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a8138 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6d1 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.780249:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143773.780254:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143773.780267:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73a8146 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6d8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.780274:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.780304:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.780342:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622361728 00000100:00100000:0.0:1746143773.780346:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622361728 00000100:00100000:0.0:1746143773.780363:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622361856 00000100:00100000:0.0:1746143773.780364:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622361856 00000100:00100000:0.0:1746143773.780377:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11437 00010000:00010000:1.0:1746143773.780379:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a814d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143773.780382:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622361728:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143773.780389:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.780391:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a814d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.780400:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a814d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143773.780400:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73a8154 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6df expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.780410:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a814d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.780415:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a814d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143773.780418:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73a8154 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6df expref: 19 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.780421:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a814d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143773.780426:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73a8154 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6df expref: 19 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.780427:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c528e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143773.780430:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a814d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143773.780435:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d000, rc 0) 00010000:00010000:1.0:1746143773.780437:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a814d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.780442:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143773.780445:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143773.780447:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a814d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.780451:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73a814d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.780472:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73a8146 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6d8 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.780473:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622361728:12345-192.168.202.3@tcp:101:cat.0 Request processed in 90us (199us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143773.780478:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11437 00010000:00010000:1.0:1746143773.780479:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73a8146 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6d8 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.780486:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c529600, rc 0) 00000100:00100000:0.0:1746143773.780492:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11438 00000100:00100000:0.0:1746143773.780496:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:31960:x1830963622361856:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143773.780503:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143773.780504:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:31963:x1830963622361600:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 753us (1042us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143773.780509:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12776 00010000:00010000:0.0:1746143773.780512:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6e6 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.780526:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.780534:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73a7e2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4c4 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143773.780540:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7d8e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a462 expref: 35 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143773.780546:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143773.780547:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143773.780550:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.780575:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7d8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a462 expref: 35 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143773.780585:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7d8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a462 expref: 35 pid: 3135 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143773.780722:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626685952:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143773.780787:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73a7e2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4c4 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143773.780796:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73a7e2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4c4 expref: 9 pid: 3134 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143773.780804:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626686080:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143773.780828:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.780836:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 15 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143773.780842:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626686208:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143773.780858:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.782307:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626685952:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143773.782315:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626686080:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143773.782321:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626686208:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143773.782342:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.782356:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d600, rc 0) 00000100:00100000:0.0:1746143773.782382:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:31960:x1830963622361856:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1885us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143773.782393:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11438 00000100:00100000:0.0:1746143773.783212:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.783270:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.783452:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622361984 00000100:00100000:2.0:1746143773.783459:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622361984 00010000:00010000:2.0:1746143773.783490:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73a7e2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4c4 expref: 10 pid: 3134 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143773.783522:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622362112 00000100:00100000:2.0:1746143773.783525:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622362112 00010000:00010000:2.0:1746143773.783534:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7d8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a462 expref: 35 pid: 3135 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143773.783548:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5343 00000100:00100000:2.0:1746143773.783554:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622361984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.783566:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.783586:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73a7e2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4c4 expref: 10 pid: 3134 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143773.783595:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73a7e2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4c4 expref: 10 pid: 3134 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143773.783615:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73a7e2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a4c4 expref: 10 pid: 3134 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143773.783634:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.783658:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622361984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 104us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.783664:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5343 00000100:00100000:2.0:1746143773.783676:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5344 00000100:00100000:2.0:1746143773.783680:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622362112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.783686:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.783691:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7d8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a462 expref: 35 pid: 3135 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143773.783699:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7d8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a462 expref: 35 pid: 3135 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143773.783709:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a7d8e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a462 expref: 35 pid: 3135 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143773.783715:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.783728:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622362112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.783732:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5344 00000100:00100000:0.0:1746143773.783763:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.783807:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622362240 00000100:00100000:1.0:1746143773.783811:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622362240 00010000:00010000:1.0:1746143773.783827:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 16 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143773.783844:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5345 00000100:00100000:1.0:1746143773.783849:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622362240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.783859:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.783866:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 16 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143773.783875:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 16 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143773.783887:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084200/0x87925e4cb73a7d5d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a44d expref: 16 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143773.783897:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.783898:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.783905:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.783942:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.783983:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.784000:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626686336:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143773.784048:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.784193:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.784211:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622362496 00000100:00100000:0.0:1746143773.784214:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622362496 00002000:00100000:0.0:1746143773.784244:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092ef0380 x1830963622362496/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 504/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143773.784253:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0380 with x1830963622362496 ext(0->1048575) 00002000:00010000:0.0:1746143773.784257:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef0380 00000100:00100000:1.0:1746143773.784259:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.784272:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3218 00000100:00100000:1.0:1746143773.784277:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622362752 00000100:00100000:0.0:1746143773.784277:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622362496:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143773.784279:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622362752 00000100:00100000:1.0:1746143773.784327:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4653 00000100:00100000:1.0:1746143773.784333:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:31963:x1830963622362752:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143773.784477:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:31963:x1830963622362752:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 145us (218us total) trans 8589943501 rc 0/0 00000100:00100000:1.0:1746143773.784483:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4653 00000100:00100000:0.0:1746143773.787194:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.787323:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622363008 00000100:00100000:3.0:1746143773.787333:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622363008 00002000:00100000:3.0:1746143773.787378:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1662976->1667071) req@ffff880092ef3480 x1830963622363008/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.787389:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3480 with x1830963622363008 ext(1662976->1667071) 00002000:00010000:3.0:1746143773.787394:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef3480 00000100:00100000:3.0:1746143773.787554:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3219 00000100:00100000:3.0:1746143773.787563:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622363008:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143773.787974:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626686336:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143773.787996:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.788239:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622363008:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 676us (1052us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143773.788239:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622362240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4388us (4473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.788246:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3219 00000100:00100000:1.0:1746143773.788248:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5345 00002000:00100000:3.0:1746143773.788252:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1662976->1667071) req@ffff880092ef3480 x1830963622363008/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.788261:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3480 with x1830963622363008 ext(1662976->1667071) 00002000:00010000:3.0:1746143773.788264:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef3480 00000100:00100000:2.0:1746143773.793135:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622362496:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8845us (8930us total) trans 0 rc 1011712/1011712 00000100:00100000:2.0:1746143773.793148:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3218 00002000:00100000:2.0:1746143773.793162:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092ef0380 x1830963622362496/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 504/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1011712/1011712 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.793172:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0380 with x1830963622362496 ext(0->1048575) 00002000:00010000:2.0:1746143773.793179:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef0380 00000100:00100000:0.0:1746143773.798492:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.798990:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622363136 00000100:00100000:2.0:1746143773.799001:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622363136 00000100:00100000:0.0:1746143773.799788:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.799832:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622363264 00000100:00100000:2.0:1746143773.799837:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622363264 00000100:00100000:2.0:1746143773.799860:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11439 00000100:00100000:3.0:1746143773.799867:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11440 00000100:00100000:2.0:1746143773.799869:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:31967:x1830963622363136:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143773.799876:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:31960:x1830963622363264:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143773.799888:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.799888:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.799905:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6f4 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.799905:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6ed expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.799972:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.799972:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.799979:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.799981:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a8115 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6b5 expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.799981:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143773.799984:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 16 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.799988:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8097 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a668 expref: 16 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.799994:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.799996:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.799998:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->1449983] (req 1048576->1449983) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.800017:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8097 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a668 expref: 16 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.800018:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.800030:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8097 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a668 expref: 16 pid: 1945 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143773.800043:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626686592:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.800104:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 35 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143773.800113:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626686464:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.800140:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a8115 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6b5 expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143773.800140:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4840 going to sleep for 11 seconds 00010000:00010000:3.0:1746143773.800148:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a8115 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6b5 expref: 8 pid: 12327 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143773.800157:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626686720:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.800187:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.800194:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 35 pid: 3135 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143773.800200:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626686848:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.800214:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.802840:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.802873:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.802941:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.803072:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626686464:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.803106:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 16 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.803123:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ea00, rc 0) 00000100:00100000:2.0:1746143773.803167:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:31967:x1830963622363136:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3299us (4683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.803176:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11439 00000100:00100000:2.0:1746143773.803222:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622363648 00000100:00100000:2.0:1746143773.803228:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622363648 00002000:00100000:2.0:1746143773.803265:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1662976->2097151) req@ffff880092ef0e00 x1830963622363648/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.803273:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0e00 with x1830963622363648 ext(1662976->2097151) 00010000:00010000:2.0:1746143773.803280:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 36 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143773.803282:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626686592:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.803290:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 36 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143773.803292:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626686720:192.168.202.3@tcp:104: 00002000:00010000:2.0:1746143773.803295:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef0e00 00000100:00100000:3.0:1746143773.803299:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626686848:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143773.803313:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1368 00000100:00100000:2.0:1746143773.803320:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622363648:12345-192.168.202.3@tcp:4:multiop.0 00010000:00010000:3.0:1746143773.803330:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->1449983] (req 1048576->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 36 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.803345:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:3.0:1746143773.803364:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:31960:x1830963622363264:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3490us (3581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.803370:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11440 00000100:00100000:2.0:1746143773.803448:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622363520 00000100:00100000:2.0:1746143773.803451:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622363520 00010000:00010000:2.0:1746143773.803470:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8097 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a668 expref: 16 pid: 1945 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143773.803552:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.803597:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.804745:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622363392 00000100:00100000:2.0:1746143773.804752:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622363392 00010000:00010000:2.0:1746143773.804769:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a8115 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6b5 expref: 9 pid: 12327 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143773.804790:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622363776 00000100:00100000:2.0:1746143773.804792:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622363776 00010000:00010000:2.0:1746143773.804808:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 37 pid: 3135 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143773.804824:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5346 00000100:00100000:2.0:1746143773.804831:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622363520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.804843:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143773.804872:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5347 00000100:00100000:3.0:1746143773.804879:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5348 00000100:00100000:1.0:1746143773.804880:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622363392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143773.804886:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622363776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.804888:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.804894:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.804898:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a8115 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6b5 expref: 9 pid: 12327 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143773.804901:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 37 pid: 3135 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143773.804909:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a8115 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6b5 expref: 9 pid: 12327 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143773.804928:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 37 pid: 3135 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143773.804947:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c529c00/0x87925e4cb73a8115 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6b5 expref: 9 pid: 12327 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143773.804962:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f800/0x87925e4cb73a8058 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a629 expref: 37 pid: 3135 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143773.804971:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143773.804976:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143773.804994:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622363392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 116us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.804996:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622363776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 111us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.805000:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5347 00000100:00100000:3.0:1746143773.805004:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5348 00000100:00100000:1.0:1746143773.805017:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622364032 00000100:00100000:1.0:1746143773.805020:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622364032 00000100:00100000:1.0:1746143773.805042:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12777 00000100:00100000:1.0:1746143773.805046:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+40:31970:x1830963622364032:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143773.805063:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.805077:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a8170 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a6fb expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.805147:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8097 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a668 expref: 16 pid: 1945 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143773.805156:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8097 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a668 expref: 16 pid: 1945 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143773.805169:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8097 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a668 expref: 16 pid: 1945 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746143773.805172:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143773.805185:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.805186:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.805188:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.805194:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.805195:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143773.805202:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1746143773.805204:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143773.805232:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.805244:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626686976:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143773.805289:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a8170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6fb expref: 43 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.805291:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4840 going to sleep for 11 seconds 00010000:00010000:1.0:1746143773.805301:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6fb expref: 42 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.805307:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143773.805310:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143773.805312:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30400, rc 0) 00000100:00100000:1.0:1746143773.805330:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+42:31970:x1830963622364032:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 284us (1779us total) trans 8589943502 rc 0/0 00000100:00100000:1.0:1746143773.805335:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12777 00000100:00100000:2.0:1746143773.808528:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622363648:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5196us (5575us total) trans 17179872921 rc 0/0 00000100:00100000:2.0:1746143773.808541:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1368 00002000:00100000:2.0:1746143773.808552:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1662976->2097151) req@ffff880092ef0e00 x1830963622363648/t17179872921(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.808562:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0e00 with x1830963622363648 ext(1662976->2097151) 00010000:00010000:2.0:1746143773.808571:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 36 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.808586:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 36 pid: 13436 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143773.808593:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef0e00 00000100:00100000:2.0:1746143773.810187:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626686976:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.810209:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.810317:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622363520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5486us (7487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.810327:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5346 00000100:00100000:0.0:1746143773.810462:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.810650:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.810719:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622364288 00000100:00100000:3.0:1746143773.810726:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622364288 00010000:00010000:3.0:1746143773.810754:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 36 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143773.810808:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622364416 00000100:00100000:2.0:1746143773.810811:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622364416 00002000:00100000:2.0:1746143773.810838:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1445888->1449983) req@ffff880092ef1f80 x1830963622364416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.810846:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1f80 with x1830963622364416 ext(1445888->1449983) 00002000:00010000:2.0:1746143773.810850:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef1f80 00000100:00100000:0.0:1746143773.811485:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5349 00000100:00100000:0.0:1746143773.811492:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963622364288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143773.811507:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143773.811515:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3220 00002000:00010000:0.0:1746143773.811521:0:12362:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143773 -> 1746143774 00000100:00100000:2.0:1746143773.811522:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622364416:12345-192.168.202.3@tcp:3:multiop.0 00002000:00010000:0.0:1746143773.811523:0:12362:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143773 -> 1746143774 00010000:00010000:0.0:1746143773.811528:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 37 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143773.811536:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 37 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143773.811557:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a815b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6e6 expref: 37 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143773.811580:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143773.811581:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143773.811588:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.811593:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.811618:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.811627:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626687104:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.811639:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622364416:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 117us (988us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143773.811644:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3220 00002000:00100000:2.0:1746143773.811650:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1445888->1449983) req@ffff880092ef1f80 x1830963622364416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.811657:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1f80 with x1830963622364416 ext(1445888->1449983) 00002000:00010000:2.0:1746143773.811660:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef1f80 00000100:00100000:0.0:1746143773.811672:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.813024:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626687104:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.813040:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.813063:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622364288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1571us (2601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.813070:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5349 00000100:00100000:2.0:1746143773.815374:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.815478:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.815547:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622364544 00000100:00100000:3.0:1746143773.815556:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622364544 00000100:00100000:3.0:1746143773.815608:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11441 00000100:00100000:3.0:1746143773.815616:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:31970:x1830963622364544:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143773.815635:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.815651:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a702 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.815682:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.815689:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.815691:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.815694:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1732608->2002943] (req 1732608->2002943) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 16 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.815723:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.815734:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 34 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143773.815746:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626687232:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.815818:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.815987:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622364800 00000100:00100000:0.0:1746143773.815991:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622364800 00000100:00100000:0.0:1746143773.816020:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4654 00000100:00100000:0.0:1746143773.816025:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+297:31960:x1830963622364800:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143773.816200:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+298:31960:x1830963622364800:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 174us (721us total) trans 8589943503 rc 0/0 00000100:00100000:0.0:1746143773.816206:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4654 00000100:00100000:0.0:1746143773.816870:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.816939:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622365056 00000100:00100000:3.0:1746143773.816943:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622365056 00002000:00100000:3.0:1746143773.816985:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092ef3b80 x1830963622365056/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.816994:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3b80 with x1830963622365056 ext(1048576->2097151) 00002000:00010000:3.0:1746143773.816999:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef3b80 00000100:00100000:3.0:1746143773.817024:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3221 00000100:00100000:3.0:1746143773.817030:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622365056:12345-192.168.202.3@tcp:3:multiop.0 00010000:00010000:3.0:1746143773.817808:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143773.820817:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.821008:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622365184 00000100:00100000:2.0:1746143773.821018:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622365184 00002000:00100000:2.0:1746143773.821063:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1449983) req@ffff880092ef1180 x1830963622365184/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.821073:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1180 with x1830963622365184 ext(1048576->1449983) 00010000:00010000:2.0:1746143773.821084:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 35 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.821098:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 35 pid: 9587 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143773.821104:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef1180 00000100:00100000:2.0:1746143773.821128:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1369 00000100:00100000:2.0:1746143773.821136:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622365184:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143773.821530:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626687232:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.821554:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1732608->2002943] (req 1732608->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.821569:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3600, rc 0) 00000100:00100000:3.0:1746143773.821599:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:31970:x1830963622364544:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5985us (6235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.821606:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11441 00000100:00100000:3.0:1746143773.824529:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622365056:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7488us (7648us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143773.824542:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3221 00002000:00100000:3.0:1746143773.824555:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092ef3b80 x1830963622365056/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.824565:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3b80 with x1830963622365056 ext(1048576->2097151) 00002000:00010000:3.0:1746143773.824571:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef3b80 00000100:00100000:2.0:1746143773.826503:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622365184:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5357us (5686us total) trans 17179872922 rc 0/0 00000100:00100000:2.0:1746143773.826515:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1369 00002000:00100000:2.0:1746143773.826526:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1449983) req@ffff880092ef1180 x1830963622365184/t17179872922(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.826536:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1180 with x1830963622365184 ext(1048576->1449983) 00010000:00010000:2.0:1746143773.826547:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 37 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.826563:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 37 pid: 9587 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143773.826575:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef1180 00000100:00100000:0.0:1746143773.829639:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.829749:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622365312 00000100:00100000:2.0:1746143773.829759:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622365312 00010000:00010000:2.0:1746143773.829800:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 37 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143773.829881:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5350 00000100:00100000:2.0:1746143773.829891:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622365312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.829906:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143773.829968:0:12362:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143773 -> 1746143774 00002000:00010000:2.0:1746143773.829972:0:12362:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143773 -> 1746143774 00010000:00010000:2.0:1746143773.829978:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 37 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.829991:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 37 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.830016:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8169 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6f4 expref: 37 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.830044:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.830046:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.830053:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.830061:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.830097:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.830109:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626687360:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.830205:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.833889:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.833969:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622365440 00000100:00100000:3.0:1746143773.833979:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622365440 00000100:00100000:3.0:1746143773.834029:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11442 00000100:00100000:3.0:1746143773.834042:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:31967:x1830963622365440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.834064:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143773.834070:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143773.834082:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a709 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.834105:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622365696 00010000:00010000:3.0:1746143773.834118:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.834120:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622365696 00010000:00010000:3.0:1746143773.834125:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.834127:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.834131:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.834165:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143773.834167:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1732608->1736703) req@ffff880094196d80 x1830963622365696/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746143773.834177:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 18 pid: 9587 timeout: 933 lvb_type: 0 00002000:00100000:2.0:1746143773.834177:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196d80 with x1830963622365696 ext(1732608->1736703) 00010000:00010000:2.0:1746143773.834186:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 18 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143773.834191:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626687488:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143773.834200:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 7/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 18 pid: 9587 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143773.834207:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094196d80 00000100:00100000:2.0:1746143773.834229:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1370 00000100:00100000:2.0:1746143773.834235:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622365696:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143773.834279:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.834359:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622365696:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 123us (288us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143773.834364:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1370 00002000:00100000:2.0:1746143773.834368:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1732608->1736703) req@ffff880094196d80 x1830963622365696/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.834381:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196d80 with x1830963622365696 ext(1732608->1736703) 00010000:00010000:2.0:1746143773.834385:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 18 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.834393:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 18 pid: 9587 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143773.834398:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094196d80 00000100:00100000:2.0:1746143773.834439:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626687360:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.834453:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.834558:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622365312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4665us (4927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.834565:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5350 00000100:00100000:3.0:1746143773.835235:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626687488:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.835250:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.835259:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2600, rc 0) 00000100:00100000:3.0:1746143773.835290:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:31967:x1830963622365440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1246us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.835297:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11442 00000100:00100000:0.0:1746143773.837461:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.839041:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622365952 00000100:00100000:2.0:1746143773.839051:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622365952 00002000:00100000:2.0:1746143773.839094:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1998848->2002943) req@ffff880094196300 x1830963622365952/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.839102:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196300 with x1830963622365952 ext(1998848->2002943) 00010000:00010000:2.0:1746143773.839111:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 17 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.839123:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 17 pid: 9587 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143773.839129:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094196300 00000100:00100000:2.0:1746143773.839173:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1371 00000100:00100000:2.0:1746143773.839180:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2010:x1830963622365952:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143773.839331:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2010:x1830963622365952:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 150us (1878us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143773.839336:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1371 00002000:00100000:2.0:1746143773.839341:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1998848->2002943) req@ffff880094196300 x1830963622365952/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/4536 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.839348:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196300 with x1830963622365952 ext(1998848->2002943) 00010000:00010000:2.0:1746143773.839352:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 17 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.839365:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 17 pid: 9587 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143773.839370:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094196300 00000100:00100000:0.0:1746143773.846066:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.846586:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622366208 00000100:00100000:2.0:1746143773.846594:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622366208 00002000:00100000:2.0:1746143773.846629:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1732608->2002943) req@ffff880094194e00 x1830963622366208/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.846638:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194e00 with x1830963622366208 ext(1732608->2002943) 00010000:00010000:2.0:1746143773.846646:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 17 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.846658:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 17 pid: 9587 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143773.846669:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094194e00 00000100:00100000:2.0:1746143773.846697:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1372 00000100:00100000:2.0:1746143773.846704:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622366208:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143773.850640:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622366208:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3927us (4571us total) trans 17179872923 rc 0/0 00000100:00100000:0.0:1746143773.850652:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1372 00002000:00100000:0.0:1746143773.850662:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1732608->2002943) req@ffff880094194e00 x1830963622366208/t17179872923(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143773.850678:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194e00 with x1830963622366208 ext(1732608->2002943) 00010000:00010000:0.0:1746143773.850687:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 19 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143773.850699:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 19 pid: 9587 timeout: 933 lvb_type: 0 00002000:00010000:0.0:1746143773.850705:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094194e00 00000100:00100000:0.0:1746143773.852866:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.852951:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622366336 00000100:00100000:2.0:1746143773.852967:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622366336 00010000:00010000:2.0:1746143773.852995:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 19 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143773.853029:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5351 00000100:00100000:2.0:1746143773.853036:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622366336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.853047:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.853061:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 19 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.853071:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 19 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.853090:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73a8185 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2002943) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a702 expref: 19 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.853109:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.853112:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.853117:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.853129:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.853155:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.853165:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626687616:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.853287:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.854616:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626687616:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.854629:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.854667:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622366336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1630us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.854675:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5351 00000100:00100000:0.0:1746143773.858266:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.858317:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.858403:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622366720 00000100:00100000:1.0:1746143773.858403:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622366848 00000100:00100000:2.0:1746143773.858413:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622366720 00000100:00100000:1.0:1746143773.858413:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622366848 00002000:00100000:1.0:1746143773.858461:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880094196a00 x1830963622366848/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.858462:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880094195f80 x1830963622366720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.858470:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195f80 with x1830963622366720 ext(1048576->2097151) 00002000:00100000:1.0:1746143773.858471:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196a00 with x1830963622366848 ext(1048576->2097151) 00002000:00010000:2.0:1746143773.858476:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094195f80 00002000:00010000:1.0:1746143773.858476:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196a00 00000100:00100000:2.0:1746143773.858578:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3222 00000100:00100000:2.0:1746143773.858588:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622366848:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143773.858601:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3223 00000100:00100000:3.0:1746143773.858608:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622366720:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143773.868587:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622366848:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 9987us (10255us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143773.868605:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3222 00002000:00100000:2.0:1746143773.868617:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880094196a00 x1830963622366848/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.868626:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196a00 with x1830963622366848 ext(1048576->2097151) 00002000:00010000:2.0:1746143773.868631:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196a00 00000100:00100000:3.0:1746143773.868673:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622366720:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 10063us (10417us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143773.868682:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3223 00002000:00100000:3.0:1746143773.868688:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880094195f80 x1830963622366720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.868696:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195f80 with x1830963622366720 ext(1048576->2097151) 00002000:00010000:3.0:1746143773.868700:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094195f80 00000100:00100000:0.0:1746143773.875104:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.875223:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622366976 00000100:00100000:3.0:1746143773.875234:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622366976 00000100:00100000:3.0:1746143773.875294:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11443 00000100:00100000:3.0:1746143773.875303:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:31967:x1830963622366976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.875322:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.875340:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8193 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a710 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.875366:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.875368:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.875376:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8193 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a710 expref: 19 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.875391:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8193 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a710 expref: 19 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.875401:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2c00, rc 0) 00000100:00100000:3.0:1746143773.875494:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31967:x1830963622366976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 191us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.875503:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11443 00000100:00100000:0.0:1746143773.879742:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.879802:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.879867:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622367360 00000100:00100000:2.0:1746143773.879878:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622367360 00002000:00100000:2.0:1746143773.879978:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880094197800 x1830963622367360/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.879987:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197800 with x1830963622367360 ext(2097152->3145727) 00002000:00010000:2.0:1746143773.879993:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197800 00000100:00100000:2.0:1746143773.880023:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622367488 00000100:00100000:2.0:1746143773.880026:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622367488 00002000:00100000:2.0:1746143773.880041:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880094197100 x1830963622367488/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.880047:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197100 with x1830963622367488 ext(2097152->3145727) 00002000:00010000:2.0:1746143773.880050:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094197100 00000100:00100000:2.0:1746143773.880076:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3224 00000100:00100000:2.0:1746143773.880083:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622367360:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143773.880106:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3225 00000100:00100000:1.0:1746143773.880115:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622367488:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.886977:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622367360:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6872us (7225us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143773.886990:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3224 00002000:00100000:2.0:1746143773.887003:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880094197800 x1830963622367360/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.887018:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197800 with x1830963622367360 ext(2097152->3145727) 00002000:00010000:2.0:1746143773.887025:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197800 00000100:00100000:1.0:1746143773.889479:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622367488:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9354us (9665us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143773.889490:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3225 00002000:00100000:1.0:1746143773.889501:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880094197100 x1830963622367488/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.889510:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197100 with x1830963622367488 ext(2097152->3145727) 00002000:00010000:1.0:1746143773.889516:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094197100 00000100:00100000:0.0:1746143773.895110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.895171:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622367616 00000100:00100000:3.0:1746143773.895180:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622367616 00000100:00100000:3.0:1746143773.895238:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11444 00000100:00100000:3.0:1746143773.895247:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31967:x1830963622367616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.895269:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.895288:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a717 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.895321:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.895328:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.895330:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.895333:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.895371:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.895382:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 20 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143773.895397:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626687744:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.895493:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.897319:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626687744:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143773.897330:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143773.897343:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.897359:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3800, rc 0) 00000100:00100000:3.0:1746143773.897401:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:31967:x1830963622367616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2156us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.897403:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622367744 00000100:00100000:3.0:1746143773.897409:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11444 00000100:00100000:1.0:1746143773.897411:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622367744 00002000:00100000:1.0:1746143773.897452:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3174400->3342335) req@ffff880094195c00 x1830963622367744/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.897462:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195c00 with x1830963622367744 ext(3174400->3342335) 00010000:00010000:1.0:1746143773.897469:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 20 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143773.897482:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 20 pid: 9587 timeout: 933 lvb_type: 0 00002000:00010000:1.0:1746143773.897493:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094195c00 00000100:00100000:2.0:1746143773.897564:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1373 00000100:00100000:2.0:1746143773.897575:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622367744:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143773.898389:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.898441:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622368000 00000100:00100000:1.0:1746143773.898447:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622368000 00000100:00100000:1.0:1746143773.898488:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12778 00000100:00100000:1.0:1746143773.898494:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+298:31975:x1830963622368000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143773.898510:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.898529:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73a81a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a71e expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.898598:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898610:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898620:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898639:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a81af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898644:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a81af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898648:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a81af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898743:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a81b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898753:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a81b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898759:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a81b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746143773.898768:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143773.898850:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898856:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898861:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898866:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898872:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143773.898875:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898881:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898891:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143773.898894:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143773.898897:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898902:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a81a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898972:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a81af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898981:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a81af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898985:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a81af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898989:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143773.898991:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a81af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.898995:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a81af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.899001:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22900) 00010000:00010000:1.0:1746143773.899003:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143773.899005:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a81af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.899009:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a81af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.899050:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73a81a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a71e expref: 301 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.899060:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a81b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a71e expref: 300 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.899065:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143773.899067:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143773.899069:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:1.0:1746143773.899114:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+300:31975:x1830963622368000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 620us (726us total) trans 8589943504 rc 0/0 00000100:00100000:1.0:1746143773.899121:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12778 00000100:00100000:0.0:1746143773.901615:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.901759:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622368128 00000100:00100000:2.0:1746143773.901768:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622368128 00000100:00100000:2.0:1746143773.901827:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 735 00000100:00100000:2.0:1746143773.901836:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+300:2009:x1830963622368128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.901850:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.901872:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a81b6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a71e expref: 300 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.901893:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.901897:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.901946:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+299:2009:x1830963622368128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 112us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.901961:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 735 00000100:00100000:3.0:1746143773.902727:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.902758:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.902780:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.902817:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.902830:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622368384 00000100:00100000:2.0:1746143773.902834:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622368384 00000100:00100000:2.0:1746143773.902861:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622368640 00000100:00100000:2.0:1746143773.902863:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622368640 00000100:00100000:2.0:1746143773.902873:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622368256 00000100:00100000:2.0:1746143773.902875:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622368256 00000100:00100000:2.0:1746143773.902885:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622368512 00000100:00100000:2.0:1746143773.902887:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622368512 00000100:00100000:2.0:1746143773.902897:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11445 00000100:00100000:2.0:1746143773.902903:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622368384:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.902933:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.902946:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a81c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a72c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.902976:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.902978:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.902986:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a81c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a72c expref: 38 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.902999:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a81c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a72c expref: 38 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.903008:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369e00, rc 0) 00000100:00100000:2.0:1746143773.903030:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622368384:12345-192.168.202.3@tcp:101:cat.0 Request processed in 127us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.903036:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11445 00000100:00100000:2.0:1746143773.903047:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11446 00000100:00100000:2.0:1746143773.903051:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622368640:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.903058:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.903068:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097369a00/0x87925e4cb73a81cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a73a expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.903083:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097369a00/0x87925e4cb73a81cb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a73a expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.903089:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097369a00/0x87925e4cb73a81cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a73a expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.903099:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369a00, rc 0) 00000100:00100000:2.0:1746143773.903114:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622368640:12345-192.168.202.3@tcp:101:cat.0 Request processed in 63us (356us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143773.903118:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11446 00000100:00100000:2.0:1746143773.903127:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11447 00000100:00100000:2.0:1746143773.903131:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963622368256:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143773.903136:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.903142:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a81d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a725 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.903177:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626687872:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143773.903233:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.903319:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622367744:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5747us (5990us total) trans 21474840242 rc 0/0 00000100:00100000:2.0:1746143773.903328:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1373 00002000:00100000:2.0:1746143773.903336:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3174400->3342335) req@ffff880094195c00 x1830963622367744/t21474840242(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.903344:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195c00 with x1830963622367744 ext(3174400->3342335) 00010000:00010000:2.0:1746143773.903350:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 22 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.903360:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 22 pid: 9587 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143773.903371:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094195c00 00000100:00100000:1.0:1746143773.903476:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11448 00000100:00100000:1.0:1746143773.903484:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622368512:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143773.903491:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.903500:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a81d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a733 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.903511:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.903512:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.903522:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a81d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a733 expref: 38 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.903532:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a81d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a733 expref: 38 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.903540:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31e00, rc 0) 00000100:00100000:1.0:1746143773.903561:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622368512:12345-192.168.202.3@tcp:101:cat.0 Request processed in 79us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.903567:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11448 00000100:00100000:2.0:1746143773.905038:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626687872:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143773.905075:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a81d2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a725 expref: 33 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.905086:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a81d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a725 expref: 33 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.905103:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ee00, rc 0) 00000100:00100000:2.0:1746143773.905139:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963622368256:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2007us (2358us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143773.905145:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11447 00000100:00100000:0.0:1746143773.906847:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.907040:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622368768 00000100:00100000:2.0:1746143773.907047:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622368768 00010000:00010000:2.0:1746143773.907080:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 22 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143773.907117:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5352 00000100:00100000:2.0:1746143773.907125:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622368768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.907142:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143773.907157:0:12362:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143773 -> 1746143774 00002000:00010000:2.0:1746143773.907159:0:12362:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143773 -> 1746143774 00010000:00010000:2.0:1746143773.907164:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 22 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.907180:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 22 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.907199:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73a80b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3174400->3342335] (req 3174400->3342335) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a684 expref: 22 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.907212:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.907214:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.907220:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.907229:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.907256:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.907265:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626688000:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.907330:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.907538:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.907617:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622368896 00000100:00100000:3.0:1746143773.907621:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622368896 00000100:00100000:3.0:1746143773.907646:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11449 00000100:00100000:3.0:1746143773.907651:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:31975:x1830963622368896:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.907666:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.907676:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a741 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.907694:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.907705:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.907706:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143773.907709:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.907726:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.907737:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 21 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143773.907745:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626688128:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143773.907905:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.910717:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.911013:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626688000:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.911040:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.911085:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622368768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3957us (4242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.911095:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5352 00000100:00100000:2.0:1746143773.911133:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622369024 00000100:00100000:2.0:1746143773.911140:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622369024 00002000:00100000:2.0:1746143773.911180:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b3:0x0] (233472->270335) req@ffff880094195180 x1830963622369024/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.911189:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195180 with x1830963622369024 ext(233472->270335) 00010000:00010000:2.0:1746143773.911196:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 21 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.911208:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 21 pid: 1945 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143773.911214:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094195180 00000100:00100000:2.0:1746143773.911245:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1374 00000100:00100000:2.0:1746143773.911252:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622369024:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143773.911472:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626688128:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143773.911492:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.911506:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2800, rc 0) 00000100:00100000:3.0:1746143773.911526:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:31975:x1830963622368896:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3875us (3987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.911532:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11449 00000100:00100000:0.0:1746143773.913199:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.914655:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622369280 00000100:00100000:1.0:1746143773.914665:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622369280 00002000:00100000:1.0:1746143773.914701:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8801373bb800 x1830963622369280/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.914708:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bb800 with x1830963622369280 ext(3145728->4194303) 00002000:00010000:1.0:1746143773.914713:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373bb800 00000100:00100000:1.0:1746143773.914738:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3226 00000100:00100000:1.0:1746143773.914746:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622369280:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143773.915011:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622369024:12345-192.168.202.3@tcp:4:cat.0 Request processed in 3757us (4302us total) trans 21474840243 rc 0/0 00000100:00100000:3.0:1746143773.915020:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1374 00002000:00100000:3.0:1746143773.915026:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b3:0x0] (233472->270335) req@ffff880094195180 x1830963622369024/t21474840243(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/448 e 0 to 0 dl 1746143784 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.915034:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195180 with x1830963622369024 ext(233472->270335) 00010000:00010000:3.0:1746143773.915042:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 25 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143773.915055:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 25 pid: 1945 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143773.915061:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094195180 00000100:00100000:0.0:1746143773.923620:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.923672:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622369408 00000100:00100000:2.0:1746143773.923683:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622369408 00010000:00010000:2.0:1746143773.923722:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 25 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143773.924271:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622369280:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9523us (11077us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143773.924329:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3226 00002000:00100000:1.0:1746143773.924339:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8801373bb800 x1830963622369280/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.924348:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bb800 with x1830963622369280 ext(3145728->4194303) 00002000:00010000:1.0:1746143773.924353:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373bb800 00000100:00100000:2.0:1746143773.925088:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5353 00000100:00100000:2.0:1746143773.925100:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622369408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.925115:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.925135:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 23 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.925148:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 23 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.925175:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8066 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 233472->270335) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a637 expref: 23 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143773.925205:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.925207:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.925215:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.925223:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.925258:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.925269:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626688256:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143773.925345:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.927200:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626688256:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143773.927220:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.927257:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622369408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2159us (3648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.927267:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5353 00000100:00100000:0.0:1746143773.931396:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.931708:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622369536 00000100:00100000:3.0:1746143773.931718:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622369536 00000100:00100000:3.0:1746143773.931808:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11450 00000100:00100000:3.0:1746143773.931818:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622369536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.931839:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.931858:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a81e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a748 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.931885:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.931886:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.931895:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a81e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a748 expref: 23 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.931942:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a81e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a748 expref: 23 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.931962:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:3.0:1746143773.932007:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963622369536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 191us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.932014:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11450 00000100:00100000:0.0:1746143773.932613:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.933135:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622369920 00000100:00100000:1.0:1746143773.933142:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622369920 00002000:00100000:1.0:1746143773.933182:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8801373b9c00 x1830963622369920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.933193:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9c00 with x1830963622369920 ext(0->1048575) 00002000:00010000:1.0:1746143773.933198:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373b9c00 00000100:00100000:1.0:1746143773.933230:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3227 00000100:00100000:1.0:1746143773.933237:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622369920:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143773.933642:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.933678:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143773.933695:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622370048 00000100:00100000:0.0:1746143773.933698:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622370048 00002000:00100000:0.0:1746143773.933715:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8801373b9180 x1830963622370048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143773.933723:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9180 with x1830963622370048 ext(1048576->2097151) 00002000:00010000:0.0:1746143773.933727:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b9180 00000100:00100000:0.0:1746143773.933753:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622370176 00000100:00100000:0.0:1746143773.933756:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622370176 00002000:00100000:0.0:1746143773.933766:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800939a7800 x1830963622370176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143773.933778:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7800 with x1830963622370176 ext(1048576->2097151) 00002000:00010000:0.0:1746143773.933782:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a7800 00000100:00100000:0.0:1746143773.933792:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3228 00000100:00100000:0.0:1746143773.933797:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622370048:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143773.934010:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3229 00000100:00100000:3.0:1746143773.934019:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622370176:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143773.938515:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.939353:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622370560 00000100:00100000:2.0:1746143773.939364:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622370560 00002000:00100000:2.0:1746143773.939412:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff8800939a5180 x1830963622370560/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143773.939567:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622369920:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6328us (6953us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143773.939577:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3227 00002000:00100000:1.0:1746143773.939584:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8801373b9c00 x1830963622369920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143773.939593:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9c00 with x1830963622369920 ext(0->1048575) 00002000:00010000:1.0:1746143773.939599:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373b9c00 00002000:00100000:2.0:1746143773.939655:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5180 with x1830963622370560 ext(4194304->4780031) 00002000:00010000:2.0:1746143773.939658:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a5180 00000100:00100000:2.0:1746143773.939782:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3230 00000100:00100000:2.0:1746143773.939791:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622370560:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143773.942018:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622370176:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7992us (8330us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143773.942030:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3229 00002000:00100000:3.0:1746143773.942041:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800939a7800 x1830963622370176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143773.942051:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7800 with x1830963622370176 ext(1048576->2097151) 00002000:00010000:3.0:1746143773.942057:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a7800 00000100:00100000:2.0:1746143773.944185:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963622370048:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10375us (10531us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143773.944197:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3228 00002000:00100000:2.0:1746143773.944209:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8801373b9180 x1830963622370048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.944218:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9180 with x1830963622370048 ext(1048576->2097151) 00002000:00010000:2.0:1746143773.944225:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b9180 00000100:00100000:2.0:1746143773.944884:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622370560:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5093us (6379us total) trans 0 rc 585728/585728 00000100:00100000:2.0:1746143773.944891:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3230 00002000:00100000:2.0:1746143773.944897:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff8800939a5180 x1830963622370560/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.944904:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5180 with x1830963622370560 ext(4194304->4780031) 00002000:00010000:2.0:1746143773.944908:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a5180 00000100:00100000:0.0:1746143773.946596:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143773.946755:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622370816 00000100:00100000:1.0:1746143773.946765:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622370816 00000100:00100000:1.0:1746143773.946824:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12779 00000100:00100000:1.0:1746143773.946832:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+299:31977:x1830963622370816:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143773.946859:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.946880:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73a81ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a74f expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.947447:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947461:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947471:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947484:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a81fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947489:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a81fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947494:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a81fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947592:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a8203 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947601:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a8203 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947606:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a8203 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746143773.947619:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143773.947690:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947695:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947702:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947708:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947713:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082049c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143773.947717:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947723:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947732:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143773.947735:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143773.947739:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947743:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73a81f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947769:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a81fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947774:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a81fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947782:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a81fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947786:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082048600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143773.947788:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a81fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947792:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a81fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947797:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22100) 00010000:00010000:1.0:1746143773.947798:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143773.947800:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a81fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947805:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73a81fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143773.947839:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73a81ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a74f expref: 302 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.947849:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a8203 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a74f expref: 301 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.947855:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143773.947857:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143773.947859:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048e00, rc 0) 00000100:00100000:1.0:1746143773.948359:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+301:31977:x1830963622370816:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1526us (1768us total) trans 8589943505 rc 0/0 00000100:00100000:1.0:1746143773.948366:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12779 00000100:00100000:0.0:1746143773.957208:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.957366:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622370944 00000100:00100000:2.0:1746143773.957378:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622370944 00000100:00100000:2.0:1746143773.957450:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 736 00000100:00100000:2.0:1746143773.957459:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+301:2010:x1830963622370944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.957479:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.957508:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73a8203 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a74f expref: 301 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.957538:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143773.957543:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.957596:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+300:2010:x1830963622370944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 138us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.957602:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 736 00000100:00100000:0.0:1746143773.959673:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143773.959725:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622371072 00000100:00100000:3.0:1746143773.959733:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622371072 00000100:00100000:3.0:1746143773.959785:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11451 00000100:00100000:3.0:1746143773.959793:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:31975:x1830963622371072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143773.959812:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.959829:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8211 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a756 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.959859:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.959860:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.959869:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8211 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a756 expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.959883:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8211 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a756 expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.959898:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467c00, rc 0) 00000100:00100000:3.0:1746143773.959995:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:31975:x1830963622371072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 202us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.960001:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11451 00000100:00100000:0.0:1746143773.968795:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.968861:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622371328 00000100:00100000:2.0:1746143773.968871:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622371328 00002000:00100000:2.0:1746143773.968933:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88009c4d4a80 x1830963622371328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.968943:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4a80 with x1830963622371328 ext(2097152->4194303) 00002000:00010000:2.0:1746143773.968949:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4a80 00000100:00100000:2.0:1746143773.968982:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3231 00000100:00100000:2.0:1746143773.968991:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622371328:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.984821:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622371328:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15820us (16025us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143773.984833:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3231 00002000:00100000:2.0:1746143773.984846:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88009c4d4a80 x1830963622371328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.984856:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4a80 with x1830963622371328 ext(2097152->4194303) 00002000:00010000:2.0:1746143773.984863:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4a80 00000100:00100000:0.0:1746143773.993648:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143773.993806:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622371584 00000100:00100000:2.0:1746143773.993817:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622371584 00002000:00100000:2.0:1746143773.993864:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4775935) req@ffff88009c4d4380 x1830963622371584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/0 e 0 to 0 dl 1746143784 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.993875:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4380 with x1830963622371584 ext(4194304->4775935) 00002000:00010000:2.0:1746143773.993881:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4380 00000100:00100000:2.0:1746143773.993938:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3232 00000100:00100000:2.0:1746143773.993948:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622371584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143773.999298:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622371584:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5339us (5648us total) trans 0 rc 581632/581632 00000100:00100000:2.0:1746143773.999309:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3232 00002000:00100000:2.0:1746143773.999321:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4775935) req@ffff88009c4d4380 x1830963622371584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:169/0 lens 488/440 e 0 to 0 dl 1746143784 ref 1 fl Complete:/200/0 rc 581632/581632 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143773.999330:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4380 with x1830963622371584 ext(4194304->4775935) 00002000:00010000:2.0:1746143773.999336:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4380 00000100:00100000:0.0:1746143774.006552:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.007361:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622371840 00000100:00100000:2.0:1746143774.007372:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622371840 00000100:00100000:2.0:1746143774.007421:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4655 00000100:00100000:2.0:1746143774.007429:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+300:31975:x1830963622371840:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143774.007651:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+301:31975:x1830963622371840:12345-192.168.202.3@tcp:35:cat.0 Request processed in 222us (1107us total) trans 8589943506 rc 0/0 00000100:00100000:2.0:1746143774.007657:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4655 00000100:00100000:0.0:1746143774.044764:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.044942:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622371968 00000100:00100000:3.0:1746143774.044961:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622371968 00000100:00100000:3.0:1746143774.045009:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11452 00000100:00100000:3.0:1746143774.045016:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:31977:x1830963622371968:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143774.045037:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.045056:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a75d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.045088:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.045095:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a81c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a72c expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.045102:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.045104:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.045107:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [2007040->2097151] (req 2007040->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.045141:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a81c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a72c expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.045159:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a81c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a72c expref: 39 pid: 13436 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.045173:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626688384:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.045291:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.045300:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 17 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.045308:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626688512:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.045329:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143774.048112:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626688384:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.048123:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626688512:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.048154:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [2007040->2097151] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.048172:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466800, rc 0) 00000100:00100000:3.0:1746143774.048798:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:31977:x1830963622371968:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3779us (4042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.048808:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11452 00000100:00100000:0.0:1746143774.049012:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.049184:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622372096 00000100:00100000:3.0:1746143774.049191:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622372096 00010000:00010000:3.0:1746143774.049224:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a81c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a72c expref: 39 pid: 13436 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.049260:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5354 00000100:00100000:3.0:1746143774.049267:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963622372096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.049279:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.049300:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a81c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a72c expref: 39 pid: 13436 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143774.049312:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a81c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a72c expref: 39 pid: 13436 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143774.049333:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a81c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a72c expref: 39 pid: 13436 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143774.049367:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.049389:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622372096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 122us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.049395:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5354 00000100:00100000:0.0:1746143774.050204:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.050370:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622372224 00000100:00100000:2.0:1746143774.050375:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622372224 00010000:00010000:2.0:1746143774.050399:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 18 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.050426:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5355 00000100:00100000:2.0:1746143774.050432:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963622372224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.050442:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.050453:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 18 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.050463:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 18 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.050478:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73a8162 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ed expref: 18 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.050502:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.050504:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.050511:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.050518:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.050553:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.050564:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626688640:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.050623:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.053869:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.054263:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622372480 00000100:00100000:3.0:1746143774.054275:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622372480 00000100:00100000:2.0:1746143774.054294:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626688640:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.054316:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143774.054317:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (2007040->2011135) req@ffff880090e25180 x1830963622372480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.054326:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25180 with x1830963622372480 ext(2007040->2011135) 00002000:00010000:3.0:1746143774.054331:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e25180 00000100:00100000:3.0:1746143774.054362:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3233 00000100:00100000:3.0:1746143774.054370:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963622372480:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143774.054538:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622372224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4105us (4336us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.054552:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963622372480:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 181us (693us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143774.054559:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3233 00002000:00100000:3.0:1746143774.054564:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (2007040->2011135) req@ffff880090e25180 x1830963622372480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.054570:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25180 with x1830963622372480 ext(2007040->2011135) 00002000:00010000:3.0:1746143774.054573:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e25180 00000100:00100000:2.0:1746143774.055071:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5355 00000100:00100000:0.0:1746143774.058428:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.058585:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622372608 00000100:00100000:3.0:1746143774.058596:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622372608 00000100:00100000:3.0:1746143774.058645:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11453 00000100:00100000:3.0:1746143774.058653:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:31977:x1830963622372608:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143774.058673:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.058693:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a764 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.058726:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 16 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.058734:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a81d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a733 expref: 39 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.058740:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.058742:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.058745:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->1683455] (req 1048576->1683455) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.058784:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a81d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a733 expref: 39 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.058795:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a81d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a733 expref: 39 pid: 3135 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.058807:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626688768:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.058909:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 16 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.058944:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 16 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.058961:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626688896:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.058994:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.062429:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.062674:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626688768:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.062689:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626688896:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.062721:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->1683455] (req 1048576->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.062737:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52600, rc 0) 00000100:00100000:3.0:1746143774.062796:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:31977:x1830963622372608:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4143us (4380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.062807:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11453 00000100:00100000:2.0:1746143774.062819:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622372736 00000100:00100000:2.0:1746143774.062828:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622372736 00010000:00010000:2.0:1746143774.062864:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a81d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a733 expref: 39 pid: 3135 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.062897:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5356 00000100:00100000:2.0:1746143774.062905:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129c37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622372736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.062969:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.062991:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a81d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a733 expref: 39 pid: 3135 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.063002:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a81d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a733 expref: 39 pid: 3135 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.063023:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a81d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a733 expref: 39 pid: 3135 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.063347:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.063511:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129c37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963622372736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 606us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.063521:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5356 00000100:00100000:0.0:1746143774.064720:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.064949:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622372864 00000100:00100000:2.0:1746143774.064968:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622372864 00010000:00010000:2.0:1746143774.064997:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 17 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.065032:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5357 00000100:00100000:2.0:1746143774.065039:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622372864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.065051:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.065077:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 17 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.065089:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 17 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.065107:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090fc2600/0x87925e4cb73a818c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a709 expref: 17 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.065120:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.065122:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.065131:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.065139:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.065165:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.065174:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626689024:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.065238:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143774.069394:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626689024:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.069414:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.069858:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622372864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4817us (5141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.069869:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5357 00000100:00100000:0.0:1746143774.072713:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.073312:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622373120 00000100:00100000:3.0:1746143774.073324:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622373120 00002000:00100000:3.0:1746143774.073376:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1679360->1683455) req@ffff880090e24e00 x1830963622373120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.073386:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e24e00 with x1830963622373120 ext(1679360->1683455) 00002000:00010000:3.0:1746143774.073392:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e24e00 00000100:00100000:3.0:1746143774.073477:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3234 00000100:00100000:3.0:1746143774.073486:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963622373120:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143774.073661:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963622373120:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 175us (961us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143774.074468:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3234 00002000:00100000:3.0:1746143774.074477:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1679360->1683455) req@ffff880090e24e00 x1830963622373120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.074485:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e24e00 with x1830963622373120 ext(1679360->1683455) 00002000:00010000:3.0:1746143774.074489:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e24e00 00000100:00100000:0.0:1746143774.075575:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.075616:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.075784:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622373248 00000100:00100000:3.0:1746143774.075790:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622373248 00000100:00100000:3.0:1746143774.075823:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622373376 00000100:00100000:3.0:1746143774.075824:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622373376 00000100:00100000:3.0:1746143774.075836:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11454 00000100:00100000:3.0:1746143774.075842:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2010:x1830963622373248:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.075857:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.075874:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8226 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a76b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143774.075946:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626689152:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143774.076056:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11455 00000100:00100000:1.0:1746143774.076065:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622373376:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.076071:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.076079:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a822d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a772 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143774.076337:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626689280:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143774.076699:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143774.076776:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.080441:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.080475:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622373632 00000100:00100000:0.0:1746143774.080482:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622373632 00002000:00010000:3.0:1746143774.080508:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143773 -> 1746143774 00000100:00100000:3.0:1746143774.080529:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626689152:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143774.080540:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4656 00000100:00100000:0.0:1746143774.080551:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+301:31977:x1830963622373632:12345-192.168.202.3@tcp:35:multiop.0 00010000:00010000:3.0:1746143774.080562:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8226 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a76b expref: 19 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.080577:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73a8226 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a76b expref: 19 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.080596:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466200, rc 0) 00000100:00100000:3.0:1746143774.080642:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622373248:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4799us (5070us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143774.080651:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11454 00002000:00010000:1.0:1746143774.080760:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143773 -> 1746143774 00000100:00100000:1.0:1746143774.080773:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626689280:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143774.080789:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a822d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a772 expref: 17 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.080799:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a822d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a772 expref: 17 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.080820:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048800, rc 0) 00000100:00100000:1.0:1746143774.080844:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622373376:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4780us (5226us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143774.080849:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11455 00000100:00100000:0.0:1746143774.081340:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+302:31977:x1830963622373632:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 791us (910us total) trans 8589943507 rc 0/0 00000100:00100000:0.0:1746143774.081346:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4656 00000100:00100000:0.0:1746143774.087044:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.087758:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622373888 00000100:00100000:3.0:1746143774.087768:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622373888 00002000:00100000:3.0:1746143774.087814:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800938de680 x1830963622373888/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.087824:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de680 with x1830963622373888 ext(0->1048575) 00002000:00010000:3.0:1746143774.087829:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938de680 00000100:00100000:3.0:1746143774.087858:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3235 00000100:00100000:3.0:1746143774.087866:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622373888:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143774.097801:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622373888:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9922us (10755us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.097815:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3235 00002000:00100000:3.0:1746143774.097829:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800938de680 x1830963622373888/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.097839:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de680 with x1830963622373888 ext(0->1048575) 00002000:00010000:3.0:1746143774.097846:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938de680 00000100:00100000:0.0:1746143774.102288:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.102360:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622374016 00000100:00100000:1.0:1746143774.102370:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622374016 00000100:00100000:1.0:1746143774.102427:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11456 00000100:00100000:1.0:1746143774.102434:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:31984:x1830963622374016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.102455:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.102488:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a779 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.102520:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.102528:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.102530:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.102533:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 17 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.102564:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.102576:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 37 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.102588:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626689408:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.103414:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143774.107036:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626689408:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.107071:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 17 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.107090:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049600, rc 0) 00000100:00100000:1.0:1746143774.107139:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:31984:x1830963622374016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4704us (4861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.107147:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11456 00000100:00100000:0.0:1746143774.108118:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.109097:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622374144 00000100:00100000:3.0:1746143774.109107:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622374144 00002000:00100000:3.0:1746143774.109160:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (2007040->2097151) req@ffff8800938dc380 x1830963622374144/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.109171:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc380 with x1830963622374144 ext(2007040->2097151) 00010000:00010000:3.0:1746143774.109180:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 38 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.109194:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 38 pid: 13436 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.109201:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938dc380 00000100:00100000:3.0:1746143774.109229:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1375 00000100:00100000:3.0:1746143774.109236:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622374144:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143774.118347:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622374144:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 9099us (10220us total) trans 17179872924 rc 0/0 00000100:00100000:3.0:1746143774.118360:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1375 00002000:00100000:3.0:1746143774.118373:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (2007040->2097151) req@ffff8800938dc380 x1830963622374144/t17179872924(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/448 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.118390:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc380 with x1830963622374144 ext(2007040->2097151) 00010000:00010000:3.0:1746143774.118400:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 40 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.118417:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 40 pid: 13436 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.118424:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938dc380 00000100:00100000:0.0:1746143774.120767:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.120831:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622374272 00000100:00100000:2.0:1746143774.120840:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622374272 00010000:00010000:2.0:1746143774.120877:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 40 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.120967:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5358 00000100:00100000:2.0:1746143774.120976:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622374272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.120990:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.121011:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 40 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.121023:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 40 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.121046:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73a8218 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a75d expref: 40 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.121079:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.121082:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.121089:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 16 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.121102:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 16 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.121137:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 16 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.121150:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626689536:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.121222:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143774.123655:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626689536:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.123677:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.123723:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963622374272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2746us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.123734:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5358 00000100:00100000:0.0:1746143774.125459:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.126293:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622374528 00000100:00100000:3.0:1746143774.126306:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622374528 00002000:00100000:3.0:1746143774.126353:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8800938de300 x1830963622374528/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.126362:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de300 with x1830963622374528 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.126367:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938de300 00000100:00100000:3.0:1746143774.126391:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3236 00000100:00100000:3.0:1746143774.126398:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622374528:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143774.134307:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.135524:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.135617:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622374912 00000100:00100000:1.0:1746143774.135628:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622374912 00000100:00100000:1.0:1746143774.135755:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12780 00000100:00100000:1.0:1746143774.135763:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+302:31988:x1830963622374912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.135790:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.135809:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a823b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a787 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.135886:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.135899:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.135909:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.135936:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a8249 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.135942:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a8249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.135948:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a8249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.136050:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8250 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.136060:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8250 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.136066:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8250 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746143774.136075:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:2.0:1746143774.136144:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622374656 00010000:00010000:1.0:1746143774.136145:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746143774.136149:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622374656 00010000:00010000:1.0:1746143774.136150:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.136156:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.136162:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.136167:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7e000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143774.136171:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.136177:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746143774.136204:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11457 00000100:00100000:2.0:1746143774.136211:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:31980:x1830963622374656:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143774.136220:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.136231:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a780 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.136252:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.136261:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a81e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a748 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.136268:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.136271:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.136274:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [770048->1048575] (req 770048->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.136301:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a81e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a748 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.136313:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a81e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a748 expref: 24 pid: 13436 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.136329:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626689664:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.136457:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.136465:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 33 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.136529:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626689792:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143774.136562:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143774.136597:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622374528:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10198us (11142us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.136607:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3236 00002000:00100000:3.0:1746143774.136616:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8800938de300 x1830963622374528/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.136626:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de300 with x1830963622374528 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.136630:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938de300 00010000:00010000:1.0:1746143774.137729:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143774.137733:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143774.137737:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.137742:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8242 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.137769:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a8249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.137774:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a8249 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.137784:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a8249 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.137788:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7ea00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143774.137791:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a8249 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.137796:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a8249 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.137801:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22700) 00010000:00010000:1.0:1746143774.137803:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143774.137805:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a8249 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.137809:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a8249 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143774.137852:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a823b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a787 expref: 305 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.137864:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8250 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a787 expref: 304 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.137870:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143774.137872:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143774.137875:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e600, rc 0) 00000100:00100000:1.0:1746143774.137905:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+304:31988:x1830963622374912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2143us (2385us total) trans 8589943508 rc 0/0 00000100:00100000:1.0:1746143774.137933:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12780 00000100:00100000:0.0:1746143774.139244:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626689664:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143774.140109:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626689792:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.140141:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [770048->1048575] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.140157:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2800, rc 0) 00000100:00100000:2.0:1746143774.140344:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:31980:x1830963622374656:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4133us (6046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.140352:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11457 00000100:00100000:2.0:1746143774.142048:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.142078:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.142081:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622375040 00000100:00100000:2.0:1746143774.142103:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.142115:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622375168 00000100:00100000:3.0:1746143774.142119:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622375168 00000100:00100000:2.0:1746143774.142119:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622375296 00000100:00100000:2.0:1746143774.142122:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622375296 00000100:00100000:2.0:1746143774.142166:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 737 00000100:00100000:0.0:1746143774.142167:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622375040 00000100:00100000:2.0:1746143774.142173:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+304:2010:x1830963622375296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.142186:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 34 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.142187:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143774.142207:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5359 00010000:00010000:2.0:1746143774.142209:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8250 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a787 expref: 304 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143774.142213:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622375040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.142221:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.142237:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143774.142240:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 34 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.142241:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143774.142249:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 34 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.142265:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73a81e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a741 expref: 34 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.142270:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+303:2010:x1830963622375296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 97us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.142276:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 737 00010000:00010000:3.0:1746143774.142301:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a81e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a748 expref: 24 pid: 13436 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.142305:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.142318:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5360 00000100:00100000:2.0:1746143774.142319:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622375424 00000100:00100000:2.0:1746143774.142321:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622375424 00000100:00100000:2.0:1746143774.142338:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11458 00000100:00100000:2.0:1746143774.142343:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622375424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.142357:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.142368:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8265 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a78e expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.142387:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143774.142388:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622375168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.142394:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8265 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a78e expref: 35 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.142396:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.142403:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8265 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a78e expref: 35 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.142416:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ee00, rc 0) 00000100:00100000:2.0:1746143774.142432:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622375424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 89us (127us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143774.142437:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11458 00000100:00100000:2.0:1746143774.142491:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143774.142496:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a81e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a748 expref: 24 pid: 13436 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.142502:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622375552 00010000:00010000:3.0:1746143774.142505:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a81e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a748 expref: 24 pid: 13436 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.142505:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622375552 00010000:00010000:3.0:1746143774.142517:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73a81e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a748 expref: 24 pid: 13436 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143774.142681:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.142683:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.142691:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.142698:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.142730:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143774.142742:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626689920:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143774.142790:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.142797:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11459 00000100:00100000:2.0:1746143774.142803:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622375552:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.142812:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143774.142812:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622375040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 598us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.142819:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5359 00010000:00010000:2.0:1746143774.142822:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a826c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a795 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.142833:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.142835:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.142839:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a826c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a795 expref: 40 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.142850:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a826c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a795 expref: 40 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.142858:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2600, rc 0) 00000100:00100000:2.0:1746143774.142871:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622375552:12345-192.168.202.3@tcp:101:cat.0 Request processed in 69us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.142876:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11459 00000100:00100000:3.0:1746143774.143387:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.145329:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.145427:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.145695:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622375680 00000100:00100000:3.0:1746143774.145704:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622375680 00000100:00100000:3.0:1746143774.145747:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622375808 00000100:00100000:3.0:1746143774.145749:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622375808 00000100:00100000:3.0:1746143774.145769:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11460 00000100:00100000:3.0:1746143774.145776:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:31984:x1830963622375680:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143774.145780:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11461 00000100:00100000:1.0:1746143774.145789:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+33:31988:x1830963622375808:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.145791:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.145798:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.145807:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a79c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.145809:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7a3 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.145832:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.145832:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.145839:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.145839:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143774.145841:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.145841:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143774.145844:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.145844:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.145869:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.145869:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.145878:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 39 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.145879:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.145888:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626690048:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.145888:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626690176:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.146249:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143774.146288:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143774.146376:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626689920:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143774.146392:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.146417:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963622375168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4093us (4337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.146425:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5360 00000100:00100000:0.0:1746143774.146494:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.146592:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622376064 00000100:00100000:3.0:1746143774.146596:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622376064 00002000:00100000:3.0:1746143774.146619:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (770048->774143) req@ffff88007f649f80 x1830963622376064/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.146629:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649f80 with x1830963622376064 ext(770048->774143) 00010000:00010000:3.0:1746143774.146635:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.146646:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.146652:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f649f80 00000100:00100000:3.0:1746143774.146672:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1376 00000100:00100000:3.0:1746143774.146677:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622376064:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143774.146789:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622376064:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 112us (295us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143774.146795:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1376 00002000:00100000:3.0:1746143774.146800:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (770048->774143) req@ffff88007f649f80 x1830963622376064/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.146808:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649f80 with x1830963622376064 ext(770048->774143) 00010000:00010000:3.0:1746143774.146812:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.146821:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.146827:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f649f80 00000100:00100000:1.0:1746143774.149113:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626690176:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.149144:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.149163:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e600, rc 0) 00000100:00100000:1.0:1746143774.149210:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+34:31988:x1830963622375808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3422us (3782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.149218:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11461 00000100:00100000:3.0:1746143774.149394:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626690048:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.149412:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.149424:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa17600, rc 0) 00000100:00100000:3.0:1746143774.149442:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:31984:x1830963622375680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3667us (4120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.149448:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11460 00000100:00100000:2.0:1746143774.149943:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.150117:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622376192 00000100:00100000:1.0:1746143774.150124:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622376192 00002000:00100000:1.0:1746143774.150159:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1683455) req@ffff88009c4d6300 x1830963622376192/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.150169:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6300 with x1830963622376192 ext(1048576->1683455) 00010000:00010000:1.0:1746143774.150175:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 40 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.150187:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 40 pid: 13436 timeout: 933 lvb_type: 0 00002000:00010000:1.0:1746143774.150193:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d6300 00000100:00100000:1.0:1746143774.150214:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1377 00000100:00100000:1.0:1746143774.150220:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622376192:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143774.151008:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.151078:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622376448 00000100:00100000:2.0:1746143774.151079:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.151083:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622376448 00000100:00100000:0.0:1746143774.151146:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622376576 00000100:00100000:0.0:1746143774.151150:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622376576 00000100:00100000:0.0:1746143774.151179:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11462 00000100:00100000:0.0:1746143774.151184:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:31980:x1830963622376576:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143774.151194:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143774.151210:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7aa expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.151231:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.151239:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a826c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a795 expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.151245:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.151246:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.151250:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->1769471] (req 1048576->1769471) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.151282:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a826c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a795 expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.151293:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a826c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a795 expref: 41 pid: 1945 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143774.151303:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626690304:192.168.202.3@tcp:104: 00002000:00100000:3.0:1746143774.151398:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (770048->1048575) req@ffff88007f648000 x1830963622376448/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.151408:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648000 with x1830963622376448 ext(770048->1048575) 00010000:00010000:3.0:1746143774.151415:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.151424:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 23 pid: 1945 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.151431:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f648000 00010000:00010000:0.0:1746143774.151543:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.151551:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 19 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.151575:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1378 00000100:00100000:3.0:1746143774.151582:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622376448:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143774.152094:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626690432:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143774.152132:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.155057:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626690304:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143774.164290:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.164446:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622376704 00000100:00100000:3.0:1746143774.164457:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622376704 00010000:00010000:3.0:1746143774.164500:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a826c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a795 expref: 42 pid: 1945 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.164545:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5361 00000100:00100000:3.0:1746143774.164553:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622376704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.164569:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.164592:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a826c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a795 expref: 42 pid: 1945 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143774.164604:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a826c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a795 expref: 42 pid: 1945 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143774.164628:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a826c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a795 expref: 42 pid: 1945 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143774.164659:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.164705:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622376704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 153us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.164712:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5361 00000100:00100000:0.0:1746143774.164892:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626690432:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143774.164946:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->1769471] (req 1048576->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.164969:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2200, rc 0) 00000100:00100000:0.0:1746143774.164995:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:31980:x1830963622376576:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 13810us (13916us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.165004:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11462 00000100:00100000:0.0:1746143774.165428:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622376192:12345-192.168.202.3@tcp:4:cat.0 Request processed in 15206us (15484us total) trans 17179872925 rc 0/0 00000100:00100000:0.0:1746143774.165436:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1377 00002000:00100000:0.0:1746143774.165446:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1683455) req@ffff88009c4d6300 x1830963622376192/t17179872925(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/448 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143774.165454:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6300 with x1830963622376192 ext(1048576->1683455) 00010000:00010000:0.0:1746143774.165461:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 41 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.165471:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 41 pid: 13436 timeout: 933 lvb_type: 0 00002000:00010000:0.0:1746143774.165476:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d6300 00000100:00100000:0.0:1746143774.166548:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.166662:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622376832 00000100:00100000:2.0:1746143774.166670:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622376832 00000100:00100000:3.0:1746143774.166785:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622376448:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 15202us (15778us total) trans 21474840244 rc 0/0 00000100:00100000:3.0:1746143774.166794:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1378 00002000:00100000:3.0:1746143774.166801:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (770048->1048575) req@ffff88007f648000 x1830963622376448/t21474840244(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/448 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.166809:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648000 with x1830963622376448 ext(770048->1048575) 00010000:00010000:3.0:1746143774.166817:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 25 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.166827:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 25 pid: 1945 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.166834:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f648000 00010000:00010000:2.0:1746143774.166873:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 19 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.166906:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5362 00000100:00100000:2.0:1746143774.166939:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5220050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622376832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.166959:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.166975:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 19 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.166984:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 19 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.167003:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73a8234 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a779 expref: 19 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.167018:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.167020:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.167027:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.167035:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.167067:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.167078:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626690560:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.168055:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.168562:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.168610:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622376960 00000100:00100000:1.0:1746143774.168618:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622376960 00010000:00010000:1.0:1746143774.168646:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 41 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.168681:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5363 00000100:00100000:1.0:1746143774.168688:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622376960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143774.168699:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143774.168716:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 41 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.168726:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 41 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.168743:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a821f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a764 expref: 41 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.168772:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.168774:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.168779:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.168786:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.168814:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143774.168824:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626690688:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143774.168867:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143774.171287:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626690560:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.171313:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.171363:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5220050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622376832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4449us (4817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.171375:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5362 00000100:00100000:0.0:1746143774.171625:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.171673:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622377088 00000100:00100000:2.0:1746143774.171680:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622377088 00010000:00010000:2.0:1746143774.171706:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 25 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.171742:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5364 00000100:00100000:2.0:1746143774.171749:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622377088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.171760:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.171780:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 25 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.171797:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 25 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.171819:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a825e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a780 expref: 25 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.171832:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.171834:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.171840:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 33 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.171848:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 33 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.171884:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 33 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.171895:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626690816:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.171994:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.181419:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.181488:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622377344 00000100:00100000:3.0:1746143774.181499:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622377344 00002000:00100000:3.0:1746143774.181549:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (1765376->1769471) req@ffff88007f648a80 x1830963622377344/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.181560:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648a80 with x1830963622377344 ext(1765376->1769471) 00002000:00010000:3.0:1746143774.181565:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648a80 00000100:00100000:3.0:1746143774.182016:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3237 00000100:00100000:3.0:1746143774.182028:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622377344:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143774.182190:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622377344:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 164us (782us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143774.182197:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3237 00002000:00100000:3.0:1746143774.182203:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (1765376->1769471) req@ffff88007f648a80 x1830963622377344/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.182210:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648a80 with x1830963622377344 ext(1765376->1769471) 00002000:00010000:3.0:1746143774.182213:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648a80 00000100:00100000:0.0:1746143774.188676:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.188796:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626690688:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143774.188818:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143774.188864:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622376960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 20176us (20304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.188876:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5363 00000100:00100000:3.0:1746143774.189110:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622377600 00000100:00100000:3.0:1746143774.189119:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622377600 00002000:00100000:3.0:1746143774.189163:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88007f649180 x1830963622377600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.189174:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649180 with x1830963622377600 ext(0->1048575) 00002000:00010000:3.0:1746143774.189179:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f649180 00000100:00100000:2.0:1746143774.189592:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626690816:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.189607:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.189642:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622377088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 17893us (18019us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.189649:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5364 00000100:00100000:3.0:1746143774.189704:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3238 00000100:00100000:3.0:1746143774.189711:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622377600:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143774.192297:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.192854:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622377856 00000100:00100000:3.0:1746143774.192865:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622377856 00002000:00100000:3.0:1746143774.192939:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092ef2d80 x1830963622377856/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.192962:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2d80 with x1830963622377856 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.192968:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef2d80 00000100:00100000:3.0:1746143774.192994:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3239 00000100:00100000:3.0:1746143774.193002:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622377856:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143774.207428:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622377600:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17701us (18746us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.207445:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3238 00002000:00100000:3.0:1746143774.207462:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88007f649180 x1830963622377600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.207472:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649180 with x1830963622377600 ext(0->1048575) 00002000:00010000:3.0:1746143774.207479:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f649180 00000100:00100000:0.0:1746143774.210534:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.210740:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622377856:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 17737us (18452us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.210756:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3239 00002000:00100000:3.0:1746143774.210768:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092ef2d80 x1830963622377856/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.210777:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2d80 with x1830963622377856 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.210782:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef2d80 00000100:00100000:2.0:1746143774.210933:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622378112 00000100:00100000:2.0:1746143774.210942:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622378112 00000100:00100000:2.0:1746143774.210988:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12781 00000100:00100000:2.0:1746143774.210995:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b71e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+303:31991:x1830963622378112:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143774.211019:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.211039:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73a8288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7b1 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.211115:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211128:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211140:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211152:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8296 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211157:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211162:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211258:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a829d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211268:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a829d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211274:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a829d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143774.211286:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143774.211359:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211364:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211370:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211375:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211380:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801331d2800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143774.211384:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211390:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211400:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143774.211403:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143774.211407:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211412:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a828f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211429:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211434:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8296 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211443:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211447:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ee00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143774.211449:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211454:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8296 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211459:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d200) 00010000:00010000:2.0:1746143774.211462:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143774.211464:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8296 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211469:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73a8296 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.211502:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73a8288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b1 expref: 306 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.211512:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a829d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b1 expref: 305 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.211519:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.211520:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143774.211523:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ea00, rc 0) 00000100:00100000:2.0:1746143774.211545:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b71e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+305:31991:x1830963622378112:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 551us (1023us total) trans 8589943509 rc 0/0 00000100:00100000:2.0:1746143774.211550:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12781 00000100:00100000:0.0:1746143774.214307:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.219340:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622378240 00000100:00100000:2.0:1746143774.219354:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622378240 00000100:00100000:2.0:1746143774.219425:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11463 00000100:00100000:2.0:1746143774.219432:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:31988:x1830963622378240:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.219451:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.219470:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7b8 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.219502:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.219510:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143774.219512:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143774.219515:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.219547:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.219558:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 17 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.219571:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626690944:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143774.219672:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.221283:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.221335:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.221341:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622378368 00000100:00100000:1.0:1746143774.221350:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622378368 00000100:00100000:1.0:1746143774.221408:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11464 00000100:00100000:1.0:1746143774.221416:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+34:31991:x1830963622378368:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143774.221431:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.221445:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7bf expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.221469:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.221478:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8211 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a756 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.221484:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a80ba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3342336->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a68b expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.221489:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.221491:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.221494:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3899392->4042751] (req 3899392->4042751) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.221517:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a80ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3342336->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a68b expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.221525:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a80ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3342336->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a68b expref: 35 pid: 3135 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.221535:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626691072:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.221596:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8211 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a756 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.221604:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8211 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a756 expref: 35 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.221611:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626691200:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.221631:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.221639:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 23 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.221646:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626691328:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.221661:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143774.221772:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622378496 00000100:00100000:2.0:1746143774.221775:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622378496 00000100:00100000:2.0:1746143774.221805:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 738 00000100:00100000:2.0:1746143774.221810:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+305:2011:x1830963622378496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.221821:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.221838:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a829d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b1 expref: 305 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.221854:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.221858:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.221879:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+304:2011:x1830963622378496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 69us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.221885:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 738 00000100:00100000:2.0:1746143774.221942:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626690944:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.221972:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.222043:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2800, rc 0) 00000100:00100000:2.0:1746143774.222479:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:31988:x1830963622378240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3047us (8180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.222485:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11463 00000100:00100000:0.0:1746143774.223893:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.223989:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.224015:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626691072:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.224024:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626691200:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.224031:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626691328:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.224064:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3899392->4042751] (req 3899392->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.224080:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32000, rc 0) 00000100:00100000:1.0:1746143774.224116:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:31991:x1830963622378368:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2700us (2837us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.224126:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11464 00000100:00100000:2.0:1746143774.224186:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622378752 00000100:00100000:2.0:1746143774.224192:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622378752 00010000:00010000:2.0:1746143774.224216:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a80ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3342336->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a68b expref: 35 pid: 3135 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.224237:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5365 00000100:00100000:2.0:1746143774.224243:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622378752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.224253:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.224273:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a80ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3342336->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a68b expref: 35 pid: 3135 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.224282:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a80ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3342336->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a68b expref: 35 pid: 3135 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.224300:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a80ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3342336->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a68b expref: 35 pid: 3135 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.224311:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.224327:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622378752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 84us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.224332:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5365 00000100:00100000:3.0:1746143774.224415:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622378624 00000100:00100000:3.0:1746143774.224419:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622378624 00002000:00100000:3.0:1746143774.224451:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1769471) req@ffff880129dc3800 x1830963622378624/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.224461:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc3800 with x1830963622378624 ext(1048576->1769471) 00010000:00010000:3.0:1746143774.224467:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 18 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.224477:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 18 pid: 13436 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.224483:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129dc3800 00000100:00100000:3.0:1746143774.224496:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1379 00000100:00100000:3.0:1746143774.224501:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622378624:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143774.230752:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.232191:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622379008 00000100:00100000:1.0:1746143774.232205:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622379008 00000100:00100000:1.0:1746143774.232279:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11465 00000100:00100000:1.0:1746143774.232289:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:31984:x1830963622379008:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.232310:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.232328:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7c6 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.232355:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.232362:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3899392->4042751] (req 3899392->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.232368:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.232371:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 25 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.232410:0:3134:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3899392->4042751] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.232422:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 25 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.232433:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32c00, rc 0) 00000100:00100000:1.0:1746143774.232490:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:31984:x1830963622379008:12345-192.168.202.3@tcp:101:cat.0 Request processed in 202us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.232496:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11465 00000100:00100000:0.0:1746143774.233440:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.233504:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.233584:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622378880 00000100:00100000:1.0:1746143774.233589:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622378880 00010000:00010000:1.0:1746143774.233611:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8211 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a756 expref: 34 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.233632:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5366 00000100:00100000:1.0:1746143774.233639:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622378880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143774.233649:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143774.233668:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8211 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a756 expref: 34 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.233679:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8211 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a756 expref: 34 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.233698:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8211 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a756 expref: 34 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.233727:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143774.233751:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622378880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 113us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.233757:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5366 00000100:00100000:1.0:1746143774.233769:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622379136 00000100:00100000:1.0:1746143774.233771:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622379136 00010000:00010000:1.0:1746143774.233780:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 25 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.233795:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5367 00000100:00100000:1.0:1746143774.233800:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622379136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143774.233806:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143774.233812:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 25 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.233819:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 25 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.233830:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73a819a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a717 expref: 25 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.233837:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.233839:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.233845:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 32 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.233852:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 32 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.233873:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 32 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.233884:0:12362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 32 pid: 3134 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.233896:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626691584:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143774.233981:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143774.235634:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626691584:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143774.235651:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143774.235676:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622379136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1876us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.235684:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5367 00000100:00100000:0.0:1746143774.235893:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.236091:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622379392 00000100:00100000:2.0:1746143774.236097:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622379392 00002000:00100000:2.0:1746143774.236133:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (3899392->3903487) req@ffff880129dc1500 x1830963622379392/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.236143:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1500 with x1830963622379392 ext(3899392->3903487) 00010000:00010000:2.0:1746143774.236151:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.236162:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143774.236169:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129dc1500 00000100:00100000:2.0:1746143774.236190:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1380 00000100:00100000:2.0:1746143774.236197:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622379392:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143774.236928:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622379392:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 714us (1018us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143774.236935:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1380 00002000:00100000:2.0:1746143774.236942:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (3899392->3903487) req@ffff880129dc1500 x1830963622379392/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.236960:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1500 with x1830963622379392 ext(3899392->3903487) 00010000:00010000:2.0:1746143774.236966:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.236974:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143774.236980:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129dc1500 00000100:00100000:3.0:1746143774.238545:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622378624:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 14034us (14647us total) trans 17179872926 rc 0/0 00000100:00100000:3.0:1746143774.238556:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1379 00002000:00100000:3.0:1746143774.238565:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1769471) req@ffff880129dc3800 x1830963622378624/t17179872926(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/448 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.238580:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc3800 with x1830963622378624 ext(1048576->1769471) 00010000:00010000:3.0:1746143774.238589:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 20 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.238600:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 20 pid: 13436 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.238606:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129dc3800 00000100:00100000:0.0:1746143774.240816:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.240903:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622379648 00000100:00100000:3.0:1746143774.240941:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622379648 00002000:00100000:3.0:1746143774.240995:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4038656->4042751) req@ffff880129dc2d80 x1830963622379648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.241004:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2d80 with x1830963622379648 ext(4038656->4042751) 00010000:00010000:3.0:1746143774.241012:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.241025:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.241032:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129dc2d80 00000100:00100000:3.0:1746143774.241064:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1381 00000100:00100000:3.0:1746143774.241072:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622379648:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143774.241219:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622379648:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 147us (410us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143774.241229:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1381 00002000:00100000:3.0:1746143774.241234:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4038656->4042751) req@ffff880129dc2d80 x1830963622379648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.241241:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2d80 with x1830963622379648 ext(4038656->4042751) 00010000:00010000:3.0:1746143774.241246:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143774.241247:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143774.241254:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.241259:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129dc2d80 00000100:00100000:1.0:1746143774.241348:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622379776 00000100:00100000:1.0:1746143774.241353:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622379776 00000100:00100000:0.0:1746143774.243481:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.243535:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.243563:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622380288 00000100:00100000:0.0:1746143774.243571:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622380288 00000100:00100000:0.0:1746143774.243628:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4657 00000100:00100000:0.0:1746143774.243636:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+304:31991:x1830963622380288:12345-192.168.202.3@tcp:35:multiop.0 00010000:00010000:1.0:1746143774.243659:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 20 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.243687:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5368 00000100:00100000:1.0:1746143774.243693:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5221050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622379776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143774.243703:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143774.243721:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 20 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.243732:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 20 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.243753:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a8281 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7aa expref: 20 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.243768:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.243770:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.243776:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.243789:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.243819:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143774.243830:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626691712:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143774.243844:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+305:31991:x1830963622380288:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 208us (308us total) trans 8589943510 rc 0/0 00000100:00100000:0.0:1746143774.243851:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4657 00000100:00100000:1.0:1746143774.243887:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143774.244030:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622380032 00000100:00100000:3.0:1746143774.244035:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622380032 00002000:00100000:3.0:1746143774.244062:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3899392->4042751) req@ffff880136acbb80 x1830963622380032/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.244071:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acbb80 with x1830963622380032 ext(3899392->4042751) 00010000:00010000:3.0:1746143774.244079:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.244091:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 33 pid: 3134 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.244098:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136acbb80 00000100:00100000:3.0:1746143774.244111:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1382 00000100:00100000:3.0:1746143774.244116:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622380032:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143774.248877:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626691712:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.248902:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.248979:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5221050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622379776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5284us (7729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.248991:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5368 00000100:00100000:0.0:1746143774.249906:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.250101:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622380032:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5982us (6626us total) trans 21474840245 rc 0/0 00000100:00100000:3.0:1746143774.250111:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1382 00002000:00100000:3.0:1746143774.250123:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3899392->4042751) req@ffff880136acbb80 x1830963622380032/t21474840245(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/448 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.250132:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acbb80 with x1830963622380032 ext(3899392->4042751) 00010000:00010000:3.0:1746143774.250143:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 35 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.250155:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 35 pid: 3134 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.250162:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136acbb80 00000100:00100000:3.0:1746143774.250177:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622380544 00000100:00100000:3.0:1746143774.250183:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622380544 00002000:00100000:3.0:1746143774.250211:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880136ac9f80 x1830963622380544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.250218:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9f80 with x1830963622380544 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.250221:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac9f80 00000100:00100000:1.0:1746143774.250257:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3240 00000100:00100000:1.0:1746143774.250267:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622380544:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143774.254887:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.255088:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622380672 00000100:00100000:2.0:1746143774.255099:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622380672 00010000:00010000:2.0:1746143774.255138:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 35 pid: 3134 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.255179:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5369 00000100:00100000:2.0:1746143774.255187:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622380672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.255204:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143774.255222:0:12362:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143773 -> 1746143774 00010000:00010000:2.0:1746143774.255228:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 35 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.255241:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 35 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.255265:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a82b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3899392->18446744073709551615] (req 3899392->4042751) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7bf expref: 35 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.255286:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.255288:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.255296:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.255305:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.255339:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.255353:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626691840:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.255430:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143774.255610:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622380544:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 5343us (5703us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143774.255619:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3240 00002000:00100000:1.0:1746143774.255628:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880136ac9f80 x1830963622380544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.255637:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9f80 with x1830963622380544 ext(1048576->2097151) 00002000:00010000:1.0:1746143774.255641:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac9f80 00000100:00100000:2.0:1746143774.259108:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626691840:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.259133:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.259593:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622380672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4404us (4715us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.259604:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5369 00000100:00100000:2.0:1746143774.259808:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.260145:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622380800 00000100:00100000:1.0:1746143774.260153:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622380800 00000100:00100000:0.0:1746143774.260348:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.260367:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11466 00000100:00100000:1.0:1746143774.260374:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+41:31988:x1830963622380800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.260794:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.260812:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a82c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7cd expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.260838:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.260840:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.260848:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a82c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7cd expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.260868:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a82c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7cd expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.260878:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ae00, rc 0) 00000100:00100000:1.0:1746143774.260945:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:31988:x1830963622380800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 570us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.260961:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11466 00000100:00100000:1.0:1746143774.262009:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622381056 00000100:00100000:1.0:1746143774.262016:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622381056 00002000:00100000:1.0:1746143774.262051:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880136acb100 x1830963622381056/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.262061:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb100 with x1830963622381056 ext(3145728->4194303) 00002000:00010000:1.0:1746143774.262066:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136acb100 00000100:00100000:1.0:1746143774.262082:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3241 00000100:00100000:1.0:1746143774.262087:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622381056:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143774.268199:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.268263:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622381312 00000100:00100000:2.0:1746143774.268273:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622381312 00002000:00100000:2.0:1746143774.268319:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880136ac9180 x1830963622381312/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.268329:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9180 with x1830963622381312 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.268335:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac9180 00000100:00100000:2.0:1746143774.268414:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3242 00000100:00100000:2.0:1746143774.268422:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622381312:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143774.268575:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622381056:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6486us (8226us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143774.268583:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3241 00002000:00100000:1.0:1746143774.268588:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880136acb100 x1830963622381056/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.268600:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb100 with x1830963622381056 ext(3145728->4194303) 00002000:00010000:1.0:1746143774.268604:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136acb100 00000100:00100000:0.0:1746143774.274684:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.274731:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.274792:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622381440 00000100:00100000:2.0:1746143774.274803:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622381440 00000100:00100000:2.0:1746143774.275513:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622381568 00000100:00100000:2.0:1746143774.275517:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622381568 00000100:00100000:2.0:1746143774.275638:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11467 00000100:00100000:1.0:1746143774.275646:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11468 00000100:00100000:2.0:1746143774.275647:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622381440:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143774.275656:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622381568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.275667:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.275667:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.275686:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a82c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7d4 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.275710:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.275712:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.275721:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a82c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7d4 expref: 25 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.275738:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a82c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7d4 expref: 25 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.275750:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96c00, rc 0) 00010000:00010000:1.0:1746143774.275772:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a82ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7db expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.275787:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.275788:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.275794:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a82ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7db expref: 20 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.275806:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a82ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7db expref: 20 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.275813:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8a200, rc 0) 00000100:00100000:3.0:1746143774.275871:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622381312:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7448us (7682us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143774.275871:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622381568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 216us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.275877:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11468 00000100:00100000:3.0:1746143774.275880:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3242 00002000:00100000:3.0:1746143774.275889:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880136ac9180 x1830963622381312/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.275904:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9180 with x1830963622381312 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.275909:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac9180 00000100:00100000:2.0:1746143774.276021:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622381440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 376us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.276027:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11467 00000100:00100000:0.0:1746143774.279778:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.279903:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622381824 00000100:00100000:3.0:1746143774.280004:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622381824 00002000:00100000:3.0:1746143774.280055:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880090e58e00 x1830963622381824/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.280065:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58e00 with x1830963622381824 ext(4194304->4780031) 00002000:00010000:3.0:1746143774.280071:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e58e00 00000100:00100000:3.0:1746143774.280182:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3243 00000100:00100000:3.0:1746143774.280191:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622381824:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143774.283721:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.284062:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622381824:12345-192.168.202.3@tcp:3:cat.0 Request processed in 3869us (4293us total) trans 0 rc 585728/585728 00000100:00100000:3.0:1746143774.284075:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3243 00000100:00100000:2.0:1746143774.284087:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622381952 00002000:00100000:3.0:1746143774.284089:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880090e58e00 x1830963622381824/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143774.284095:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622381952 00002000:00100000:3.0:1746143774.284098:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58e00 with x1830963622381824 ext(4194304->4780031) 00002000:00010000:3.0:1746143774.284104:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e58e00 00000100:00100000:2.0:1746143774.284149:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11469 00000100:00100000:2.0:1746143774.284157:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:31988:x1830963622381952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.284174:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.284190:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73a82d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7e2 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.284216:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.284219:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.284226:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73a82d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e2 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.285063:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73a82d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e2 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.285078:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96400, rc 0) 00000100:00100000:2.0:1746143774.285118:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:31988:x1830963622381952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 962us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.285125:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11469 00000100:00100000:0.0:1746143774.293071:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.293584:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622382208 00000100:00100000:3.0:1746143774.293595:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622382208 00002000:00100000:3.0:1746143774.293640:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880090e59f80 x1830963622382208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.293650:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59f80 with x1830963622382208 ext(2097152->4194303) 00002000:00010000:3.0:1746143774.293656:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59f80 00000100:00100000:3.0:1746143774.294363:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3244 00000100:00100000:3.0:1746143774.294374:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622382208:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143774.306214:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622382208:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11530us (12842us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143774.306229:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3244 00002000:00100000:3.0:1746143774.306242:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880090e59f80 x1830963622382208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.306252:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59f80 with x1830963622382208 ext(2097152->4194303) 00002000:00010000:3.0:1746143774.306258:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59f80 00000100:00100000:0.0:1746143774.316658:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.316724:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622382464 00000100:00100000:3.0:1746143774.316735:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622382464 00002000:00100000:3.0:1746143774.316787:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880090e5bb80 x1830963622382464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.316797:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5bb80 with x1830963622382464 ext(4194304->4780031) 00002000:00010000:3.0:1746143774.316802:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e5bb80 00000100:00100000:3.0:1746143774.316835:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3245 00000100:00100000:3.0:1746143774.316843:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622382464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143774.320549:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622382464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 3627us (3824us total) trans 0 rc 585728/585728 00000100:00100000:3.0:1746143774.320563:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3245 00002000:00100000:3.0:1746143774.320577:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880090e5bb80 x1830963622382464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.320587:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5bb80 with x1830963622382464 ext(4194304->4780031) 00002000:00010000:3.0:1746143774.320594:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e5bb80 00000100:00100000:0.0:1746143774.327006:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.327278:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622382720 00000100:00100000:2.0:1746143774.327290:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622382720 00000100:00100000:2.0:1746143774.327338:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4658 00000100:00100000:2.0:1746143774.327347:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+305:31988:x1830963622382720:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143774.328222:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+306:31988:x1830963622382720:12345-192.168.202.3@tcp:35:cat.0 Request processed in 873us (1229us total) trans 8589943511 rc 0/0 00000100:00100000:2.0:1746143774.328231:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4658 00000100:00100000:0.0:1746143774.403455:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.403845:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622382848 00000100:00100000:3.0:1746143774.403857:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622382848 00000100:00100000:3.0:1746143774.403998:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12782 00000100:00100000:3.0:1746143774.404008:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:31997:x1830963622382848:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143774.404036:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.404059:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73a82dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7e9 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.404122:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.404134:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.404145:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.404157:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73a82ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.404163:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73a82ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.404169:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73a82ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.404243:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.404253:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6fb expref: 41 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.404260:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.404293:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6fb expref: 41 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.404305:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6fb expref: 41 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.404317:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626691968:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.404418:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00080000:2.0:1746143774.404608:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143774.408832:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.408977:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626691968:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.409004:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143774.409617:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622383104 00000100:00100000:2.0:1746143774.409625:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622383104 00000100:00100000:2.0:1746143774.409682:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4659 00000100:00100000:2.0:1746143774.409690:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+42:30658:x1830963622383104:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143774.409936:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+43:30658:x1830963622383104:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 221us (1089us total) trans 8589943512 rc 0/0 00000100:00100000:2.0:1746143774.409944:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4659 00000100:00100000:0.0:1746143774.413359:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.413454:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622383232 00000100:00100000:2.0:1746143774.413464:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622383232 00010000:00010000:2.0:1746143774.413504:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6fb expref: 43 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.413983:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5370 00000100:00100000:2.0:1746143774.413994:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+43:2008:x1830963622383232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.414009:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.414016:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6fb expref: 43 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.414028:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6fb expref: 43 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.414053:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a8177 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6fb expref: 43 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.414074:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.414079:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.414089:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.414096:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.414131:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143774.414333:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414340:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143774.414396:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143774.414400:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143774.414418:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414428:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414438:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414443:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414448:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414453:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414459:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880123268400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143774.414462:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414468:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414476:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143774.414479:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143774.414482:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414486:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268400/0x87925e4cb73a82e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414512:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73a82ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414517:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73a82ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414521:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73a82ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414524:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880123269c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143774.414525:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73a82ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414529:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73a82ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414533:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092b0a000) 00010000:00010000:0.0:1746143774.414535:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143774.414536:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73a82ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414540:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73a82ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143774.414575:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73a82dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e9 expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.414591:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e9 expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.414592:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+42:2008:x1830963622383232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 589us (1233us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143774.414597:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143774.414599:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143774.414601:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268600, rc 0) 00000100:00100000:2.0:1746143774.414605:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5370 00000100:00100000:0.0:1746143774.414630:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:31997:x1830963622382848:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 10624us (11188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.414636:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12782 00000100:00100000:0.0:1746143774.416553:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.417005:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.417033:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.417056:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622383360 00000100:00100000:0.0:1746143774.417064:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622383360 00000100:00100000:1.0:1746143774.417093:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622383616 00000100:00100000:1.0:1746143774.417097:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622383616 00000100:00100000:0.0:1746143774.417607:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622383488 00000100:00100000:0.0:1746143774.417610:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622383488 00000100:00100000:1.0:1746143774.417613:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11470 00000100:00100000:1.0:1746143774.417620:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622383360:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:0.0:1746143774.417627:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11471 00000100:00100000:0.0:1746143774.417631:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622383616:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143774.417639:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143774.417639:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.417656:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a82ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7f0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.417656:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73a82f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7fe expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.417679:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.417679:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.417680:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.417681:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.417689:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a82ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f0 expref: 8 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.417689:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73a82f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7fe expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.417704:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a82ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f0 expref: 8 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.417704:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73a82f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7fe expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.417714:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0aa00, rc 0) 00010000:00010000:0.0:1746143774.417714:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550600, rc 0) 00000100:00100000:1.0:1746143774.417755:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622383360:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 135us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.417760:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11470 00000100:00100000:3.0:1746143774.417767:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11472 00000100:00100000:3.0:1746143774.417774:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622383488:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143774.417780:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.417788:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a8306 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a7f7 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.417808:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.417809:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.417813:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a8306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f7 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.417822:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a8306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f7 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.417828:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123269200, rc 0) 00000100:00100000:0.0:1746143774.417957:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622383616:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 313us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.417961:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11471 00000100:00100000:1.0:1746143774.417971:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.417994:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622383744 00000100:00100000:0.0:1746143774.417997:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622383744 00000100:00100000:0.0:1746143774.418019:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11473 00000100:00100000:0.0:1746143774.418023:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622383744:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143774.418028:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143774.418035:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a830d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a805 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.418044:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.418046:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.418050:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a830d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a805 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.418058:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a830d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a805 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.418065:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550800, rc 0) 00000100:00100000:0.0:1746143774.418079:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622383744:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 56us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.418084:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11473 00000100:00100000:3.0:1746143774.418151:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622383488:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 377us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.418162:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11472 00000100:00100000:0.0:1746143774.421167:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.421250:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622384000 00000100:00100000:2.0:1746143774.421282:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622384000 00000100:00100000:2.0:1746143774.421353:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12783 00000100:00100000:2.0:1746143774.421361:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:31997:x1830963622384000:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143774.421378:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.421395:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a8314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a80c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.421634:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a831b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.421648:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e9 expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.421656:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a831b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.421689:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e9 expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.421700:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e9 expref: 16 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.421713:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626692096:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143774.421807:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.423599:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.423666:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622384128 00000100:00100000:3.0:1746143774.423680:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622384128 00000100:00100000:2.0:1746143774.423688:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626692096:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.423705:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a831b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.423745:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e9 expref: 17 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.423777:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5371 00000100:00100000:3.0:1746143774.423784:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622384128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.423797:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.423803:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e9 expref: 17 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.423814:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e9 expref: 17 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.423835:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a82f1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e9 expref: 17 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.423859:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.423865:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a831b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.423873:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a831b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.423879:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a831b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.423909:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143774.424054:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a831b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.424061:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a831b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143774.424076:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963622384128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 291us (479us total) trans 0 rc 0/0 00000004:00200000:2.0:1746143774.424077:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:3.0:1746143774.424084:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5371 00010000:00010000:2.0:1746143774.424656:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a8314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a80c expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.424687:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a831b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a80c expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.424693:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.424697:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143774.424700:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96800, rc 0) 00000100:00100000:2.0:1746143774.425238:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:31997:x1830963622384000:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 3876us (4079us total) trans 8589943513 rc 0/0 00000100:00100000:2.0:1746143774.425246:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12783 00000100:00100000:0.0:1746143774.427827:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.427873:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622384384 00000100:00100000:2.0:1746143774.427881:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622384384 00000100:00100000:2.0:1746143774.427943:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12784 00000100:00100000:2.0:1746143774.427960:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:31997:x1830963622384384:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143774.427979:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.427982:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143774.428003:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a831b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a80c expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.428029:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.428033:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143774.428041:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a8329 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a813 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.428115:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73a8330 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.428127:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73a8330 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.428134:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73a8330 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143774.428147:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143774.428222:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a8329 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a813 expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.428234:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73a8330 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a813 expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.428240:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.428242:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143774.428244:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97800, rc 0) 00000100:00100000:2.0:1746143774.428421:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:31997:x1830963622384384:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 470us (597us total) trans 8589943514 rc 0/0 00000100:00100000:2.0:1746143774.428428:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12784 00000100:00100000:0.0:1746143774.430453:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.430539:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622384512 00000100:00100000:2.0:1746143774.430545:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622384512 00000100:00100000:2.0:1746143774.430575:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12785 00000100:00100000:2.0:1746143774.430580:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:31997:x1830963622384512:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143774.430595:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.430607:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a833e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a81a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.430642:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a833e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a81a expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.430652:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a833e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a81a expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.430664:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.430667:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143774.430669:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96e00, rc 0) 00000100:00100000:2.0:1746143774.431301:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:31997:x1830963622384512:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 719us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.431307:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12785 00000100:00100000:0.0:1746143774.433565:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.433599:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.434192:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.434211:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622384640 00000100:00100000:0.0:1746143774.434218:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622384640 00000100:00100000:0.0:1746143774.435293:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622384768 00000100:00100000:0.0:1746143774.435298:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622384768 00000100:00100000:3.0:1746143774.435346:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622384896 00000100:00100000:3.0:1746143774.435350:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622384896 00000100:00100000:3.0:1746143774.435376:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11474 00000100:00100000:3.0:1746143774.435383:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622384640:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143774.435417:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.435432:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.435444:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a82ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f0 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.435450:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a82c7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7d4 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.435456:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.435458:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.435461:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.435489:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a82c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7d4 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.435506:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a82c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7d4 expref: 24 pid: 13436 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.435517:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626692224:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.435622:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11475 00000100:00100000:1.0:1746143774.435629:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622384896:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143774.435648:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.435658:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.435665:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73a82f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7fe expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143774.435702:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11476 00000100:00100000:0.0:1746143774.435708:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622384768:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143774.435724:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.435732:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.435738:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a8306 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f7 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.435744:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a82ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7db expref: 19 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.435749:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.435751:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.435753:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.435770:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a82ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7db expref: 19 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.435777:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a82ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7db expref: 19 pid: 3134 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143774.435785:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626692352:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143774.435812:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a8306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f7 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.435819:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a8306 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f7 expref: 11 pid: 1945 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143774.435825:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626692480:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143774.435846:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.435853:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 41 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143774.435859:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626692608:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143774.435871:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.435901:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.435945:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622385024 00000100:00100000:2.0:1746143774.435957:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622385024 00000100:00100000:2.0:1746143774.435978:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11477 00000100:00100000:2.0:1746143774.435983:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622385024:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143774.435998:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.436007:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 34 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.436013:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a811c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6bc expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.436019:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a809e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a66f expref: 24 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.436024:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.436025:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.436027:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.436047:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a809e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a66f expref: 24 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.436054:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a809e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a66f expref: 24 pid: 9587 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.436063:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626692736:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.436091:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a811c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6bc expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.436098:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a811c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6bc expref: 10 pid: 12327 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.436105:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626692864:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.436128:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 34 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.436136:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 34 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.436143:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626692992:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143774.436158:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4900 going to sleep for 11 seconds 00010000:00010000:1.0:1746143774.436206:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a82c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7cd expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.436214:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.436215:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.436217:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.436234:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a82c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7cd expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.436241:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a82c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7cd expref: 41 pid: 3134 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.436247:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626693120:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.436273:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73a82f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7fe expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.436280:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73a82f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7fe expref: 11 pid: 13430 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143774.436286:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626693248:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.436303:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.436309:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 19 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.436319:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626693376:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.436330:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143774.437678:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.437719:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.437737:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622385152 00000100:00100000:1.0:1746143774.437742:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622385152 00000100:00100000:1.0:1746143774.437765:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622385280 00000100:00100000:1.0:1746143774.437767:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622385280 00010000:00010000:3.0:1746143774.438044:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a82ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f0 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.438057:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a82ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f0 expref: 11 pid: 3134 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.438067:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626693504:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.438110:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.438117:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 34 pid: 3134 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.438124:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626693632:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.438135:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143774.439086:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11478 00000100:00100000:1.0:1746143774.439096:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622385152:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143774.439124:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.439136:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.439143:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a830d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a805 expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.439149:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73a82d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e2 expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.439155:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8193 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a710 expref: 24 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.439165:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.439167:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.439169:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 7/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.439186:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8193 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a710 expref: 24 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.439194:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8193 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a710 expref: 24 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.439202:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626693760:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.439226:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73a82d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e2 expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.439233:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73a82d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e2 expref: 34 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.439240:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626693888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.439254:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a830d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a805 expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.439262:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a830d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a805 expref: 11 pid: 13430 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143774.439273:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626694016:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.439286:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.439292:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 24 pid: 3134 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.439298:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fdb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626694144:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.439307:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800973583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.439533:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11479 00000100:00100000:0.0:1746143774.439542:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622385280:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143774.439561:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.439570:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.439577:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a812a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ca expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.439583:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 41 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.439588:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.439590:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.439591:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.439605:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 41 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.439612:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 41 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143774.439620:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bcb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626694272:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143774.439666:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a812a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ca expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.439674:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a812a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ca expref: 12 pid: 13430 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143774.439681:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626694400:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143774.439700:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.439707:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 19 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143774.439714:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626694528:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143774.439724:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.448942:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.448976:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622385536 00000100:00100000:0.0:1746143774.448983:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622385536 00010000:00010000:0.0:1746143774.449014:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a82ce lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7db expref: 20 pid: 3134 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143774.449055:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5372 00000100:00100000:0.0:1746143774.449062:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622385536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.449073:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143774.449089:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a82ce lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7db expref: 20 pid: 3134 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143774.449103:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a82ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7db expref: 20 pid: 3134 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143774.449123:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.449158:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622385536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 96us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.449164:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5372 00000100:00100000:0.0:1746143774.449194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.449204:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622385408 00000100:00100000:0.0:1746143774.449207:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622385408 00010000:00010000:0.0:1746143774.449217:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a82c7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7d4 expref: 25 pid: 13436 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143774.449231:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5373 00000100:00100000:0.0:1746143774.449235:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622385408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.449242:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143774.449251:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a82c7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7d4 expref: 25 pid: 13436 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143774.449259:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a82c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7d4 expref: 25 pid: 13436 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143774.449269:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.449282:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622385408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.449287:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5373 00000100:00100000:0.0:1746143774.449324:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.449332:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622385664 00000100:00100000:0.0:1746143774.449335:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622385664 00010000:00010000:0.0:1746143774.449351:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a8306 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f7 expref: 13 pid: 1945 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143774.449364:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5374 00000100:00100000:0.0:1746143774.449369:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622385664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.449374:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143774.449380:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a8306 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f7 expref: 13 pid: 1945 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143774.449388:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a8306 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f7 expref: 13 pid: 1945 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143774.449398:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.449410:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622385664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 41us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.449414:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5374 00000100:00100000:1.0:1746143774.449778:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626693120:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.449983:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626693248:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.450006:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a82ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7db expref: 19 pid: 3134 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143774.450021:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626692352:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.450030:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73a8306 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f7 expref: 12 pid: 1945 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143774.450038:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626692480:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.450045:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626692608:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.450065:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143774.452030:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626692736:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143774.452042:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626692864:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143774.452052:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626692992:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143774.452072:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.452168:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a82c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7d4 expref: 24 pid: 13436 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.452184:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626692224:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143774.456286:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bcb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626694272:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143774.456322:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626694400:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143774.456344:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626694528:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143774.456366:0:9839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143774.456396:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.456479:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626693376:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.456495:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143774.456516:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626693760:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.456525:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626693888:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.456531:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626694016:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.456537:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fdb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626694144:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.456549:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143774.456603:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.456652:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626693504:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.456659:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626693632:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.456679:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.458220:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622385792 00000100:00100000:2.0:1746143774.458228:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622385792 00010000:00010000:2.0:1746143774.458261:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 42 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.458283:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622386176 00000100:00100000:2.0:1746143774.458285:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622386176 00010000:00010000:2.0:1746143774.458296:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 35 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.458316:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5375 00000100:00100000:2.0:1746143774.458322:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5221c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963622385792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.458334:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.458350:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 42 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.458359:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 42 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.458376:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a82ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7b8 expref: 42 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143774.458414:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5376 00000100:00100000:0.0:1746143774.458421:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622386176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.458430:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143774.458441:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 35 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.458449:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 35 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.458461:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73a8074 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a645 expref: 35 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.458475:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.458509:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622386176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.458515:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5376 00000100:00100000:0.0:1746143774.458549:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.458558:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622386432 00000100:00100000:0.0:1746143774.458561:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622386432 00010000:00010000:0.0:1746143774.458571:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 19 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143774.458583:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5377 00000100:00100000:0.0:1746143774.458587:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963622386432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.458592:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143774.458599:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 19 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.458606:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 19 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.458616:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73a8273 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a79c expref: 19 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.458623:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.458633:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622386432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 46us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.458637:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5377 00000100:00100000:0.0:1746143774.458670:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.458677:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622386816 00000100:00100000:0.0:1746143774.458679:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622386816 00010000:00010000:0.0:1746143774.458686:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 34 pid: 3134 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.458793:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143774.458818:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.458820:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.458824:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.458831:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.458846:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.458860:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5221c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622385792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 538us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.458864:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5375 00000100:00100000:2.0:1746143774.459731:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622385920 00000100:00100000:2.0:1746143774.459736:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622385920 00010000:00010000:2.0:1746143774.459749:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a811c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6bc expref: 12 pid: 12327 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.459761:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5378 00000100:00100000:2.0:1746143774.459765:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622386816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.459772:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.459781:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 34 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.459789:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 34 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.459801:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a827a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7a3 expref: 34 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.459811:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.459826:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622386816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.459831:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5378 00000100:00100000:2.0:1746143774.459840:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5379 00000100:00100000:2.0:1746143774.459844:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622385920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.459849:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.459855:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a811c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6bc expref: 12 pid: 12327 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.459863:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a811c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6bc expref: 12 pid: 12327 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.459872:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c528000/0x87925e4cb73a811c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6bc expref: 12 pid: 12327 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.459879:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.459889:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622385920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.459894:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5379 00010000:00010000:2.0:1746143774.459959:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.459966:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.459980:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.459986:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.459993:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.459998:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801331d2e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143774.460001:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.460012:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.460021:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.460026:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2e00/0x87925e4cb73a8353 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.460062:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622384768:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 24354us (26462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.460069:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11476 00000100:00100000:2.0:1746143774.460122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.460133:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622386304 00000100:00100000:2.0:1746143774.460136:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622386304 00010000:00010000:2.0:1746143774.460146:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73a82f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7fe expref: 11 pid: 13430 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.460160:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5380 00000100:00100000:2.0:1746143774.460165:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622386304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.460171:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.460178:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73a82f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7fe expref: 11 pid: 13430 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460185:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73a82f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7fe expref: 11 pid: 13430 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460198:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73a82f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7fe expref: 11 pid: 13430 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460205:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.460218:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622386304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.460223:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5380 00000100:00100000:2.0:1746143774.460252:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.460262:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622386560 00000100:00100000:2.0:1746143774.460264:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622386560 00010000:00010000:2.0:1746143774.460272:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a82ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f0 expref: 11 pid: 3134 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.460284:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5381 00000100:00100000:2.0:1746143774.460288:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622386560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.460293:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.460299:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a82ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f0 expref: 11 pid: 3134 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460306:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a82ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f0 expref: 11 pid: 3134 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460316:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a82ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7f0 expref: 11 pid: 3134 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460323:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.460325:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.460328:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.460334:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.460348:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.460361:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622386560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.460366:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5381 00000100:00100000:2.0:1746143774.460397:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.460407:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622387328 00000100:00100000:2.0:1746143774.460410:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622387328 00010000:00010000:2.0:1746143774.460419:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 24 pid: 3134 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.460431:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5382 00000100:00100000:2.0:1746143774.460435:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622387328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.460441:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.460447:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 24 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.460455:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 24 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.460465:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73a82b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7c6 expref: 24 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.460477:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.460489:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622387328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 54us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.460495:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5382 00000100:00100000:2.0:1746143774.460534:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.460543:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622386048 00000100:00100000:2.0:1746143774.460546:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622386048 00010000:00010000:2.0:1746143774.460554:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a809e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a66f expref: 23 pid: 9587 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.460565:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5383 00000100:00100000:2.0:1746143774.460569:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963622386048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.460575:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.460581:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a809e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a66f expref: 23 pid: 9587 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460588:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a809e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a66f expref: 23 pid: 9587 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460597:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a809e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a66f expref: 23 pid: 9587 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460604:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.460606:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.460608:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.460618:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.460630:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.460642:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622386048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.460647:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5383 00000100:00100000:2.0:1746143774.460676:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.460684:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622386944 00000100:00100000:2.0:1746143774.460686:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622386944 00010000:00010000:2.0:1746143774.460694:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a830d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a805 expref: 10 pid: 13430 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.460705:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5384 00000100:00100000:2.0:1746143774.460709:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622386944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.460715:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.460721:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a830d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a805 expref: 10 pid: 13430 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460727:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a830d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a805 expref: 10 pid: 13430 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460736:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73a830d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a805 expref: 10 pid: 13430 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.460743:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.460755:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622386944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.460760:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5384 00000100:00100000:2.0:1746143774.460789:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.460798:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622387200 00000100:00100000:2.0:1746143774.460800:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622387200 00010000:00010000:2.0:1746143774.460808:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 18 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.460818:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5385 00000100:00100000:2.0:1746143774.460822:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622387200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.460827:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.460833:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 18 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.460840:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 18 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.461043:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.461055:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.461065:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.461070:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.461075:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.461080:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143774.461082:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.461087:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.461094:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.461099:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a835a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143774.461127:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622385024:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 25144us (25225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.461133:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11477 00010000:00010000:3.0:1746143774.461211:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.461218:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.461228:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.461232:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.461237:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.461242:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880123268a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143774.461244:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.461249:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.461256:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.461261:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a8345 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143774.461297:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622384640:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 25914us (27736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.461303:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11474 00000100:00100000:0.0:1746143774.461385:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.461469:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.461481:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622387584 00000100:00100000:0.0:1746143774.461484:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622387584 00010000:00010000:0.0:1746143774.461498:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73a82d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e2 expref: 33 pid: 13436 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143774.461511:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622386688 00000100:00100000:0.0:1746143774.461513:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622386688 00010000:00010000:0.0:1746143774.461519:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8193 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a710 expref: 22 pid: 9587 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143774.461528:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5386 00000100:00100000:0.0:1746143774.461532:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622387584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.461537:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143774.461544:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73a82d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e2 expref: 33 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.461550:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73a82d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e2 expref: 33 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.461562:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73a82d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7e2 expref: 33 pid: 13436 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.461569:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.461583:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622387584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.461588:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5386 00000100:00100000:0.0:1746143774.461597:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5387 00000100:00100000:0.0:1746143774.461600:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622386688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.461605:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143774.461612:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8193 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a710 expref: 22 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.461619:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8193 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a710 expref: 22 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.461628:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8193 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a710 expref: 22 pid: 9587 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.461635:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.461636:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.461639:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.461644:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.461659:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.461672:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622386688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.461677:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5387 00010000:00010000:1.0:1746143774.462066:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.462073:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.462083:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.462088:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.462098:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.462103:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d66400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143774.462105:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.462117:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.462125:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.462129:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a8361 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143774.462165:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2008:x1830963622385152:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 23071us (24490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.462170:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11478 00000100:00100000:1.0:1746143774.462484:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.462509:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.462536:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.462579:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622387072 00000100:00100000:3.0:1746143774.462582:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622387072 00010000:00010000:3.0:1746143774.462597:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a812a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ca expref: 10 pid: 13430 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.462606:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622387456 00000100:00100000:3.0:1746143774.462608:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622387456 00010000:00010000:3.0:1746143774.462613:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 41 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.462620:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622387712 00000100:00100000:3.0:1746143774.462621:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622387712 00010000:00010000:3.0:1746143774.462627:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a82c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7cd expref: 42 pid: 3134 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.462636:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5388 00000100:00100000:3.0:1746143774.462641:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622387072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.462648:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143774.462686:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5389 00000100:00100000:0.0:1746143774.462693:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137108850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622387456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.462698:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143774.464120:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5390 00000100:00100000:1.0:1746143774.464129:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622387712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143774.464140:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143774.464154:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a82c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7cd expref: 42 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.464163:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a82c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7cd expref: 42 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.464180:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a82c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a7cd expref: 42 pid: 3134 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.464192:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.464193:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.464197:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.464204:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.464222:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143774.464235:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.464241:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.464253:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.464259:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.464269:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.464274:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0b000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143774.464277:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.464284:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.464293:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.464298:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0b000/0x87925e4cb73a834c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143774.464337:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622384896:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 28709us (30145us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.464344:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11475 00000100:00100000:1.0:1746143774.464368:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622387712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 242us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.464373:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5390 00010000:00010000:2.0:1746143774.465060:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a8089 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a65a expref: 18 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.465093:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a812a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ca expref: 9 pid: 13430 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143774.465106:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a812a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ca expref: 9 pid: 13430 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143774.465117:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73a812a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a6ca expref: 9 pid: 13430 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746143774.465126:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.465141:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622387072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2500us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.465146:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5388 00010000:00010000:0.0:1746143774.465192:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 40 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.465201:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 40 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.465212:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73a8090 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a661 expref: 40 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143774.465219:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.465221:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.465223:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.465229:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.465315:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.465330:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622387200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4506us (4539us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.465336:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5385 00010000:00010000:0.0:1746143774.465881:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.465899:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137108850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622387456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3206us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.465905:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5389 00010000:00010000:1.0:1746143774.466011:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.466020:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.466316:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.466322:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.466328:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.466333:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143774.466336:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.466342:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.466351:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.466357:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a8368 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143774.466390:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622385280:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 26850us (28670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.466397:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11479 00000100:00100000:0.0:1746143774.468835:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.468985:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622387968 00000100:00100000:2.0:1746143774.468994:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622387968 00000100:00100000:2.0:1746143774.469033:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12786 00000100:00100000:2.0:1746143774.469040:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:31997:x1830963622387968:12345-192.168.202.3@tcp:36:mirror_io.0 00010000:00010000:2.0:1746143774.469077:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.469101:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a833e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a81a expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469114:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.469118:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143774.469139:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.469149:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a78a9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1bb expref: 305 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469155:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a790b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1e5 expref: 41 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469162:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a13d expref: 41 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469168:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73a77c9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a144 expref: 305 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469173:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a542 expref: 41 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469178:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 8/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.469202:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a542 expref: 41 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469214:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a542 expref: 41 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.469225:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626694656:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.469308:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73a77c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a144 expref: 305 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469315:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73a77c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a144 expref: 305 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.469322:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626694784:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.469346:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a13d expref: 41 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469353:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a13d expref: 41 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.469359:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626694912:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.469379:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a790b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1e5 expref: 41 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469386:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a790b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1e5 expref: 41 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.469393:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626695040:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.469415:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a78a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1bb expref: 305 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.469421:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a78a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1bb expref: 305 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.469427:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626695168:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143774.469442:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.471645:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.471672:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.471689:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622388608 00000100:00100000:0.0:1746143774.471695:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622388608 00000100:00100000:0.0:1746143774.471735:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4660 00000100:00100000:0.0:1746143774.471740:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+42:26342:x1830963622388608:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143774.471889:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+43:26342:x1830963622388608:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 147us (214us total) trans 8589943515 rc 0/0 00000100:00100000:0.0:1746143774.471895:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4660 00000100:00100000:0.0:1746143774.471982:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.472051:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.472074:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.472168:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622388096 00000100:00100000:3.0:1746143774.472172:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622388096 00010000:00010000:3.0:1746143774.472188:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73a77c9 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a144 expref: 306 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.472209:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622388352 00000100:00100000:3.0:1746143774.472211:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622388352 00010000:00010000:3.0:1746143774.472220:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a78a9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1bb expref: 307 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.472229:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622388736 00000100:00100000:3.0:1746143774.472231:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622388736 00010000:00010000:3.0:1746143774.472237:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a790b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1e5 expref: 43 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.472243:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622388224 00000100:00100000:3.0:1746143774.472244:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622388224 00010000:00010000:3.0:1746143774.472251:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a13d expref: 44 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.472259:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5391 00000100:00100000:3.0:1746143774.472264:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+307:2008:x1830963622388096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.472271:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.472275:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73a77c9 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a144 expref: 307 pid: 7245 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.472282:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73a77c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a144 expref: 307 pid: 7245 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.472298:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.472302:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.472309:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.472332:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+307:2008:x1830963622388096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 67us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.472337:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5391 00000100:00100000:3.0:1746143774.472349:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5392 00000100:00100000:3.0:1746143774.472352:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+306:2008:x1830963622388352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.472357:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.472361:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a78a9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1bb expref: 306 pid: 7245 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.472367:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a78a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1bb expref: 306 pid: 7245 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.472379:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.472382:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.472386:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.472400:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+306:2008:x1830963622388352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.472405:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5392 00000100:00100000:3.0:1746143774.472414:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5393 00000100:00100000:3.0:1746143774.472419:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+44:2011:x1830963622388736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.472424:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.472427:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a790b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1e5 expref: 44 pid: 7245 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.472433:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a790b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1e5 expref: 44 pid: 7245 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.472441:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.472444:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.472448:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.472460:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+44:2011:x1830963622388736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 40us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.472464:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5393 00000100:00100000:3.0:1746143774.472472:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5394 00000100:00100000:3.0:1746143774.472476:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+43:2011:x1830963622388224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.472481:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.472484:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a13d expref: 43 pid: 7245 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.472490:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a13d expref: 43 pid: 7245 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.472497:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.472500:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.472503:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.472515:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+43:2011:x1830963622388224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 38us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.472519:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5394 00000100:00100000:2.0:1746143774.472789:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626694656:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.472813:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73a77c9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a144 expref: 305 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.472824:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626694784:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.472832:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a77c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a13d expref: 42 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.472839:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626694912:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.472846:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a790b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1e5 expref: 41 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.472854:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626695040:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.472862:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a78a9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a1bb expref: 304 pid: 7245 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.472868:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626695168:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.472892:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143774.475990:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.476120:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622388864 00000100:00100000:1.0:1746143774.476129:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622388864 00010000:00010000:1.0:1746143774.476158:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a542 expref: 41 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.476197:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5395 00000100:00100000:1.0:1746143774.476204:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+41:2008:x1830963622388864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143774.476217:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143774.476221:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a542 expref: 41 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.476231:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a542 expref: 41 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.476249:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a7efa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a542 expref: 41 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.476261:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143774.476265:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143774.476273:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143774.476279:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143774.476303:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143774.476334:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+40:2008:x1830963622388864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 131us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.476341:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5395 00010000:00010000:3.0:1746143774.476439:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.476446:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000040:00080000:3.0:1746143774.476659:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2599, 88 off216424 00000004:00080000:3.0:1746143774.476665:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833700752762ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143774.476709:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2569, 88 off214136 00000004:00080000:3.0:1746143774.476714:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833700801611ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143774.476725:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2570, 88 off214224 00000004:00080000:3.0:1746143774.476728:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833700815514ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143774.476735:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2600, 88 off216512 00000004:00080000:3.0:1746143774.476738:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833700825714ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143774.476750:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2601, 88 off216600 00000004:00080000:3.0:1746143774.476753:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833700840556ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143774.476764:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2571, 88 off214312 00000004:00080000:3.0:1746143774.476766:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833700854359ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143774.476774:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2572, 88 off214400 00000004:00080000:3.0:1746143774.476776:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833700863931ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143774.476783:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2573, 88 off214488 00000004:00080000:3.0:1746143774.476785:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833700873021ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143774.476793:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2602, 88 off216688 00000004:00080000:3.0:1746143774.476796:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833700883459ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143774.476808:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2574, 88 off214576 00000004:00080000:3.0:1746143774.476811:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833700898711ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143774.476818:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2603, 88 off216776 00000004:00080000:3.0:1746143774.476821:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833700908711ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143774.476832:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2575, 88 off214664 00000004:00080000:3.0:1746143774.476835:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833700923349ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143774.476842:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2604, 88 off216864 00000004:00080000:3.0:1746143774.476845:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833700932721ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143774.476856:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2605, 88 off216952 00000004:00080000:3.0:1746143774.476859:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833700946684ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143774.476869:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2606, 88 off217040 00000004:00080000:3.0:1746143774.476871:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833700959034ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143774.476989:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2607, 88 off217128 00000004:00080000:3.0:1746143774.476994:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833701082066ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143774.477012:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2576, 88 off214752 00000004:00080000:3.0:1746143774.477014:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833701102276ns, next at 770855090093ns, rc = 0 00000001:00080000:0.0:1746143774.478944:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943516 is committed 00000004:00080000:0.0:1746143774.478960:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1806 committed 00000004:00080000:0.0:1746143774.478969:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1835 committed 00000004:00080000:0.0:1746143774.478977:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1834 committed 00000004:00080000:0.0:1746143774.478978:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1833 committed 00000004:00080000:0.0:1746143774.478980:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1832 committed 00000004:00080000:0.0:1746143774.478981:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1805 committed 00000004:00080000:0.0:1746143774.478982:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1831 committed 00000004:00080000:0.0:1746143774.478984:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1804 committed 00000004:00080000:0.0:1746143774.478985:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1830 committed 00000004:00080000:0.0:1746143774.478986:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1803 committed 00000004:00080000:0.0:1746143774.478987:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1802 committed 00000004:00080000:0.0:1746143774.478989:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1801 committed 00000004:00080000:0.0:1746143774.478990:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1829 committed 00000004:00080000:0.0:1746143774.478991:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1828 committed 00000004:00080000:0.0:1746143774.478992:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1800 committed 00000004:00080000:0.0:1746143774.478994:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1799 committed 00000004:00080000:0.0:1746143774.478995:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1827 committed 00000001:00080000:0.0:1746143774.479000:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943515 is committed 00000001:00080000:0.0:1746143774.479006:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943511 is committed 00000100:00100000:2.0:1746143774.479313:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626695552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143774.479361:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143774.479384:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626696064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143774.479397:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143774.479410:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143774.479414:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626695680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143774.479426:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143774.479435:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626696192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143774.479445:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1746143774.479482:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d843800 reply state ffff88009605d400 transno 8589943516 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.479497:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.479505:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.479507:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746143774.479511:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746143774.479573:0:6587:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143774.479584:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31997:x1830963622387968:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 10543us (10754us total) trans 8589943516 rc 0/0 00000100:00100000:2.0:1746143774.479591:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12786 00010000:00010000:2.0:1746143774.479615:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.479621:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.479629:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.479634:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143774.479637:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.479643:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.479651:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.479653:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143774.479656:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.479659:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a836f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143774.479843:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626695296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.479865:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.479880:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626695808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.479891:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.479910:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143774.479930:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626695424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.479945:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.479966:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626695936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.479979:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.480004:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626695552 00000100:00100000:0.0:1746143774.480010:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626695552 00000100:00100000:0.0:1746143774.480038:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626696064 00000100:00100000:0.0:1746143774.480040:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626696064 00000100:00100000:0.0:1746143774.480049:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626695680 00000100:00100000:0.0:1746143774.480051:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626695680 00000100:00100000:0.0:1746143774.480059:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626696192 00000100:00100000:0.0:1746143774.480060:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626696192 00000100:00100000:0.0:1746143774.480068:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626695296 00000100:00100000:0.0:1746143774.480070:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626695296 00000100:00100000:0.0:1746143774.480075:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626695808 00000100:00100000:0.0:1746143774.480076:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626695808 00000100:00100000:0.0:1746143774.480081:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626695424 00000100:00100000:0.0:1746143774.480082:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626695424 00000100:00100000:0.0:1746143774.480088:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626695936 00000100:00100000:0.0:1746143774.480090:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626695936 00000100:00100000:3.0:1746143774.480093:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11480 00000100:00100000:3.0:1746143774.480100:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963626695552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.480143:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11481 00000100:00100000:0.0:1746143774.480148:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963626696064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.480201:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963626695552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (841us total) trans 17179872927 rc 0/0 00000100:00100000:0.0:1746143774.480201:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963626696064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (803us total) trans 17179872928 rc 0/0 00000100:00100000:3.0:1746143774.480207:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11480 00000100:00100000:0.0:1746143774.480209:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11481 00000100:00100000:0.0:1746143774.480216:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11482 00000100:00100000:0.0:1746143774.480220:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963626695680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.480227:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11483 00000100:00100000:3.0:1746143774.480231:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963626696192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143774.480263:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143774.480266:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143774.480268:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:0.0:1746143774.480270:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143774.480272:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143774.480273:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963626696192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (827us total) trans 17179872930 rc 0/0 00000100:00100000:3.0:1746143774.480278:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11483 00000100:00100000:0.0:1746143774.480285:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963626695680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (858us total) trans 17179872929 rc 0/0 00000100:00100000:3.0:1746143774.480286:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11484 00000100:00100000:3.0:1746143774.480290:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626695296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.480290:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11482 00000100:00100000:0.0:1746143774.480297:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11485 00000100:00100000:0.0:1746143774.480300:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626695808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143774.480327:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143774.480330:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143774.480331:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143774.480333:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143774.480334:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746143774.480335:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963626695296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (469us total) trans 17179872931 rc 0/0 00000100:00100000:3.0:1746143774.480340:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11484 00000100:00100000:0.0:1746143774.480347:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626695808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (454us total) trans 17179872932 rc 0/0 00000100:00100000:3.0:1746143774.480348:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11486 00000100:00100000:0.0:1746143774.480351:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11485 00000100:00100000:3.0:1746143774.480352:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626695424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.480357:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11487 00000100:00100000:0.0:1746143774.480360:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626695936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.480395:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963626695424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (448us total) trans 17179872933 rc 0/0 00000100:00100000:0.0:1746143774.480395:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963626695936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 34us (415us total) trans 17179872934 rc 0/0 00000100:00100000:3.0:1746143774.480400:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11486 00000100:00100000:0.0:1746143774.480401:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11487 00000100:00080000:0.0:1746143774.480410:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143774.480414:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626696704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143774.480419:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626696448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.480431:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.480433:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626696320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.480444:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626697216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143774.480445:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.480454:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626696832:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.480455:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.480464:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143774.480465:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.480468:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626696576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143774.480483:0:3773:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872906 gen 2 00000004:00080000:0.0:1746143774.480486:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30a80, transno 17179872858 00000004:00080000:0.0:1746143774.480491:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30700, transno 17179872859 00000004:00080000:0.0:1746143774.480494:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c38000, transno 17179872860 00000004:00080000:0.0:1746143774.480495:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33800, transno 17179872861 00000004:00080000:0.0:1746143774.480497:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c38700, transno 17179872862 00000004:00080000:0.0:1746143774.480499:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33480, transno 17179872863 00000004:00080000:0.0:1746143774.480501:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c39180, transno 17179872864 00000004:00080000:0.0:1746143774.480503:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c39880, transno 17179872865 00000004:00080000:0.0:1746143774.480505:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4c700, transno 17179872867 00000004:00080000:0.0:1746143774.480507:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136ac9c00, transno 17179872868 00000004:00080000:0.0:1746143774.480509:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4f480, transno 17179872869 00000004:00080000:0.0:1746143774.480511:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136ac8000, transno 17179872870 00000004:00080000:0.0:1746143774.480513:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136aca300, transno 17179872871 00000004:00080000:0.0:1746143774.480514:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136ac8700, transno 17179872872 00000004:00080000:0.0:1746143774.480516:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136acb800, transno 17179872873 00000004:00080000:0.0:1746143774.480518:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129dc0380, transno 17179872874 00000004:00080000:0.0:1746143774.480520:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093726300, transno 17179872887 00000004:00080000:0.0:1746143774.480522:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093725180, transno 17179872888 00000004:00080000:0.0:1746143774.480523:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093727480, transno 17179872889 00000004:00080000:0.0:1746143774.480526:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093727100, transno 17179872890 00000004:00080000:0.0:1746143774.480528:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093725f80, transno 17179872891 00000004:00080000:0.0:1746143774.480529:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093726d80, transno 17179872892 00000004:00080000:0.0:1746143774.480531:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093725500, transno 17179872893 00000004:00080000:0.0:1746143774.480533:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093724000, transno 17179872894 00000100:00100000:3.0:1746143774.480535:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143774.480535:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b62d80, transno 17179872899 00000004:00080000:0.0:1746143774.480537:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b61f80, transno 17179872900 00000004:00080000:0.0:1746143774.480539:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b63b80, transno 17179872901 00000004:00080000:0.0:1746143774.480541:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b62680, transno 17179872902 00000004:00080000:0.0:1746143774.480544:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b63480, transno 17179872903 00000100:00100000:3.0:1746143774.480545:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626697088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143774.480546:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b60e00, transno 17179872904 00000004:00080000:0.0:1746143774.480547:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b62a00, transno 17179872905 00000004:00080000:0.0:1746143774.480549:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b61880, transno 17179872906 00000100:00100000:0.0:1746143774.480554:0:3773:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880096fd8380 x1830963626695424/t17179872933(17179872933) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143790 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00100000:3.0:1746143774.480559:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143774.480562:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd8380/2, rc 0, transno 17179872933 00000100:00100000:0.0:1746143774.480566:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626695424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.480571:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626696704 00000100:00100000:3.0:1746143774.480574:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626696704 00000004:00080000:0.0:1746143774.480574:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd9f80/2, rc 0, transno 17179872934 00000100:00100000:0.0:1746143774.480576:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626695936:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143774.480581:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd9180/2, rc 0, transno 17179872931 00000100:00100000:0.0:1746143774.480584:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626695296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143774.480589:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd9880/2, rc 0, transno 17179872932 00000100:00100000:3.0:1746143774.480591:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626696320 00000100:00100000:0.0:1746143774.480591:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626695808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.480592:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626696320 00000100:00100000:3.0:1746143774.480598:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626697216 00000100:00100000:3.0:1746143774.480599:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626697216 00000100:00100000:0.0:1746143774.480603:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626696832 00000100:00100000:3.0:1746143774.480604:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626696576 00000100:00100000:0.0:1746143774.480604:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626696832 00000100:00100000:3.0:1746143774.480605:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626696576 00000100:00100000:3.0:1746143774.480610:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626697088 00000100:00100000:3.0:1746143774.480611:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626697088 00000100:00100000:0.0:1746143774.480613:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11488 00000100:00100000:0.0:1746143774.480617:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963626696704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.480618:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11489 00000100:00100000:3.0:1746143774.480621:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3773:x1830963626696320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.480664:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11490 00000100:00100000:3.0:1746143774.480668:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626697216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143774.480685:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626696704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (253us total) trans 21474840247 rc 0/0 00000100:00100000:0.0:1746143774.480690:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11488 00000100:00100000:0.0:1746143774.480700:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11491 00000100:00100000:0.0:1746143774.480704:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626696576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.480716:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626697216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (260us total) trans 21474840248 rc 0/0 00000100:00100000:3.0:1746143774.480721:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11490 00000100:00100000:3.0:1746143774.480729:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11492 00000100:00100000:3.0:1746143774.480733:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626696832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143774.480748:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626696576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (266us total) trans 21474840249 rc 0/0 00000100:00100000:0.0:1746143774.480752:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11491 00000100:00100000:0.0:1746143774.480760:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11493 00000100:00100000:0.0:1746143774.480764:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626697088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.480776:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626696832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (309us total) trans 21474840250 rc 0/0 00000100:00100000:3.0:1746143774.480780:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11492 00000100:00080000:0.0:1746143774.480794:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143774.480800:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.480810:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626696320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (364us total) trans 21474840246 rc 0/0 00000100:00100000:0.0:1746143774.480812:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626696960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.480815:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11489 00000100:00100000:3.0:1746143774.480822:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626696448 00000100:00100000:3.0:1746143774.480824:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626696448 00000100:00100000:0.0:1746143774.480824:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.480831:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626696960 00000100:00100000:3.0:1746143774.480832:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626696960 00000100:00100000:3.0:1746143774.480839:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11494 00000100:00100000:3.0:1746143774.480842:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963626696448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143774.480846:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143774.480848:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143774.480850:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143774.480851:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143774.480853:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143774.480868:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963626697088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (308us total) trans 21474840251 rc 0/0 00000100:00100000:0.0:1746143774.480872:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11493 00000100:00100000:0.0:1746143774.480881:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11495 00000100:00100000:0.0:1746143774.480885:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963626696960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.480886:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963626696448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (85us total) trans 21474840252 rc 0/0 00000100:00100000:3.0:1746143774.480891:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11494 00000100:00100000:3.0:1746143774.480907:0:3772:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840227 gen 2 00000004:00080000:3.0:1746143774.480925:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bcb800, transno 21474840173 00000004:00080000:3.0:1746143774.480928:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bcb480, transno 21474840174 00000004:00080000:3.0:1746143774.480930:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bc8a80, transno 21474840175 00000004:00080000:3.0:1746143774.480932:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bc9c00, transno 21474840176 00000004:00080000:3.0:1746143774.480934:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bcaa00, transno 21474840177 00000004:00080000:3.0:1746143774.480936:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e59180, transno 21474840178 00000004:00080000:3.0:1746143774.480938:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bca680, transno 21474840179 00000004:00080000:3.0:1746143774.480940:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5b100, transno 21474840180 00000004:00080000:3.0:1746143774.480942:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5aa00, transno 21474840181 00000004:00080000:3.0:1746143774.480944:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e59880, transno 21474840183 00000004:00080000:3.0:1746143774.480961:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e2300, transno 21474840184 00000100:00100000:0.0:1746143774.480961:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963626696960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (135us total) trans 21474840253 rc 0/0 00000004:00080000:3.0:1746143774.480963:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e2a00, transno 21474840185 00000004:00080000:3.0:1746143774.480965:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e3b80, transno 21474840186 00000004:00080000:3.0:1746143774.480966:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e2680, transno 21474840187 00000100:00100000:0.0:1746143774.480967:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11495 00000004:00080000:3.0:1746143774.480968:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e3800, transno 21474840188 00000004:00080000:3.0:1746143774.480970:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32d80, transno 21474840189 00000004:00080000:3.0:1746143774.480972:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e0e00, transno 21474840190 00000004:00080000:3.0:1746143774.480975:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5a300, transno 21474840191 00000004:00080000:3.0:1746143774.480977:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391d880, transno 21474840206 00000004:00080000:3.0:1746143774.480979:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391fb80, transno 21474840207 00000004:00080000:3.0:1746143774.480980:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391ca80, transno 21474840208 00000004:00080000:3.0:1746143774.480982:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391f480, transno 21474840209 00000004:00080000:3.0:1746143774.480984:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391df80, transno 21474840210 00000004:00080000:3.0:1746143774.480986:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391f800, transno 21474840211 00000004:00080000:3.0:1746143774.480987:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391ea00, transno 21474840212 00000004:00080000:3.0:1746143774.480989:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391c700, transno 21474840213 00000004:00080000:3.0:1746143774.480992:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373ba300, transno 21474840214 00000004:00080000:3.0:1746143774.480994:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b45180, transno 21474840219 00000004:00080000:3.0:1746143774.480995:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b45f80, transno 21474840220 00000004:00080000:3.0:1746143774.480997:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b44e00, transno 21474840221 00000004:00080000:3.0:1746143774.480999:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b45c00, transno 21474840222 00000004:00080000:3.0:1746143774.481001:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b46d80, transno 21474840223 00000004:00080000:3.0:1746143774.481002:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b45500, transno 21474840224 00000004:00080000:3.0:1746143774.481004:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b45880, transno 21474840225 00000004:00080000:3.0:1746143774.481006:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cc000, transno 21474840226 00000004:00080000:3.0:1746143774.481008:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b44000, transno 21474840227 00000100:00100000:3.0:1746143774.481012:0:3772:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800921cdc00 x1830963626696576/t21474840249(21474840249) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143790 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746143774.481018:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cdc00/2, rc 0, transno 21474840249 00000100:00100000:3.0:1746143774.481021:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626696576:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143774.481186:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd9500/2, rc 0, transno 17179872929 00000100:00100000:2.0:1746143774.481189:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626695680:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143774.481195:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fdad80/2, rc 0, transno 17179872930 00000100:00100000:2.0:1746143774.481197:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626696192:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143774.481201:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd8e00/2, rc 0, transno 17179872927 00000100:00100000:2.0:1746143774.481204:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626695552:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143774.481208:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fdbb80/2, rc 0, transno 17179872928 00000100:00100000:2.0:1746143774.481210:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626696064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143774.481515:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 32 done 00000004:00080000:3.0:1746143774.481578:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921ced80/2, rc 0, transno 21474840251 00000100:00100000:3.0:1746143774.481581:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626697088:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143774.481587:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cca80/2, rc 0, transno 21474840247 00000100:00100000:3.0:1746143774.481589:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626696704:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143774.481594:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cc700/2, rc 0, transno 21474840248 00000100:00100000:3.0:1746143774.481597:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626697216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143774.481889:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cea00/2, rc 0, transno 21474840252 00000100:00100000:0.0:1746143774.481893:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626696448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143774.481904:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cce00/2, rc 0, transno 21474840253 00000100:00100000:0.0:1746143774.481906:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626696960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143774.481931:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921ce680/2, rc 0, transno 21474840246 00000100:00100000:0.0:1746143774.481934:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626696320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143774.481953:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cc380/2, rc 0, transno 21474840250 00000100:00100000:0.0:1746143774.481956:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626696832:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143774.482120:0:8224:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 36 done 00000100:00100000:0.0:1746143774.482192:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626697344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143774.482217:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.482640:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626697344 00000100:00100000:3.0:1746143774.482644:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626697344 00000100:00100000:3.0:1746143774.482665:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11496 00000100:00100000:3.0:1746143774.482671:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626697344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.482759:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963626697344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (541us total) trans 21474840254 rc 0/0 00000100:00100000:3.0:1746143774.482764:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11496 00000004:00080000:0.0:1746143774.482821:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cc000/2, rc 0, transno 21474840254 00000100:00100000:0.0:1746143774.482825:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626697344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143774.484306:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.484860:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622388992 00000100:00100000:2.0:1746143774.484865:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622388992 00000100:00100000:2.0:1746143774.484893:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12787 00000100:00100000:2.0:1746143774.484899:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31997:x1830963622388992:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143774.484934:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.484999:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a8376 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a821 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.485045:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a8376 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a821 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.485056:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a8376 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a821 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.485069:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.485071:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143774.485074:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551800, rc 0) 00000100:00100000:2.0:1746143774.485114:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31997:x1830963622388992:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 215us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.485119:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12787 00000100:00100000:0.0:1746143774.488331:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.488384:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622389120 00000100:00100000:2.0:1746143774.488391:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622389120 00000100:00100000:2.0:1746143774.488444:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 739 00000100:00100000:2.0:1746143774.488452:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b41f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31997:x1830963622389120:12345-192.168.202.3@tcp:103:mirror_io.0 00010000:00010000:2.0:1746143774.488464:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.488511:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73a8330 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a813 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.488526:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.488530:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.488691:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b41f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31997:x1830963622389120:12345-192.168.202.3@tcp:103:mirror_io.0 Request processed in 238us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.488697:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 739 00000100:00100000:0.0:1746143774.490381:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.490439:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622389376 00000100:00100000:3.0:1746143774.490445:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622389376 00000100:00100000:3.0:1746143774.490469:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4661 00000100:00100000:3.0:1746143774.490474:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:31997:x1830963622389376:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143774.490641:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31997:x1830963622389376:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 165us (262us total) trans 8589943517 rc 0/0 00000100:00100000:3.0:1746143774.490647:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4661 00000100:00100000:0.0:1746143774.492306:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.492352:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622389632 00000100:00100000:3.0:1746143774.492357:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622389632 00000100:00100000:3.0:1746143774.492378:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4662 00000100:00100000:3.0:1746143774.492384:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:31997:x1830963622389632:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143774.492500:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:31997:x1830963622389632:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 115us (196us total) trans 8589943518 rc 0/0 00000100:00100000:3.0:1746143774.492506:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4662 00000100:00100000:0.0:1746143774.509529:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.509592:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622389888 00000100:00100000:2.0:1746143774.509601:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622389888 00000100:00100000:2.0:1746143774.509649:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12788 00000100:00100000:2.0:1746143774.509657:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:32005:x1830963622389888:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143774.509680:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.509695:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73a837d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a828 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.509753:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.509763:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.509771:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.509781:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a838b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.509785:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a838b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.509789:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a838b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.509862:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73a8392 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.509872:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73a8392 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.509878:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73a8392 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143774.509885:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143774.510003:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510010:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510015:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510020:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510025:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d550a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143774.510028:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510034:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510043:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143774.510045:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143774.510048:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510052:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510073:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a838b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510078:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a838b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510082:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a838b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510085:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143774.510087:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a838b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510091:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a838b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510096:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d700) 00010000:00010000:2.0:1746143774.510098:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143774.510100:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a838b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510104:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a838b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.510134:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73a837d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a828 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.510143:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73a8392 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a828 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.510148:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.510150:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143774.510152:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550000, rc 0) 00000100:00100000:2.0:1746143774.510204:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32005:x1830963622389888:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 547us (680us total) trans 8589943519 rc 0/0 00000100:00100000:2.0:1746143774.510209:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12788 00000100:00100000:0.0:1746143774.511755:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.513371:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622390144 00000100:00100000:2.0:1746143774.513380:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622390144 00000100:00100000:2.0:1746143774.513419:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12789 00000100:00100000:2.0:1746143774.513427:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+260:32008:x1830963622390144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.513450:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.513465:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a83a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a82f expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.513531:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513542:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513551:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513563:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a83ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513572:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a83ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513578:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a83ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513657:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513669:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513675:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143774.513683:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143774.513739:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513745:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513749:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513755:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513760:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d550800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143774.513763:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513768:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513776:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143774.513778:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143774.513781:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513785:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73a83a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513796:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a83ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513800:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a83ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513804:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a83ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513807:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d550600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143774.513809:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a83ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513812:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a83ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513816:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9dc00) 00010000:00010000:2.0:1746143774.513818:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143774.513819:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a83ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513823:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a83ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.513849:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a83a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a82f expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.513857:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a82f expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.513862:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.513864:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143774.513866:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551c00, rc 0) 00000100:00100000:2.0:1746143774.513908:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32008:x1830963622390144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 482us (2157us total) trans 8589943520 rc 0/0 00000100:00100000:2.0:1746143774.513931:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12789 00000100:00100000:0.0:1746143774.516720:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.517752:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.517809:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.519344:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622390400 00000100:00100000:2.0:1746143774.519355:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622390400 00000100:00100000:2.0:1746143774.519398:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12790 00000100:00100000:2.0:1746143774.519405:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32009:x1830963622390400:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.519424:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.519439:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a83c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a836 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.519517:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a83ca lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.519528:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a83ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.519537:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a83ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143774.519546:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143774.519625:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a83c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a836 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.519638:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a83ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a836 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.519645:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.519648:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143774.519651:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74000, rc 0) 00000100:00100000:2.0:1746143774.519689:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32009:x1830963622390400:12345-192.168.202.3@tcp:101:cat.0 Request processed in 285us (2976us total) trans 8589943521 rc 0/0 00000100:00100000:2.0:1746143774.519695:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12790 00000100:00100000:0.0:1746143774.519972:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622390528 00000100:00100000:0.0:1746143774.519977:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622390528 00000100:00100000:1.0:1746143774.520044:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622390656 00000100:00100000:1.0:1746143774.520048:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622390656 00000100:00100000:1.0:1746143774.520062:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11497 00000100:00100000:1.0:1746143774.520067:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622390528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.520075:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.520086:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d2e00/0x87925e4cb73a83d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a83d expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143774.520101:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a1e, atime: 0x68140a1e, ctime: 0x68140a1e, blocks: 0x7d8 00010000:00010000:1.0:1746143774.520111:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.520113:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.520120:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2e00/0x87925e4cb73a83d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a83d expref: 33 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.520130:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2e00/0x87925e4cb73a83d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a83d expref: 33 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.520138:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2e00, rc 0) 00000100:00100000:1.0:1746143774.520157:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622390528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 90us (2406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.520162:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11497 00000100:00100000:1.0:1746143774.520172:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11498 00000100:00100000:1.0:1746143774.520177:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963622390656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.520183:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.520191:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a83df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a844 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143774.520202:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a1e, atime: 0x68140a1e, ctime: 0x68140a1e, blocks: 0x808 00010000:00010000:1.0:1746143774.520208:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.520210:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.520213:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a83df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a844 expref: 40 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.520222:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a83df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a844 expref: 40 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.520229:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2800, rc 0) 00000100:00100000:1.0:1746143774.520240:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622390656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 63us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.520245:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11498 00000100:00100000:1.0:1746143774.520274:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.520284:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622390784 00000100:00100000:1.0:1746143774.520286:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622390784 00000100:00100000:1.0:1746143774.520297:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11499 00000100:00100000:1.0:1746143774.520302:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622390784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.520308:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.520314:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a83e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a84b expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143774.520323:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a1e, atime: 0x68140a1d, ctime: 0x68140a1e, blocks: 0x800 00010000:00010000:1.0:1746143774.520329:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.520330:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.520334:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a83e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a84b expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.520342:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a83e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a84b expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.520348:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512200, rc 0) 00000100:00100000:1.0:1746143774.520360:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622390784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 58us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.520365:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11499 00000100:00100000:1.0:1746143774.520399:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.520408:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622391040 00000100:00100000:1.0:1746143774.520411:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622391040 00000100:00100000:1.0:1746143774.520423:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11500 00000100:00100000:1.0:1746143774.520427:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622391040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.520433:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.520439:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a83ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a859 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143774.520448:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4778304, mtime: 0x68140a1e, atime: 0x68140a1e, ctime: 0x68140a1e, blocks: 0x1480 00010000:00010000:1.0:1746143774.520455:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.520456:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.520460:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a83ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a859 expref: 34 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.520468:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a83ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a859 expref: 34 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.520479:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d66400, rc 0) 00000100:00100000:1.0:1746143774.520491:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622391040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 64us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.520496:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11500 00000100:00100000:1.0:1746143774.520601:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.520609:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622390912 00000100:00100000:1.0:1746143774.520612:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622390912 00000100:00100000:1.0:1746143774.520628:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11501 00000100:00100000:1.0:1746143774.520633:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622390912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.520638:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.520645:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d67200/0x87925e4cb73a83f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a852 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143774.520654:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a1d, atime: 0x68140a1d, ctime: 0x68140a1d, blocks: 0x808 00010000:00010000:1.0:1746143774.520661:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.520662:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.520666:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d67200/0x87925e4cb73a83f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a852 expref: 35 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.520674:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d67200/0x87925e4cb73a83f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a852 expref: 35 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143774.520989:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.521046:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622391168 00000100:00100000:2.0:1746143774.521050:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622391168 00000100:00100000:2.0:1746143774.521078:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11502 00000100:00100000:2.0:1746143774.521082:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622391168:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.521089:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.521095:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73a83fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a860 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143774.521104:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a1d, atime: 0x68140a1d, ctime: 0x68140a1d, blocks: 0x1008 00010000:00010000:2.0:1746143774.521111:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.521112:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.521116:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73a83fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a860 expref: 42 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.521124:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73a83fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a860 expref: 42 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.521129:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75800, rc 0) 00000100:00100000:2.0:1746143774.521149:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963622391168:12345-192.168.202.3@tcp:101:cat.0 Request processed in 67us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.521154:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11502 00010000:00010000:1.0:1746143774.522411:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d67200, rc 0) 00000100:00100000:1.0:1746143774.522436:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622390912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1802us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.522445:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11501 00000100:00100000:0.0:1746143774.523847:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.523878:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.523934:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622391296 00000100:00100000:3.0:1746143774.523940:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622391296 00000100:00100000:0.0:1746143774.524110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.524395:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622391552 00000100:00100000:3.0:1746143774.524398:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622391552 00000100:00100000:3.0:1746143774.524416:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622391808 00000100:00100000:3.0:1746143774.524417:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622391808 00000100:00100000:3.0:1746143774.524435:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11503 00000100:00100000:3.0:1746143774.524441:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622391296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.524452:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.524465:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8402 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a867 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.524481:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.524483:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.524488:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8402 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a867 expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.524500:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8402 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a867 expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.524507:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9c00, rc 0) 00000100:00100000:3.0:1746143774.524532:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622391296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 91us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.524537:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11503 00000100:00100000:3.0:1746143774.524547:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11504 00000100:00100000:3.0:1746143774.524551:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622391552:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.524556:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.524563:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73a8409 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a875 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.524570:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.524572:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.524575:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73a8409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a875 expref: 18 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.524583:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73a8409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a875 expref: 18 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.524588:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8400, rc 0) 00000100:00100000:3.0:1746143774.524598:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622391552:12345-192.168.202.3@tcp:101:cat.0 Request processed in 47us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.524602:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11504 00000100:00100000:3.0:1746143774.524608:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11505 00000100:00100000:3.0:1746143774.524611:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622391808:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.524615:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.524619:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a883 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.524626:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.524627:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.524630:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.524636:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.524641:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9800, rc 0) 00000100:00100000:3.0:1746143774.524649:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622391808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 37us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.524656:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11505 00000100:00100000:0.0:1746143774.524782:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.524823:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.525021:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622391424 00000100:00100000:1.0:1746143774.525026:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622391424 00000100:00100000:1.0:1746143774.525036:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622391680 00000100:00100000:1.0:1746143774.525038:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622391680 00000100:00100000:1.0:1746143774.525055:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11506 00000100:00100000:1.0:1746143774.525059:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622391680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.525065:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.525072:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a8417 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a87c expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.525081:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.525082:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.525086:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a8417 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a87c expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.525093:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a8417 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a87c expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.525099:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5aa400, rc 0) 00000100:00100000:1.0:1746143774.525449:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622391680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 388us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.525454:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11506 00000100:00100000:1.0:1746143774.525481:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11507 00000100:00100000:1.0:1746143774.525485:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622391424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.525491:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.525498:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a841e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a86e expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.525507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143774.525508:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.525509:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.525513:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a841e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a86e expref: 19 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.525522:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a841e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a86e expref: 19 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.525528:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368dac00, rc 0) 00000100:00100000:1.0:1746143774.525541:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622391424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 56us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.525546:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11507 00000100:00100000:1.0:1746143774.525554:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622391936 00000100:00100000:1.0:1746143774.525557:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622391936 00000100:00100000:1.0:1746143774.525580:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11508 00000100:00100000:1.0:1746143774.525585:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622391936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.525591:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.525597:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73a8425 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a88a expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143774.526218:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143774.526241:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.526243:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.526248:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73a8425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a88a expref: 20 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.526258:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73a8425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a88a expref: 20 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.526265:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368da400, rc 0) 00000100:00100000:2.0:1746143774.526292:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622392192 00000100:00100000:2.0:1746143774.526295:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622392192 00000100:00100000:1.0:1746143774.526298:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622391936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 713us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.526303:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11508 00000100:00100000:2.0:1746143774.526324:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12791 00000100:00100000:2.0:1746143774.526328:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:32003:x1830963622392192:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143774.526339:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.526347:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a842c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a891 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.526517:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.526527:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73a8392 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a828 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.526534:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a82f expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.526540:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.526561:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a82f expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.526571:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a82f expref: 263 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.526581:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626697472:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.527364:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73a8392 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a828 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.527376:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73a8392 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a828 expref: 10 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.527384:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626697600:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143774.527409:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.531617:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.531782:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622392448 00000100:00100000:2.0:1746143774.531790:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622392448 00000100:00100000:2.0:1746143774.532100:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12792 00000100:00100000:2.0:1746143774.532110:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32005:x1830963622392448:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143774.532131:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.532134:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746143774.532157:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a83ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a836 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.532180:0:6587:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73a8392 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a828 expref: 10 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.532191:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.532195:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.532201:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.532206:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143774.532216:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a843a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a898 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.532258:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.532267:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a8376 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a821 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.532273:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.533329:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a8376 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a821 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.533343:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a8376 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a821 expref: 8 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.533355:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626697728:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143774.534979:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.534983:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.535263:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622392704 00000100:00100000:3.0:1746143774.535270:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622392704 00002000:00100000:3.0:1746143774.535302:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012b7e3b80 x1830963622392704/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.535311:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e3b80 with x1830963622392704 ext(0->1048575) 00002000:00010000:3.0:1746143774.535315:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7e3b80 00000100:00100000:3.0:1746143774.535338:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3246 00000100:00100000:3.0:1746143774.535344:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622392704:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143774.536766:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.536785:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622392832 00000100:00100000:2.0:1746143774.536790:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622392832 00010000:00010000:2.0:1746143774.536814:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a82f expref: 264 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.536846:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5396 00000100:00100000:2.0:1746143774.536852:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:2010:x1830963622392832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.536861:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.536866:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a82f expref: 264 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.536881:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a82f expref: 264 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.536899:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.536903:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.536929:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.536935:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143774.536941:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.536955:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.536969:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.536992:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:2010:x1830963622392832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 139us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.536998:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5396 00010000:00010000:3.0:1746143774.537096:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551c00/0x87925e4cb73a83b5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a82f expref: 263 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.537110:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626697472:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.537122:0:7245:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from blocking AST (req@ffff880092ef1880 x1830963626697600) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73a8392 lrc: 1/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a828 expref: 11 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.537131:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73a8392 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a828 expref: 11 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.537138:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626697600:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.537151:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.537154:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.537159:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.537166:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143774.537173:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143774.537177:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143774.537193:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143774.537293:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a842c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a891 expref: 264 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.537304:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a891 expref: 263 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.537310:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.537312:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143774.537314:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75000, rc 0) 00000100:00100000:3.0:1746143774.537427:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:32003:x1830963622392192:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11097us (11209us total) trans 8589943522 rc 0/0 00000100:00100000:3.0:1746143774.537433:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12791 00000100:00100000:0.0:1746143774.544639:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.544668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.544682:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.544708:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.544964:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622393216 00000100:00100000:2.0:1746143774.544972:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622393216 00002000:00100000:2.0:1746143774.545006:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b7e3800 x1830963622393216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.545015:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e3800 with x1830963622393216 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.545020:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e3800 00000100:00100000:2.0:1746143774.545035:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622393472 00000100:00100000:2.0:1746143774.545037:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622393472 00002000:00100000:2.0:1746143774.545045:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012b7e0e00 x1830963622393472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.545052:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e0e00 with x1830963622393472 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.545055:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e0e00 00000100:00100000:2.0:1746143774.545062:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622393728 00000100:00100000:2.0:1746143774.545064:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622393728 00002000:00100000:2.0:1746143774.545074:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095c30380 x1830963622393728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.545080:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30380 with x1830963622393728 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.545083:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c30380 00000100:00100000:2.0:1746143774.545092:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3247 00000100:00100000:2.0:1746143774.545098:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622393216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143774.545718:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622392960 00000100:00100000:1.0:1746143774.545722:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622392960 00010000:00010000:1.0:1746143774.545738:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a8376 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a821 expref: 9 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.546268:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3248 00000100:00100000:3.0:1746143774.546277:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622393472:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143774.546399:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3249 00000100:00100000:0.0:1746143774.546405:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622393728:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143774.546896:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622392704:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11551us (11915us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.546903:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3246 00002000:00100000:3.0:1746143774.546928:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012b7e3b80 x1830963622392704/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.546936:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e3b80 with x1830963622392704 ext(0->1048575) 00002000:00010000:3.0:1746143774.546940:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7e3b80 00000100:00100000:1.0:1746143774.547527:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5397 00000100:00100000:1.0:1746143774.547535:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622392960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143774.547547:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143774.547553:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a8376 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a821 expref: 9 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.547563:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a8376 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a821 expref: 9 pid: 6587 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.547581:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143774.547585:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143774.547593:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143774.547598:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143774.547614:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143774.547631:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622392960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 96us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.547635:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5397 00000100:00100000:1.0:1746143774.547679:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.548076:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622393984 00000100:00100000:2.0:1746143774.548082:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622393984 00002000:00100000:2.0:1746143774.548105:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880096fdb100 x1830963622393984/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.548112:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fdb100 with x1830963622393984 ext(0->1048575) 00002000:00010000:2.0:1746143774.548116:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fdb100 00000100:00100000:2.0:1746143774.548126:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3250 00000100:00100000:2.0:1746143774.548131:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622393984:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143774.548624:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.548654:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.548681:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143774.549940:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73a8376 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a821 expref: 8 pid: 6587 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.549976:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626697728:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.549989:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.549996:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.550000:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143774.550130:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622394240 00000100:00100000:3.0:1746143774.550134:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622394240 00002000:00100000:3.0:1746143774.550160:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095c32d80 x1830963622394240/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.550167:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32d80 with x1830963622394240 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.550170:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c32d80 00000100:00100000:3.0:1746143774.550184:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622394496 00000100:00100000:3.0:1746143774.550186:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622394496 00002000:00100000:3.0:1746143774.550195:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095c33b80 x1830963622394496/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.550201:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33b80 with x1830963622394496 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.550204:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c33b80 00000100:00100000:3.0:1746143774.550219:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622394752 00000100:00100000:3.0:1746143774.550221:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622394752 00002000:00100000:3.0:1746143774.550232:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095c33800 x1830963622394752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.550238:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33800 with x1830963622394752 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.550240:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c33800 00000100:00100000:3.0:1746143774.550258:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3251 00000100:00100000:3.0:1746143774.550264:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622394240:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143774.550319:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3252 00000100:00100000:1.0:1746143774.550325:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622394496:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143774.550814:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3253 00000100:00100000:3.0:1746143774.550820:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622394752:12345-192.168.202.3@tcp:3:multiop.0 00000040:00080000:2.0:1746143774.553005:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2608, 88 off217216 00000004:00080000:2.0:1746143774.553017:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833777104085ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143774.553068:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2577, 88 off214840 00000004:00080000:2.0:1746143774.553071:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833777159175ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143774.553092:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2578, 88 off214928 00000004:00080000:2.0:1746143774.553095:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833777183025ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143774.553109:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2609, 88 off217304 00000004:00080000:2.0:1746143774.553111:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833777199241ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143774.553119:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2610, 88 off217392 00000004:00080000:2.0:1746143774.553121:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833777209158ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143774.553128:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2579, 88 off215016 00000004:00080000:2.0:1746143774.553131:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833777218533ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143774.553138:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2580, 88 off215104 00000004:00080000:2.0:1746143774.553141:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833777228735ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143774.553148:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2581, 88 off215192 00000004:00080000:2.0:1746143774.553150:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833777238191ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143774.553157:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2611, 88 off217480 00000004:00080000:2.0:1746143774.553161:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833777248393ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143774.553167:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2582, 88 off215280 00000004:00080000:2.0:1746143774.553169:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833777257404ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143774.553177:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2612, 88 off217568 00000004:00080000:2.0:1746143774.553179:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833777267150ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143774.553186:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2583, 88 off215368 00000004:00080000:2.0:1746143774.553188:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833777276003ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143774.553195:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2613, 88 off217656 00000004:00080000:2.0:1746143774.553197:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833777284951ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143774.553204:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2614, 88 off217744 00000004:00080000:2.0:1746143774.553207:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833777294658ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143774.553213:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2615, 88 off217832 00000004:00080000:2.0:1746143774.553215:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833777303081ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143774.553221:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2616, 88 off217920 00000004:00080000:2.0:1746143774.553223:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 833777311390ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143774.553230:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2584, 88 off215456 00000004:00080000:2.0:1746143774.553232:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 833777320290ns, next at 770855090093ns, rc = 0 00000100:00100000:2.0:1746143774.557838:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.558043:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622393216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12942us (13372us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143774.558052:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3247 00002000:00100000:2.0:1746143774.558061:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b7e3800 x1830963622393216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.558068:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e3800 with x1830963622393216 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.558073:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e3800 00000100:00100000:3.0:1746143774.558254:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622394880 00000100:00100000:3.0:1746143774.558260:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622394880 00000100:00100000:3.0:1746143774.558754:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12793 00000100:00100000:3.0:1746143774.558761:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:32008:x1830963622394880:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.558778:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.558793:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a89f expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.558836:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.558844:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 264 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.558858:0:7245:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143774.558868:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 264 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.558878:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.558880:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143774.558883:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 264 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.558889:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7d000, rc 0) 00000001:00080000:0.0:1746143774.559064:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943523 is committed 00000004:00080000:0.0:1746143774.559070:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1814 committed 00000004:00080000:0.0:1746143774.559076:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1844 committed 00000004:00080000:0.0:1746143774.559086:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1843 committed 00000004:00080000:0.0:1746143774.559087:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1842 committed 00000004:00080000:0.0:1746143774.559089:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1841 committed 00000004:00080000:0.0:1746143774.559090:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1813 committed 00000004:00080000:0.0:1746143774.559092:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1840 committed 00000004:00080000:0.0:1746143774.559093:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1812 committed 00000004:00080000:0.0:1746143774.559094:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1839 committed 00000004:00080000:0.0:1746143774.559095:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1811 committed 00000004:00080000:0.0:1746143774.559096:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1810 committed 00000004:00080000:0.0:1746143774.559098:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1809 committed 00000004:00080000:0.0:1746143774.559100:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1838 committed 00000004:00080000:0.0:1746143774.559101:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1837 committed 00000004:00080000:0.0:1746143774.559102:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1808 committed 00000004:00080000:0.0:1746143774.559103:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1807 committed 00000004:00080000:0.0:1746143774.559105:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1836 committed 00000001:00080000:0.0:1746143774.559108:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943522 is committed 00000001:00080000:0.0:1746143774.559116:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943518 is committed 00000100:00100000:3.0:1746143774.559872:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:32008:x1830963622394880:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1108us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.559881:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12793 00000100:00100000:3.0:1746143774.560014:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626698112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.560048:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.560067:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626698624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.560080:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.560093:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746143774.560097:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626697984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.560108:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.560118:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626698496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.560128:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.560146:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626698112 00000100:00100000:3.0:1746143774.560150:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626698112 00000100:00100000:3.0:1746143774.560169:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626698624 00000100:00100000:3.0:1746143774.560171:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626698624 00000100:00100000:3.0:1746143774.560178:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626697984 00000100:00100000:3.0:1746143774.560180:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626697984 00000100:00100000:3.0:1746143774.560187:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626698496 00000100:00100000:3.0:1746143774.560188:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626698496 00000100:00100000:3.0:1746143774.560197:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11509 00000100:00100000:3.0:1746143774.560202:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963626698112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143774.560299:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4778304 -> 4778304 00002000:00010000:3.0:1746143774.560302:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143774 -> 1746143774 00002000:00010000:3.0:1746143774.560304:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143774 -> 1746143774 00002000:00010000:3.0:1746143774.560306:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143774 -> 1746143774 00002000:00010000:3.0:1746143774.560308:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5248 -> 5248 00000100:00100000:3.0:1746143774.560328:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963626698112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (279us total) trans 21474840255 rc 0/0 00000100:00100000:3.0:1746143774.560333:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11509 00000100:00100000:3.0:1746143774.560343:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11510 00000100:00100000:3.0:1746143774.560347:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963626698624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143774.560382:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143774.560384:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143774.560386:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143774.560388:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143774.560390:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143774.560405:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963626698624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (324us total) trans 21474840256 rc 0/0 00000100:00100000:3.0:1746143774.560410:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11510 00000100:00100000:3.0:1746143774.560418:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11511 00000100:00100000:3.0:1746143774.560422:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963626697984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143774.560453:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143774.560455:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143773 -> 1746143773 00002000:00010000:3.0:1746143774.560457:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143773 -> 1746143773 00002000:00010000:3.0:1746143774.560459:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143773 -> 1746143773 00002000:00010000:3.0:1746143774.560460:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143774.560475:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963626697984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (366us total) trans 21474840257 rc 0/0 00000100:00100000:3.0:1746143774.560480:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11511 00000100:00100000:3.0:1746143774.560487:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11512 00000100:00100000:3.0:1746143774.560491:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963626698496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.560531:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963626698496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (401us total) trans 21474840258 rc 0/0 00000100:00100000:3.0:1746143774.560536:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11512 00000004:00080000:3.0:1746143774.560560:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cd180/2, rc 0, transno 21474840257 00000100:00100000:3.0:1746143774.560566:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626697984:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143774.560572:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cf800/2, rc 0, transno 21474840258 00000100:00100000:3.0:1746143774.560575:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626698496:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143774.560580:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cf100/2, rc 0, transno 21474840255 00000100:00100000:3.0:1746143774.560583:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626698112:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143774.560588:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921ce300/2, rc 0, transno 21474840256 00000100:00100000:3.0:1746143774.560590:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626698624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143774.560772:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626697856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143774.560794:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143774.560807:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626698368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143774.560818:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143774.560826:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626698880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143774.560836:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143774.560846:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143774.560850:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626698240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143774.560861:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143774.560871:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626698752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143774.560883:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143774.560898:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626697856 00000100:00100000:1.0:1746143774.560901:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626697856 00000100:00100000:1.0:1746143774.560932:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626698368 00000100:00100000:1.0:1746143774.560934:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626698368 00000100:00100000:1.0:1746143774.560944:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626698880 00000100:00100000:1.0:1746143774.560945:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626698880 00000100:00100000:2.0:1746143774.561458:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626698240 00000100:00100000:2.0:1746143774.561463:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626698240 00000100:00100000:2.0:1746143774.561477:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626698752 00000100:00100000:2.0:1746143774.561478:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626698752 00000100:00100000:2.0:1746143774.561486:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11513 00000100:00100000:2.0:1746143774.561490:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963626697856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143774.561547:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143774.561550:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143774 -> 1746143774 00002000:00010000:2.0:1746143774.561552:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143774 -> 1746143774 00002000:00010000:2.0:1746143774.561553:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143774 -> 1746143774 00002000:00010000:2.0:1746143774.561554:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:2.0:1746143774.561580:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963626697856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (785us total) trans 21474840259 rc 0/0 00000100:00100000:2.0:1746143774.561585:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11513 00000100:00100000:2.0:1746143774.561596:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11514 00000100:00100000:2.0:1746143774.561600:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963626698368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.561654:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963626698368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (835us total) trans 21474840260 rc 0/0 00000100:00100000:2.0:1746143774.561658:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11514 00000100:00100000:2.0:1746143774.561667:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11515 00000100:00100000:2.0:1746143774.561671:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963626698240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.561720:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963626698240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (857us total) trans 21474840261 rc 0/0 00000100:00100000:2.0:1746143774.561724:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11515 00000100:00100000:2.0:1746143774.561733:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11516 00000100:00100000:2.0:1746143774.561737:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963626698752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.561783:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963626698752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (898us total) trans 21474840262 rc 0/0 00000100:00100000:2.0:1746143774.561787:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11516 00000100:00100000:1.0:1746143774.562006:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11517 00000100:00100000:1.0:1746143774.562011:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963626698880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143774.562070:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3774:x1830963626698880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (1232us total) trans 21474840263 rc 0/0 00000100:00100000:1.0:1746143774.562075:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11517 00000004:00080000:1.0:1746143774.562104:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cd880/2, rc 0, transno 21474840261 00000100:00100000:1.0:1746143774.562108:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626698240:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143774.562114:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb5c00/2, rc 0, transno 21474840262 00000100:00100000:1.0:1746143774.562116:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626698752:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143774.562124:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cf480/2, rc 0, transno 21474840259 00000100:00100000:1.0:1746143774.562126:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626697856:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143774.562131:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cdf80/2, rc 0, transno 21474840260 00000100:00100000:1.0:1746143774.562133:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626698368:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143774.562137:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb4380/2, rc 0, transno 21474840263 00000100:00100000:1.0:1746143774.562139:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626698880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143774.565698:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626699264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.565746:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.565764:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626699776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.565777:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.565789:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143774.565793:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626699392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.565806:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.565817:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626699904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.565828:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.565846:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626699264 00000100:00100000:0.0:1746143774.565851:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626699264 00000100:00100000:0.0:1746143774.565873:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626699776 00000100:00100000:0.0:1746143774.565875:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626699776 00000100:00100000:0.0:1746143774.565883:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626699392 00000100:00100000:0.0:1746143774.565884:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626699392 00000100:00100000:0.0:1746143774.565892:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626699904 00000100:00100000:0.0:1746143774.565893:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626699904 00000100:00100000:0.0:1746143774.565904:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11518 00000100:00100000:0.0:1746143774.565908:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3773:x1830963626699264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143774.566037:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143774.566040:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143773 -> 1746143773 00002000:00010000:0.0:1746143774.566041:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143773 -> 1746143773 00002000:00010000:0.0:1746143774.566043:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143773 -> 1746143773 00002000:00010000:0.0:1746143774.566045:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143774.566069:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626699264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (323us total) trans 17179872935 rc 0/0 00000100:00100000:0.0:1746143774.566074:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11518 00000100:00100000:0.0:1746143774.566086:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11519 00000100:00100000:0.0:1746143774.566089:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3773:x1830963626699776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.566131:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626699776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (353us total) trans 17179872936 rc 0/0 00000100:00100000:0.0:1746143774.566135:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11519 00000100:00100000:0.0:1746143774.566142:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11520 00000100:00100000:0.0:1746143774.566145:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3773:x1830963626699392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143774.566172:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143774.566174:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143774.566176:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:0.0:1746143774.566177:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143774.566179:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143774.566190:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626699392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (383us total) trans 17179872937 rc 0/0 00000100:00100000:0.0:1746143774.566194:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11520 00000100:00100000:0.0:1746143774.566199:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11521 00000100:00100000:0.0:1746143774.566202:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3773:x1830963626699904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.566233:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626699904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 30us (404us total) trans 17179872938 rc 0/0 00000100:00100000:0.0:1746143774.566237:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11521 00000004:00080000:0.0:1746143774.566260:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c32300/2, rc 0, transno 17179872937 00000100:00100000:0.0:1746143774.566264:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626699392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143774.566269:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c32680/2, rc 0, transno 17179872938 00000100:00100000:0.0:1746143774.566271:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626699904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143774.566276:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c32a00/2, rc 0, transno 17179872935 00000100:00100000:0.0:1746143774.566278:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626699264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143774.566282:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c30a80/2, rc 0, transno 17179872936 00000100:00100000:0.0:1746143774.566284:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626699776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.566353:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626699008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.566372:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.566382:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626699520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.566391:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.566398:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746143774.566401:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626699136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.566410:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.566416:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626699648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.566426:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.566441:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626699008 00000100:00100000:3.0:1746143774.566444:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626699008 00000100:00100000:3.0:1746143774.566460:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626699520 00000100:00100000:3.0:1746143774.566461:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626699520 00000100:00100000:3.0:1746143774.566468:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626699136 00000100:00100000:3.0:1746143774.566469:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626699136 00000100:00100000:3.0:1746143774.566474:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626699648 00000100:00100000:3.0:1746143774.566476:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626699648 00000100:00100000:3.0:1746143774.566482:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11522 00000100:00100000:3.0:1746143774.566485:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626699008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143774.566521:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143774.566523:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143774 -> 1746143774 00002000:00010000:3.0:1746143774.566525:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143774 -> 1746143774 00002000:00010000:3.0:1746143774.566526:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143774 -> 1746143774 00002000:00010000:3.0:1746143774.566528:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143774.566546:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626699008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (173us total) trans 17179872939 rc 0/0 00000100:00100000:3.0:1746143774.566550:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11522 00000100:00100000:3.0:1746143774.566560:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11523 00000100:00100000:3.0:1746143774.566564:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626699520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143774.566598:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143774.566600:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143774.566602:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143774.566604:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143774.566605:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746143774.566621:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626699520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (229us total) trans 17179872940 rc 0/0 00000100:00100000:3.0:1746143774.566626:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11523 00000100:00100000:3.0:1746143774.566633:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11524 00000100:00100000:3.0:1746143774.566637:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626699136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143774.566666:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143774.566668:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143774 -> 1746143774 00002000:00010000:3.0:1746143774.566669:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143773 -> 1746143773 00002000:00010000:3.0:1746143774.566671:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143774 -> 1746143774 00002000:00010000:3.0:1746143774.566673:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746143774.566685:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626699136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (274us total) trans 17179872941 rc 0/0 00000100:00100000:3.0:1746143774.566689:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11524 00000100:00100000:3.0:1746143774.566697:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11525 00000100:00100000:3.0:1746143774.566700:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626699648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.566732:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626699648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 32us (305us total) trans 17179872942 rc 0/0 00000100:00100000:3.0:1746143774.566737:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11525 00000004:00080000:3.0:1746143774.566754:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c31880/2, rc 0, transno 17179872941 00000100:00100000:3.0:1746143774.566757:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626699136:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143774.566762:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c30e00/2, rc 0, transno 17179872942 00000100:00100000:3.0:1746143774.566765:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626699648:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143774.566770:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c30700/2, rc 0, transno 17179872939 00000100:00100000:3.0:1746143774.566772:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626699008:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143774.566776:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c31180/2, rc 0, transno 17179872940 00000100:00100000:3.0:1746143774.566778:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626699520:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143774.567528:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a898 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.567538:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.567541:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143774.567544:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.567552:0:6587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.567559:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.567583:0:6587:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.567592:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626700032:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.567642:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143774.567976:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622393472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21699us (23291us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143774.567984:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3248 00002000:00100000:2.0:1746143774.567992:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012b7e0e00 x1830963622393472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.568001:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e0e00 with x1830963622393472 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.568005:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e0e00 00000100:00100000:2.0:1746143774.575604:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622393728:12345-192.168.202.3@tcp:3:cat.0 Request processed in 29191us (30887us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143774.575615:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3249 00002000:00100000:2.0:1746143774.575625:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095c30380 x1830963622393728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.575633:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30380 with x1830963622393728 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.575639:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c30380 00000100:00100000:3.0:1746143774.585211:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622393984:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 37069us (37522us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.585223:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3250 00002000:00100000:3.0:1746143774.585233:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880096fdb100 x1830963622393984/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.585241:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fdb100 with x1830963622393984 ext(0->1048575) 00002000:00010000:3.0:1746143774.585248:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fdb100 00000100:00100000:2.0:1746143774.585275:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626700032:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.585306:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a843a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a898 expref: 9 pid: 6587 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746143774.585338:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a898 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.585362:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550600, rc 0) 00000100:00100000:2.0:1746143774.585388:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32005:x1830963622392448:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 53280us (53778us total) trans 8589943523 rc 0/0 00000100:00100000:2.0:1746143774.585394:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12792 00000100:00100000:2.0:1746143774.585425:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.585486:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.585498:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622395136 00000100:00100000:2.0:1746143774.585502:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622395136 00000100:00100000:2.0:1746143774.585528:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12794 00000100:00100000:2.0:1746143774.585533:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32003:x1830963622395136:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143774.585546:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.585557:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8456 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8a6 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.585587:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8456 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8a6 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.585597:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8456 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8a6 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.585606:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.585609:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143774.585611:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550a00, rc 0) 00000100:00100000:2.0:1746143774.585642:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:32003:x1830963622395136:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 110us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.585648:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12794 00000100:00100000:3.0:1746143774.585732:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622395008 00000100:00100000:3.0:1746143774.585736:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622395008 00000100:00100000:3.0:1746143774.585769:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4663 00000100:00100000:3.0:1746143774.585774:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:32008:x1830963622395008:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:3.0:1746143774.585824:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:32008:x1830963622395008:12345-192.168.202.3@tcp:49:cat.0 Request processed in 49us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.585829:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4663 00000100:00100000:3.0:1746143774.587476:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622394240:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 37208us (38847us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143774.587477:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622394496:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 37150us (38820us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.587483:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3251 00002000:00100000:3.0:1746143774.587491:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095c32d80 x1830963622394240/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143774.587494:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3252 00002000:00100000:3.0:1746143774.587498:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32d80 with x1830963622394240 ext(1048576->2097151) 00002000:00100000:1.0:1746143774.587499:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095c33b80 x1830963622394496/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00010000:3.0:1746143774.587503:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c32d80 00002000:00100000:1.0:1746143774.587506:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33b80 with x1830963622394496 ext(1048576->2097151) 00002000:00010000:1.0:1746143774.587509:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c33b80 00000100:00100000:3.0:1746143774.590827:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622394752:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 40000us (42138us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.590837:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3253 00002000:00100000:3.0:1746143774.590849:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095c33800 x1830963622394752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.590857:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33800 with x1830963622394752 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.590861:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c33800 00000100:00100000:0.0:1746143774.601749:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.601797:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.601857:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622395392 00000100:00100000:2.0:1746143774.601866:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622395392 00000100:00100000:3.0:1746143774.601877:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622395264 00000100:00100000:3.0:1746143774.601880:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622395264 00000100:00100000:2.0:1746143774.601931:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4664 00000100:00100000:2.0:1746143774.601939:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:32003:x1830963622395392:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:2.0:1746143774.602082:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:32003:x1830963622395392:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 144us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.602089:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4664 00000100:00100000:2.0:1746143774.602111:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12795 00000100:00100000:2.0:1746143774.602116:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32009:x1830963622395264:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.602125:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.602138:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a845d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8ad expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.602175:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a845d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ad expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.602186:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a845d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ad expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.602199:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.602201:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143774.602204:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550e00, rc 0) 00000100:00100000:2.0:1746143774.602235:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32009:x1830963622395264:12345-192.168.202.3@tcp:101:cat.0 Request processed in 119us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.602240:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12795 00000100:00100000:0.0:1746143774.609428:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.609520:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.609662:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622395648 00000100:00100000:3.0:1746143774.609671:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622395648 00000100:00100000:3.0:1746143774.609708:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11526 00000100:00100000:3.0:1746143774.609720:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:32005:x1830963622395648:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143774.609734:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.609749:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8b4 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.609772:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73a83fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a860 expref: 41 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.609779:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73a8425 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a88a expref: 21 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.609784:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.609786:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.609789:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3866624->4194303] (req 3866624->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.609810:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73a8425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a88a expref: 21 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.609821:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73a8425 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a88a expref: 21 pid: 3135 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.609830:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626700160:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.609929:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73a83fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a860 expref: 41 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.609942:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73a83fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a860 expref: 41 pid: 9585 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.609974:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626700288:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.610003:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143774.610369:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622395520 00000100:00100000:2.0:1746143774.610377:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622395520 00000100:00100000:2.0:1746143774.610462:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 740 00000100:00100000:2.0:1746143774.610468:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2009:x1830963622395520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.610477:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.610492:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73a8456 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8a6 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143774.611399:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.611460:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622395776 00000100:00100000:1.0:1746143774.611464:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622395776 00000100:00100000:1.0:1746143774.611498:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 741 00000100:00100000:1.0:1746143774.611503:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622395776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143774.611513:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143774.611528:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73a845d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ad expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.611548:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143774.611551:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143774.611580:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622395776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.611586:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 741 00010000:00010000:2.0:1746143774.612525:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.612529:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.613176:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2009:x1830963622395520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2705us (3752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.613183:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 740 00000100:00100000:0.0:1746143774.616417:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.617539:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.617594:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.617640:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.617995:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622396160 00000100:00100000:2.0:1746143774.618003:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622396160 00002000:00100000:2.0:1746143774.618041:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092a52680 x1830963622396160/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.618049:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a52680 with x1830963622396160 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.618054:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a52680 00000100:00100000:2.0:1746143774.618068:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622396288 00000100:00100000:2.0:1746143774.618070:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622396288 00002000:00100000:2.0:1746143774.618078:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092a52300 x1830963622396288/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.618084:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a52300 with x1830963622396288 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.618087:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a52300 00000100:00100000:2.0:1746143774.618093:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622396544 00000100:00100000:2.0:1746143774.618095:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622396544 00002000:00100000:2.0:1746143774.618102:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092a53800 x1830963622396544/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.618108:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a53800 with x1830963622396544 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.618111:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a53800 00000100:00100000:2.0:1746143774.618120:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3254 00000100:00100000:2.0:1746143774.618127:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622396160:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143774.618712:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3255 00000100:00100000:3.0:1746143774.618720:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622396288:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143774.619301:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.619368:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3256 00000100:00100000:1.0:1746143774.619376:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622396544:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143774.620706:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622396800 00000100:00100000:2.0:1746143774.620712:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622396800 00010000:00010000:2.0:1746143774.620736:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73a83fb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a860 expref: 42 pid: 9585 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.620754:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622396672 00000100:00100000:2.0:1746143774.620756:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622396672 00010000:00010000:2.0:1746143774.620764:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73a8425 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a88a expref: 26 pid: 3135 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.620774:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5398 00000100:00100000:2.0:1746143774.620779:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963622396800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.620787:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.620799:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73a83fb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a860 expref: 42 pid: 9585 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.620808:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73a83fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a860 expref: 42 pid: 9585 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.620826:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.620905:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626700160:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.620975:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73a83fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a860 expref: 42 pid: 9585 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.620990:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626700288:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.621011:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3866624->4194303] (req 3866624->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 26 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.621019:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504600, rc 0) 00000100:00100000:3.0:1746143774.621040:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:32005:x1830963622395648:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11321us (11520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.621047:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11526 00000100:00100000:2.0:1746143774.621154:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622396800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 374us (3512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.621159:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5398 00000100:00100000:2.0:1746143774.621171:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5399 00000100:00100000:2.0:1746143774.621175:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622396672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.621181:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.621187:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73a8425 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a88a expref: 25 pid: 3135 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.621194:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73a8425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a88a expref: 25 pid: 3135 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.621204:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73a8425 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a88a expref: 25 pid: 3135 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.621212:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.621214:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.621219:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.621225:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.621245:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.621253:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626700416:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.621287:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143774.625136:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.625170:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.625184:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.625201:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622397184 00000100:00100000:2.0:1746143774.625208:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622397184 00002000:00100000:2.0:1746143774.625244:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092ef2300 x1830963622397184/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.625252:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2300 with x1830963622397184 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.625257:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef2300 00000100:00100000:2.0:1746143774.625270:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622397440 00000100:00100000:2.0:1746143774.625273:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622397440 00002000:00100000:2.0:1746143774.625282:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092ef2680 x1830963622397440/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.625292:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2680 with x1830963622397440 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.625294:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef2680 00000100:00100000:2.0:1746143774.625305:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3257 00000100:00100000:2.0:1746143774.625311:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622397184:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143774.626014:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3258 00000100:00100000:2.0:1746143774.626022:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622397440:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143774.626556:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.626571:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622397696 00000100:00100000:2.0:1746143774.626574:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622397696 00002000:00100000:2.0:1746143774.626593:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092ef2a00 x1830963622397696/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.626599:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2a00 with x1830963622397696 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.626603:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef2a00 00000100:00100000:2.0:1746143774.626616:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3259 00000100:00100000:2.0:1746143774.626621:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622397696:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143774.627007:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622396928 00000100:00100000:3.0:1746143774.627012:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622396928 00000100:00100000:3.0:1746143774.627034:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11527 00000100:00100000:3.0:1746143774.627039:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:32003:x1830963622396928:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143774.627047:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.627061:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8bb expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.627080:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.627087:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143774.627089:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143774.627092:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2891776->3145727] (req 2891776->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 46 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.627115:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.627125:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 24 pid: 1947 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.627135:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626700544:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.627182:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143774.627307:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.627319:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622397952 00000100:00100000:3.0:1746143774.627321:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622397952 00002000:00100000:3.0:1746143774.627335:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3866624->3870719) req@ffff88012457c380 x1830963622397952/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.627341:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c380 with x1830963622397952 ext(3866624->3870719) 00010000:00010000:3.0:1746143774.627345:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 25 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.627354:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 25 pid: 1947 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.627359:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012457c380 00000100:00100000:3.0:1746143774.627370:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1383 00000100:00100000:3.0:1746143774.627374:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622397952:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143774.627427:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622397952:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 52us (121us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143774.627432:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1383 00002000:00100000:3.0:1746143774.627436:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3866624->3870719) req@ffff88012457c380 x1830963622397952/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.627441:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c380 with x1830963622397952 ext(3866624->3870719) 00010000:00010000:3.0:1746143774.627444:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 25 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.627451:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 25 pid: 1947 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.627456:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012457c380 00000100:00100000:0.0:1746143774.631081:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626700416:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143774.631101:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.631150:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622396672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9973us (11849us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.631159:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5399 00000100:00100000:3.0:1746143774.637036:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626700544:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.637062:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2891776->3145727] (req 2891776->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 46 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.637083:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084800, rc 0) 00000100:00100000:3.0:1746143774.637136:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:32003:x1830963622396928:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10095us (12007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.637143:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11527 00000100:00100000:3.0:1746143774.642656:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963622396160:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 24521us (26237us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.642667:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3254 00002000:00100000:3.0:1746143774.642676:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092a52680 x1830963622396160/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.642685:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a52680 with x1830963622396160 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.642689:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a52680 00000100:00100000:2.0:1746143774.646889:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2010:x1830963622396288:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 28162us (29343us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143774.646899:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3255 00002000:00100000:2.0:1746143774.646908:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092a52300 x1830963622396288/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.646929:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a52300 with x1830963622396288 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.646935:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a52300 00000100:00100000:1.0:1746143774.651862:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622396544:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 32479us (34258us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143774.651872:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3256 00002000:00100000:1.0:1746143774.651881:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092a53800 x1830963622396544/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.651890:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a53800 with x1830963622396544 ext(1048576->2097151) 00002000:00010000:1.0:1746143774.651894:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a53800 00000100:00100000:2.0:1746143774.653673:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622397184:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 28356us (28496us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143774.653682:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3257 00002000:00100000:2.0:1746143774.653689:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092ef2300 x1830963622397184/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.653697:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2300 with x1830963622397184 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.653701:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef2300 00000100:00100000:2.0:1746143774.658812:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622397440:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 32785us (33619us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143774.658822:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3258 00002000:00100000:2.0:1746143774.658831:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092ef2680 x1830963622397440/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.658840:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2680 with x1830963622397440 ext(1048576->2097151) 00002000:00010000:2.0:1746143774.658844:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef2680 00000100:00100000:3.0:1746143774.660261:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622397696:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 33636us (33702us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.660268:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3259 00002000:00100000:3.0:1746143774.660274:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092ef2a00 x1830963622397696/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.660281:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2a00 with x1830963622397696 ext(1048576->2097151) 00002000:00010000:3.0:1746143774.660285:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef2a00 00000100:00100000:0.0:1746143774.665955:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.668353:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622398208 00000100:00100000:3.0:1746143774.668362:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622398208 00002000:00100000:3.0:1746143774.668404:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3866624->4194303) req@ffff8801368ebb80 x1830963622398208/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.668419:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ebb80 with x1830963622398208 ext(3866624->4194303) 00010000:00010000:3.0:1746143774.668429:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 20 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.668442:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 20 pid: 1947 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.668448:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368ebb80 00000100:00100000:3.0:1746143774.668521:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1384 00000100:00100000:3.0:1746143774.668528:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622398208:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143774.669476:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.669689:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622398336 00000100:00100000:3.0:1746143774.669693:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622398336 00000100:00100000:3.0:1746143774.669972:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11528 00000100:00100000:3.0:1746143774.669979:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32005:x1830963622398336:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143774.669987:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.669999:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8c2 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.670019:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a83ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a859 expref: 34 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.670026:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 25 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.670031:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.670032:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.670035:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4194304->4235263] (req 4194304->4235263) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.670061:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 25 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.670068:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 25 pid: 9839 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.670077:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626700672:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.670136:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a83ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a859 expref: 34 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.670143:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a83ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a859 expref: 34 pid: 9839 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.670149:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626700800:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.670161:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.675016:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.675075:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.675095:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622398720 00000100:00100000:0.0:1746143774.675101:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622398720 00010000:00010000:0.0:1746143774.675127:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a83ed lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a859 expref: 35 pid: 9839 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143774.675150:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5400 00000100:00100000:0.0:1746143774.675157:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b41fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622398720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.675167:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143774.675184:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a83ed lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a859 expref: 35 pid: 9839 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143774.675192:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a83ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a859 expref: 35 pid: 9839 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143774.675214:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.675243:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b41fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622398720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.675249:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5400 00000100:00100000:2.0:1746143774.675616:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622398592 00000100:00100000:2.0:1746143774.675620:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622398592 00002000:00100000:2.0:1746143774.675645:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff8801368e9f80 x1830963622398592/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.675653:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9f80 with x1830963622398592 ext(2097152->3145727) 00010000:00010000:2.0:1746143774.675658:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 26 pid: 9839 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.675667:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 26 pid: 9839 timeout: 933 lvb_type: 1 00002000:00010000:2.0:1746143774.675678:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801368e9f80 00000100:00100000:2.0:1746143774.675693:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1385 00000100:00100000:2.0:1746143774.675698:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622398592:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143774.676132:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626700672:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.676141:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d66400/0x87925e4cb73a83ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a859 expref: 34 pid: 9839 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746143774.676156:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626700800:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.676175:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4194304->4235263] (req 4194304->4235263) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 27 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.676189:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084c00, rc 0) 00000100:00100000:3.0:1746143774.676230:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:32005:x1830963622398336:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6251us (6754us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.676235:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11528 00000100:00100000:1.0:1746143774.676701:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622398208:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8172us (10791us total) trans 17179872943 rc 0/0 00000100:00100000:1.0:1746143774.676708:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1384 00002000:00100000:1.0:1746143774.676714:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3866624->4194303) req@ffff8801368ebb80 x1830963622398208/t17179872943(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/448 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.676725:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ebb80 with x1830963622398208 ext(3866624->4194303) 00010000:00010000:1.0:1746143774.676731:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 22 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143774.676738:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 22 pid: 1947 timeout: 933 lvb_type: 0 00002000:00010000:1.0:1746143774.676744:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368ebb80 00000100:00100000:1.0:1746143774.676976:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.677087:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622398848 00000100:00100000:3.0:1746143774.677091:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622398848 00000100:00100000:3.0:1746143774.677110:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11529 00000100:00100000:3.0:1746143774.677115:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622398848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.677123:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.677133:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73a8479 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8c9 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143774.677133:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143774.677146:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.677152:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73a8479 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c9 expref: 35 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143774.677156:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622398976 00010000:00010000:3.0:1746143774.677160:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73a8479 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c9 expref: 35 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143774.677160:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622398976 00010000:00010000:3.0:1746143774.677166:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084600, rc 0) 00000100:00100000:1.0:1746143774.677178:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11530 00000100:00100000:1.0:1746143774.677183:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622398976:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143774.677185:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622398848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 70us (210us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143774.677190:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11529 00010000:00010000:1.0:1746143774.677190:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.677199:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73a8480 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8d0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143774.677354:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626700928:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143774.677411:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358180 going to sleep for 11 seconds 00002000:00010000:1.0:1746143774.680974:0:1945:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143773 -> 1746143775 00002000:00010000:1.0:1746143774.680980:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143773 -> 1746143775 00002000:00010000:1.0:1746143774.680982:0:1945:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143773 -> 1746143775 00000100:00100000:1.0:1746143774.680998:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626700928:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143774.681265:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.681391:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622399104 00000100:00100000:2.0:1746143774.681397:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622399104 00010000:00010000:2.0:1746143774.681422:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 22 pid: 1947 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.681451:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5401 00000100:00100000:2.0:1746143774.681458:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622399104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.681468:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.681477:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 22 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.681486:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 22 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.681502:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73a8464 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8b4 expref: 22 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.681529:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.681531:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.681537:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 43 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.681550:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 43 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.681576:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 43 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.681586:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626701056:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.681642:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b40c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143774.681673:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73a8480 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d0 expref: 43 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.681685:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73a8480 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d0 expref: 43 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143774.681695:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53800, rc 0) 00000100:00100000:1.0:1746143774.681715:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622398976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4531us (4582us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143774.681721:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11530 00000100:00100000:2.0:1746143774.682492:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622398592:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6792us (7480us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143774.682499:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1385 00002000:00100000:2.0:1746143774.682506:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff8801368e9f80 x1830963622398592/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.682514:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9f80 with x1830963622398592 ext(2097152->3145727) 00010000:00010000:2.0:1746143774.682520:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 25 pid: 9839 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.682530:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 25 pid: 9839 timeout: 933 lvb_type: 1 00002000:00010000:2.0:1746143774.682536:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801368e9f80 00000100:00100000:2.0:1746143774.686291:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626701056:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.686308:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.686353:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622399104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4894us (5087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.686364:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5401 00000100:00100000:0.0:1746143774.688522:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.688561:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622399232 00000100:00100000:0.0:1746143774.688564:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.688568:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622399232 00000100:00100000:1.0:1746143774.688600:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11531 00000100:00100000:1.0:1746143774.688606:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:32008:x1830963622399232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.688624:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.688638:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a8487 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8d7 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.688657:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.688659:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.688665:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a8487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d7 expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.688677:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a8487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d7 expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.688685:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048e00, rc 0) 00000100:00100000:1.0:1746143774.688711:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:32008:x1830963622399232:12345-192.168.202.3@tcp:101:cat.0 Request processed in 105us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.688719:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11531 00000100:00100000:2.0:1746143774.688774:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622399488 00000100:00100000:2.0:1746143774.688777:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622399488 00002000:00100000:2.0:1746143774.688800:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2891776->2895871) req@ffff8801368eb480 x1830963622399488/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.688809:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb480 with x1830963622399488 ext(2891776->2895871) 00002000:00010000:2.0:1746143774.688812:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368eb480 00000100:00100000:2.0:1746143774.688837:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3260 00000100:00100000:2.0:1746143774.688842:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622399488:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143774.688970:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622399488:12345-192.168.202.3@tcp:3:cat.0 Request processed in 127us (404us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143774.688975:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3260 00002000:00100000:2.0:1746143774.688980:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2891776->2895871) req@ffff8801368eb480 x1830963622399488/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.688986:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb480 with x1830963622399488 ext(2891776->2895871) 00002000:00010000:2.0:1746143774.688989:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368eb480 00000100:00100000:2.0:1746143774.690514:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.690597:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622399616 00000100:00100000:1.0:1746143774.690602:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622399616 00000100:00100000:1.0:1746143774.690784:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11532 00000100:00100000:1.0:1746143774.690792:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32009:x1830963622399616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143774.690984:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.690998:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8de expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.691020:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 41 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.691027:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.691029:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143774.691031:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.691054:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 41 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.691063:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 41 pid: 1947 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.691072:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626701184:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.691135:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.698171:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.698299:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.698496:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622399744 00000100:00100000:2.0:1746143774.698503:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622399744 00010000:00010000:2.0:1746143774.698533:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 25 pid: 9839 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746143774.698560:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5402 00000100:00100000:2.0:1746143774.698567:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622399744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.698580:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.698596:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 25 pid: 9839 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.698605:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 25 pid: 9839 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.698624:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8410 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a883 expref: 25 pid: 9839 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746143774.698640:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.698642:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.698647:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.698654:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.698679:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.698690:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626701312:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.698754:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143774.698861:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622399872 00000100:00100000:3.0:1746143774.698865:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622399872 00002000:00100000:3.0:1746143774.698890:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2891776->3145727) req@ffff8801368eaa00 x1830963622399872/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.698897:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eaa00 with x1830963622399872 ext(2891776->3145727) 00010000:00010000:3.0:1746143774.698902:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 42 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.698932:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 42 pid: 1947 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.698937:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368eaa00 00000100:00100000:3.0:1746143774.698962:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1386 00000100:00100000:3.0:1746143774.698967:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963622399872:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143774.699299:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bcad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626701184:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143774.699318:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.699326:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048600, rc 0) 00000100:00100000:1.0:1746143774.699347:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:32009:x1830963622399616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8556us (8837us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.699353:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11532 00000100:00100000:0.0:1746143774.704771:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.704802:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.705054:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622400128 00000100:00100000:2.0:1746143774.705061:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622400128 00002000:00100000:2.0:1746143774.705091:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8801368e9180 x1830963622400128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.705103:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9180 with x1830963622400128 ext(2097152->4194303) 00002000:00010000:2.0:1746143774.705108:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9180 00000100:00100000:2.0:1746143774.705121:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622400384 00000100:00100000:2.0:1746143774.705123:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622400384 00002000:00100000:2.0:1746143774.705132:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8801368e8a80 x1830963622400384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 504/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.705137:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8a80 with x1830963622400384 ext(2097152->4194303) 00010000:00010000:2.0:1746143774.705143:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 46 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.705154:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 46 pid: 1947 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746143774.705159:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368e8a80 00000100:00100000:2.0:1746143774.705172:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1387 00000100:00100000:2.0:1746143774.705178:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622400384:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143774.705953:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3261 00000100:00100000:1.0:1746143774.705959:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622400128:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143774.706660:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.706751:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626701312:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143774.706765:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.706800:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622399744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8234us (8637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.706807:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5402 00000100:00100000:3.0:1746143774.706864:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963622399872:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7897us (8566us total) trans 17179872944 rc 0/0 00000100:00100000:3.0:1746143774.706870:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1386 00002000:00100000:3.0:1746143774.706876:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2891776->3145727) req@ffff8801368eaa00 x1830963622399872/t17179872944(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/448 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.706884:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eaa00 with x1830963622399872 ext(2891776->3145727) 00010000:00010000:3.0:1746143774.706890:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 46 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.706905:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 46 pid: 1947 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.706941:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368eaa00 00000100:00100000:3.0:1746143774.706962:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622400640 00000100:00100000:3.0:1746143774.706967:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622400640 00002000:00100000:3.0:1746143774.706981:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (4231168->4235263) req@ffff88012b7e2680 x1830963622400640/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.706987:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e2680 with x1830963622400640 ext(4231168->4235263) 00002000:00010000:3.0:1746143774.706989:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7e2680 00000100:00100000:3.0:1746143774.707005:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3262 00000100:00100000:3.0:1746143774.707013:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622400640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143774.707066:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622400640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 56us (407us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143774.707071:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3262 00002000:00100000:3.0:1746143774.707075:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (4231168->4235263) req@ffff88012b7e2680 x1830963622400640/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.707081:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e2680 with x1830963622400640 ext(4231168->4235263) 00002000:00010000:3.0:1746143774.707083:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7e2680 00000100:00100000:0.0:1746143774.721705:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.721767:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622400896 00000100:00100000:2.0:1746143774.721775:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622400896 00000100:00100000:2.0:1746143774.721811:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4665 00000100:00100000:2.0:1746143774.721819:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32005:x1830963622400896:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143774.722059:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32005:x1830963622400896:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 240us (360us total) trans 8589943524 rc 0/0 00000100:00100000:2.0:1746143774.722065:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4665 00000100:00100000:3.0:1746143774.722814:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622400384:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17634us (18009us total) trans 0 rc 1843200/1843200 00000100:00100000:3.0:1746143774.722824:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1387 00002000:00100000:3.0:1746143774.722831:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8801368e8a80 x1830963622400384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 504/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 1843200/1843200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.722840:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8a80 with x1830963622400384 ext(2097152->4194303) 00010000:00010000:3.0:1746143774.722848:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 44 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.722860:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 44 pid: 1947 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746143774.722866:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368e8a80 00000100:00100000:1.0:1746143774.733142:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622400128:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27175us (28371us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143774.733152:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3261 00002000:00100000:1.0:1746143774.733162:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8801368e9180 x1830963622400128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.733171:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9180 with x1830963622400128 ext(2097152->4194303) 00002000:00010000:1.0:1746143774.733176:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9180 00000100:00100000:0.0:1746143774.737679:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.737870:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.737906:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.737976:0:8215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622401024 00000100:00100000:1.0:1746143774.737984:0:8215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622401024 00000100:00100000:2.0:1746143774.737999:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622401280 00000100:00100000:2.0:1746143774.738003:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622401280 00000100:00100000:2.0:1746143774.738046:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1079 00000100:00100000:2.0:1746143774.738054:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+20:2010:x1830963622401280:12345-192.168.202.3@tcp:400:kworker.0 00000100:00080000:3.0:1746143774.738059:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746143774.738107:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+20:2010:x1830963622401280:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 54us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.738112:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1079 00000100:00100000:0.0:1746143774.738133:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.738147:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622401792 00000100:00100000:0.0:1746143774.738147:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.738149:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622401792 00000100:00100000:0.0:1746143774.738158:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622401536 00000100:00100000:0.0:1746143774.738161:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622401536 00000100:00100000:2.0:1746143774.738166:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1080 00000100:00100000:2.0:1746143774.738170:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2010:x1830963622401792:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143774.738179:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622402048 00000100:00100000:0.0:1746143774.738181:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622402048 00000100:00100000:2.0:1746143774.738190:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2010:x1830963622401792:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 20us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.738194:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 655 00000100:00100000:2.0:1746143774.738195:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1080 00000100:00100000:0.0:1746143774.738199:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622401536:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143774.738218:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 656 00000100:00100000:2.0:1746143774.738223:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963622402048:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143774.738224:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622401536:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.738230:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 655 00000100:00100000:2.0:1746143774.738243:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963622402048:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 20us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.738248:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 656 00000100:00100000:0.0:1746143774.738256:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.738265:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622402304 00000100:00100000:2.0:1746143774.738268:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622402304 00000100:00100000:0.0:1746143774.738269:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.738282:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1081 00000100:00100000:0.0:1746143774.738282:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.738285:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2010:x1830963622402304:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143774.738308:0:8215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 188 00000100:00100000:1.0:1746143774.738316:0:8215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2010:x1830963622401024:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143774.738333:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622401152 00000100:00100000:2.0:1746143774.738336:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622401152 00000100:00100000:1.0:1746143774.738348:0:8215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2010:x1830963622401024:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 23us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.738350:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1082 00000100:00100000:2.0:1746143774.738353:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2010:x1830963622401152:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143774.738404:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2010:x1830963622401152:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 50us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.738408:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1082 00000100:00100000:2.0:1746143774.738418:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622402560 00000100:00100000:2.0:1746143774.738419:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622402560 00000100:00080000:3.0:1746143774.738429:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746143774.738434:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 657 00000100:00100000:2.0:1746143774.738438:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2010:x1830963622402560:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143774.738452:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2010:x1830963622402560:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 14us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.738456:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 657 00000100:00100000:3.0:1746143774.738461:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2010:x1830963622402304:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 174us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.738467:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1081 00000100:00100000:1.0:1746143774.738509:0:8215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 188 00000100:00100000:0.0:1746143774.738589:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.738614:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.738625:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622401408 00000100:00100000:2.0:1746143774.738627:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622401408 00000100:00100000:0.0:1746143774.738716:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.738735:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622401664 00000100:00100000:1.0:1746143774.738739:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622401664 00000100:00100000:2.0:1746143774.738794:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622401920 00000100:00100000:2.0:1746143774.738796:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622401920 00000100:00100000:0.0:1746143774.738808:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.738816:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 658 00000100:00100000:2.0:1746143774.738821:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622401408:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143774.738840:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622401408:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 19us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.738845:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 658 00000100:00100000:2.0:1746143774.738852:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 659 00000100:00100000:2.0:1746143774.738855:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622401920:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143774.738866:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622401920:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 11us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.738871:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 659 00000100:00100000:0.0:1746143774.738972:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.738982:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622402432 00000100:00100000:0.0:1746143774.738984:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622402432 00000100:00100000:0.0:1746143774.738998:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 660 00000100:00100000:0.0:1746143774.739002:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2010:x1830963622402432:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143774.739017:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2010:x1830963622402432:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 15us (45us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.739022:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 660 00000100:00100000:0.0:1746143774.739060:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.739187:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622402176 00000100:00100000:1.0:1746143774.739191:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622402176 00000100:00100000:1.0:1746143774.739209:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1083 00000100:00100000:1.0:1746143774.739214:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622401664:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143774.739240:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622401664:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.739244:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1083 00000100:00100000:1.0:1746143774.739253:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1084 00000100:00100000:1.0:1746143774.739257:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2010:x1830963622402176:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143774.739275:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2010:x1830963622402176:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 18us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143774.739280:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1084 00000100:00100000:3.0:1746143774.739331:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622402688 00000100:00100000:3.0:1746143774.739335:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622402688 00010000:00010000:3.0:1746143774.739366:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 44 pid: 1947 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746143774.739387:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5403 00000100:00100000:3.0:1746143774.739391:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622402688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.739400:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.739416:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 44 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.739426:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 44 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.739448:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73a846b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8bb expref: 44 pid: 1947 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746143774.739463:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.739465:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.739470:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.739477:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.739501:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143774.739511:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626701440:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143774.739546:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.745104:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.745140:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.745695:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626701440:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.745712:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.745744:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963622402688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6352us (6683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.745754:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5403 00000100:00100000:1.0:1746143774.746152:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622402816 00000100:00100000:1.0:1746143774.746158:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622402816 00000100:00100000:3.0:1746143774.746160:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622402944 00000100:00100000:3.0:1746143774.746165:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622402944 00000100:00100000:3.0:1746143774.746193:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11533 00000100:00100000:3.0:1746143774.746200:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:32003:x1830963622402944:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:1.0:1746143774.746207:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11534 00000100:00100000:1.0:1746143774.746212:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+43:32008:x1830963622402816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.746214:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.746221:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143774.746230:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a849c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8e5 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.746235:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8ec expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.746248:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143774.746250:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.746254:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a8487 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d7 expref: 36 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.746257:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a849c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8e5 expref: 44 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.746264:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143774.746266:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143774.746269:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.746269:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a849c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8e5 expref: 44 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143774.746278:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096011c00, rc 0) 00010000:00010000:3.0:1746143774.746290:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a8487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d7 expref: 36 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143774.746299:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:32008:x1830963622402816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 87us (1201us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143774.746301:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a8487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d7 expref: 36 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143774.746306:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11534 00000100:00100000:3.0:1746143774.746311:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626701568:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.746362:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143774.752242:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626701568:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.752267:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.752282:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085c00, rc 0) 00000100:00100000:3.0:1746143774.752336:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:32003:x1830963622402944:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6136us (7194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.752344:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11533 00000100:00100000:0.0:1746143774.752418:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.753234:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622403200 00000100:00100000:2.0:1746143774.753240:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622403200 00002000:00100000:2.0:1746143774.753271:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff88012b7a8e00 x1830963622403200/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.753279:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8e00 with x1830963622403200 ext(2097152->3145727) 00002000:00010000:2.0:1746143774.753283:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7a8e00 00000100:00100000:2.0:1746143774.753308:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3263 00000100:00100000:2.0:1746143774.753315:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622403200:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143774.758801:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.758906:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.759106:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622403584 00000100:00100000:3.0:1746143774.759114:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622403584 00002000:00100000:3.0:1746143774.759150:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff88012b7ab800 x1830963622403584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.759164:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ab800 with x1830963622403584 ext(2097152->3145727) 00002000:00010000:3.0:1746143774.759169:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7ab800 00000100:00100000:3.0:1746143774.759192:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3264 00000100:00100000:3.0:1746143774.759200:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622403584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143774.759594:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622403328 00000100:00100000:2.0:1746143774.759598:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622403328 00010000:00010000:2.0:1746143774.759687:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a8487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d7 expref: 36 pid: 1945 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746143774.760103:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5404 00000100:00100000:2.0:1746143774.760111:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622403328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.760121:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.760136:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a8487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d7 expref: 36 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.760147:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a8487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d7 expref: 36 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.760170:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73a8487 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8d7 expref: 36 pid: 1945 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746143774.760185:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.760186:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.760193:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.760516:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.760617:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.760628:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626701696:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.760676:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143774.768544:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622403200:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15221us (16116us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.768555:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3263 00002000:00100000:3.0:1746143774.768565:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff88012b7a8e00 x1830963622403200/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.768574:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8e00 with x1830963622403200 ext(2097152->3145727) 00002000:00010000:3.0:1746143774.768579:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7a8e00 00000100:00100000:0.0:1746143774.768620:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.768754:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622403840 00000100:00100000:3.0:1746143774.768760:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622403840 00002000:00100000:3.0:1746143774.768782:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3186688->3190783) req@ffff88012b7a9c00 x1830963622403840/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.768789:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9c00 with x1830963622403840 ext(3186688->3190783) 00002000:00010000:3.0:1746143774.768792:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a9c00 00000100:00100000:3.0:1746143774.768803:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3265 00000100:00100000:3.0:1746143774.768808:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622403840:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143774.768893:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622403840:12345-192.168.202.3@tcp:3:cat.0 Request processed in 85us (274us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143774.768898:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3265 00002000:00100000:3.0:1746143774.768902:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3186688->3190783) req@ffff88012b7a9c00 x1830963622403840/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.768908:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9c00 with x1830963622403840 ext(3186688->3190783) 00002000:00010000:3.0:1746143774.768927:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a9c00 00000100:00100000:2.0:1746143774.768963:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626701696:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.768979:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.769002:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622403328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8892us (10095us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.769008:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5404 00000100:00100000:0.0:1746143774.774817:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.775274:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622403968 00000100:00100000:3.0:1746143774.775282:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622403968 00000100:00100000:2.0:1746143774.775643:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622403584:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16440us (16845us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143774.775652:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3264 00002000:00100000:2.0:1746143774.775662:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff88012b7ab800 x1830963622403584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.775671:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ab800 with x1830963622403584 ext(2097152->3145727) 00002000:00010000:2.0:1746143774.775675:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7ab800 00000100:00100000:3.0:1746143774.776371:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11535 00000100:00100000:3.0:1746143774.776379:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32009:x1830963622403968:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.776392:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.776406:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8f3 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.776426:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 34 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.776432:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143774.776433:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143774.776436:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.776457:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 34 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.776466:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 34 pid: 1947 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143774.776475:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626701824:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.776526:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5619c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.778447:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.778959:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626701824:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.778982:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.778994:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085400, rc 0) 00000100:00100000:3.0:1746143774.779027:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32009:x1830963622403968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2649us (4217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.779034:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11535 00000100:00100000:2.0:1746143774.779108:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622404096 00000100:00100000:2.0:1746143774.779114:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622404096 00002000:00100000:2.0:1746143774.779142:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3190783) req@ffff880095c68a80 x1830963622404096/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.779149:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68a80 with x1830963622404096 ext(3145728->3190783) 00010000:00010000:2.0:1746143774.779155:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 35 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.779164:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 35 pid: 1947 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746143774.779170:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c68a80 00000100:00100000:2.0:1746143774.779195:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1388 00000100:00100000:2.0:1746143774.779202:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622404096:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143774.781409:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.782764:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622404352 00000100:00100000:1.0:1746143774.782773:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622404352 00002000:00100000:1.0:1746143774.782808:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3190784->4194303) req@ffff880095c6a300 x1830963622404352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.782815:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a300 with x1830963622404352 ext(3190784->4194303) 00010000:00010000:1.0:1746143774.782823:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 37 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143774.782834:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 37 pid: 1947 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746143774.782840:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c6a300 00000100:00100000:0.0:1746143774.782848:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.783434:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622404608 00000100:00100000:2.0:1746143774.783437:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622404608 00000100:00100000:3.0:1746143774.783445:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1389 00000100:00100000:3.0:1746143774.783453:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622404352:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143774.783454:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880095c68e00 x1830963622404608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.783460:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68e00 with x1830963622404608 ext(3145728->4194303) 00002000:00010000:2.0:1746143774.783463:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c68e00 00000100:00100000:2.0:1746143774.783474:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3266 00000100:00100000:2.0:1746143774.783478:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622404608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143774.785171:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622404096:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5964us (6725us total) trans 21474840264 rc 0/0 00000100:00100000:2.0:1746143774.785179:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1388 00002000:00100000:2.0:1746143774.785186:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3190783) req@ffff880095c68a80 x1830963622404096/t21474840264(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/448 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.785194:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68a80 with x1830963622404096 ext(3145728->3190783) 00010000:00010000:2.0:1746143774.785201:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 39 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.785211:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 39 pid: 1947 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746143774.785217:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c68a80 00000100:00100000:0.0:1746143774.787146:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.787270:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622404736 00000100:00100000:3.0:1746143774.787276:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622404736 00000100:00100000:3.0:1746143774.787308:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11536 00000100:00100000:3.0:1746143774.787315:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+39:32008:x1830963622404736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.787328:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.787342:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a8fa expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.787363:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143774.787367:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 40 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.787376:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 40 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.787389:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085200, rc 0) 00000100:00100000:3.0:1746143774.787545:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:32008:x1830963622404736:12345-192.168.202.3@tcp:101:cat.0 Request processed in 229us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.787550:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11536 00000100:00100000:2.0:1746143774.795487:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622404608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11999us (12629us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143774.795497:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3266 00002000:00100000:2.0:1746143774.795507:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880095c68e00 x1830963622404608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.795516:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68e00 with x1830963622404608 ext(3145728->4194303) 00002000:00010000:2.0:1746143774.795521:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c68e00 00000100:00100000:3.0:1746143774.795931:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963622404352:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12457us (14506us total) trans 0 rc 1003520/1003520 00000100:00100000:3.0:1746143774.795939:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1389 00002000:00100000:3.0:1746143774.795955:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3190784->4194303) req@ffff880095c6a300 x1830963622404352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 1003520/1003520 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.795962:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a300 with x1830963622404352 ext(3190784->4194303) 00010000:00010000:3.0:1746143774.795969:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 38 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143774.795981:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 38 pid: 1947 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143774.795987:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c6a300 00000100:00100000:0.0:1746143774.802906:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.803214:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622404864 00000100:00100000:2.0:1746143774.803222:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622404864 00010000:00010000:2.0:1746143774.803254:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 38 pid: 1947 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.803280:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5405 00000100:00100000:2.0:1746143774.803286:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963622404864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.803296:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143774.803308:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143774 -> 1746143775 00002000:00010000:2.0:1746143774.803311:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143774 -> 1746143775 00010000:00010000:2.0:1746143774.803315:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 38 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.803325:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 38 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.803344:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a8495 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->3190783) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8ec expref: 38 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.803360:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.803362:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.803368:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.803375:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.803381:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.803382:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.803384:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.803394:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.803418:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.803460:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626701952:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.803550:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.803557:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626702080:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.803573:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.808836:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626701952:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143774.808848:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626702080:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143774.808865:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.808930:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963622404864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5642us (6031us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.808940:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5405 00000100:00100000:1.0:1746143774.809099:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.809235:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622405120 00000100:00100000:3.0:1746143774.809241:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622405120 00002000:00100000:3.0:1746143774.809274:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880091bcad80 x1830963622405120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.809282:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcad80 with x1830963622405120 ext(3145728->4194303) 00002000:00010000:3.0:1746143774.809287:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bcad80 00000100:00100000:3.0:1746143774.809301:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3267 00000100:00100000:3.0:1746143774.809307:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622405120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143774.812136:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.812204:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622405504 00000100:00100000:2.0:1746143774.812210:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622405504 00002000:00100000:2.0:1746143774.812242:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095c6a680 x1830963622405504/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.812251:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a680 with x1830963622405504 ext(3145728->4194303) 00002000:00010000:2.0:1746143774.812256:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c6a680 00000100:00100000:2.0:1746143774.812283:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3268 00000100:00100000:2.0:1746143774.812288:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622405504:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143774.814384:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.814446:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622405632 00000100:00100000:1.0:1746143774.814453:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622405632 00000100:00100000:3.0:1746143774.814567:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622405120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5258us (5466us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143774.814576:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3267 00002000:00100000:3.0:1746143774.814584:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880091bcad80 x1830963622405120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.814593:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcad80 with x1830963622405120 ext(3145728->4194303) 00002000:00010000:3.0:1746143774.814598:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bcad80 00002000:00100000:1.0:1746143774.814659:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880092b48000 x1830963622405632/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.814666:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48000 with x1830963622405632 ext(3145728->4194303) 00002000:00010000:1.0:1746143774.814669:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48000 00000100:00100000:1.0:1746143774.814681:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3269 00000100:00100000:1.0:1746143774.814687:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622405632:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143774.819146:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143774.823343:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622405504:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11048us (11206us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143774.823351:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3268 00002000:00100000:2.0:1746143774.823360:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095c6a680 x1830963622405504/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.823367:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a680 with x1830963622405504 ext(3145728->4194303) 00002000:00010000:2.0:1746143774.823371:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c6a680 00000100:00100000:1.0:1746143774.826246:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622405632:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11551us (11860us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143774.826256:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3269 00002000:00100000:1.0:1746143774.826266:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880092b48000 x1830963622405632/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.826274:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48000 with x1830963622405632 ext(3145728->4194303) 00002000:00010000:1.0:1746143774.826279:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48000 00000100:00100000:0.0:1746143774.830483:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.830543:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622405760 00000100:00100000:3.0:1746143774.830551:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622405760 00000100:00100000:3.0:1746143774.830599:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11537 00000100:00100000:3.0:1746143774.830606:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622405760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.830620:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.830634:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73a84b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a901 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143774.830676:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626702208:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143774.830748:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5619c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143774.830815:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.830833:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622405888 00000100:00100000:2.0:1746143774.830837:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622405888 00000100:00100000:2.0:1746143774.830868:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11538 00000100:00100000:2.0:1746143774.830874:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622405888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.830881:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.830888:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33400/0x87925e4cb73a84b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a908 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.830931:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626702336:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143774.830980:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00002000:00010000:3.0:1746143774.832126:0:1947:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143774 -> 1746143775 00000100:00100000:3.0:1746143774.832144:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626702208:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143774.832164:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73a84b1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a901 expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.832173:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73a84b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a901 expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.832191:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084600, rc 0) 00000100:00100000:3.0:1746143774.832228:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622405760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1621us (1749us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143774.832234:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11537 00000100:00100000:2.0:1746143774.832407:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626702336:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143774.832423:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33400/0x87925e4cb73a84b8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a908 expref: 38 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.832431:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33400/0x87925e4cb73a84b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a908 expref: 38 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.832441:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33400, rc 0) 00000100:00100000:2.0:1746143774.832457:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622405888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1583us (1646us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143774.832462:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11538 00000100:00100000:0.0:1746143774.837004:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.837184:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.837328:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622406016 00000100:00100000:2.0:1746143774.837334:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622406016 00000100:00100000:2.0:1746143774.837371:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11539 00000100:00100000:2.0:1746143774.837377:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:32008:x1830963622406016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.837390:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.837402:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a90f expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.837427:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.837433:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143774.837435:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143774.837438:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->4780031] (req 4194304->4780031) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.837459:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.837468:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 24 pid: 1947 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.837477:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626702464:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143774.837505:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622406272 00000100:00100000:1.0:1746143774.837508:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622406272 00002000:00100000:1.0:1746143774.837528:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4235264->4780031) req@ffff880092b49180 x1830963622406272/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143774.837536:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49180 with x1830963622406272 ext(4235264->4780031) 00010000:00010000:1.0:1746143774.837540:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 25 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143774.837548:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 25 pid: 1947 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746143774.837553:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b49180 00000100:00100000:1.0:1746143774.837573:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1390 00000100:00100000:1.0:1746143774.837577:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622406272:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143774.837702:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143774.841819:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626702464:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.841848:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->4780031] (req 4194304->4780031) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.841869:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33200, rc 0) 00000100:00100000:2.0:1746143774.841906:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+38:32008:x1830963622406016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4529us (4907us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.841930:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11539 00000100:00100000:0.0:1746143774.842990:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.843086:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622406272:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5507us (5900us total) trans 0 rc 544768/544768 00000100:00100000:1.0:1746143774.843096:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1390 00002000:00100000:1.0:1746143774.843103:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4235264->4780031) req@ffff880092b49180 x1830963622406272/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 544768/544768 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143774.843105:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622406400 00002000:00100000:1.0:1746143774.843110:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49180 with x1830963622406272 ext(4235264->4780031) 00000100:00100000:3.0:1746143774.843111:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622406400 00010000:00010000:1.0:1746143774.843117:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 26 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143774.843127:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 26 pid: 1947 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746143774.843132:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b49180 00002000:00100000:3.0:1746143774.843136:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4235263) req@ffff880092b49880 x1830963622406400/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.843147:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49880 with x1830963622406400 ext(4194304->4235263) 00010000:00010000:3.0:1746143774.843152:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 25 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143774.843160:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 25 pid: 1947 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143774.843165:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b49880 00000100:00100000:3.0:1746143774.843190:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1391 00000100:00100000:3.0:1746143774.843196:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622406400:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143774.845729:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622406400:12345-192.168.202.3@tcp:4:cat.0 Request processed in 2525us (2732us total) trans 21474840265 rc 0/0 00000100:00100000:3.0:1746143774.845738:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1391 00002000:00100000:3.0:1746143774.845747:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4235263) req@ffff880092b49880 x1830963622406400/t21474840265(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/448 e 0 to 0 dl 1746143785 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.845760:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49880 with x1830963622406400 ext(4194304->4235263) 00010000:00010000:3.0:1746143774.845767:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 27 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143774.845778:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 27 pid: 1947 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143774.845784:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b49880 00000100:00100000:0.0:1746143774.847564:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.848408:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622406528 00000100:00100000:2.0:1746143774.848415:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622406528 00010000:00010000:2.0:1746143774.848445:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 27 pid: 1947 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.848469:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5406 00000100:00100000:2.0:1746143774.848476:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622406528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.848488:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.848504:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 27 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.848514:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 27 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.848532:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73a8472 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4235263) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8c2 expref: 27 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.848548:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.848549:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.848556:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.848566:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.848595:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143774.848606:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626702592:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143774.848664:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143774.848702:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.848800:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622406656 00000100:00100000:2.0:1746143774.848804:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622406656 00000100:00100000:2.0:1746143774.848824:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11540 00000100:00100000:2.0:1746143774.848829:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2011:x1830963622406656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143774.848841:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.848851:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a84c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a916 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.848862:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.848863:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143774.848866:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a84c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a916 expref: 28 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.848875:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a84c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a916 expref: 28 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.848881:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32000, rc 0) 00000100:00100000:2.0:1746143774.848903:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2011:x1830963622406656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.848908:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11540 00000100:00100000:0.0:1746143774.852511:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.852556:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622406912 00000100:00100000:3.0:1746143774.852564:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622406912 00002000:00100000:3.0:1746143774.852601:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4775936->4780031) req@ffff880092b48a80 x1830963622406912/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.852609:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48a80 with x1830963622406912 ext(4775936->4780031) 00002000:00010000:3.0:1746143774.852613:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b48a80 00000100:00100000:2.0:1746143774.852729:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626702592:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143774.852747:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.852790:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622406528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4314us (5231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.852799:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5406 00000100:00100000:3.0:1746143774.853097:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3270 00000100:00100000:3.0:1746143774.853105:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2010:x1830963622406912:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143774.853750:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2010:x1830963622406912:12345-192.168.202.3@tcp:3:cat.0 Request processed in 645us (1247us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143774.853755:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3270 00002000:00100000:3.0:1746143774.853761:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4775936->4780031) req@ffff880092b48a80 x1830963622406912/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.853768:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48a80 with x1830963622406912 ext(4775936->4780031) 00002000:00010000:3.0:1746143774.853771:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b48a80 00000100:00100000:0.0:1746143774.855121:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.855191:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622407168 00000100:00100000:3.0:1746143774.855197:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622407168 00002000:00100000:3.0:1746143774.855223:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880092b48700 x1830963622407168/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.855230:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48700 with x1830963622407168 ext(4194304->4780031) 00002000:00010000:3.0:1746143774.855233:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b48700 00000100:00100000:3.0:1746143774.855256:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3271 00000100:00100000:3.0:1746143774.855262:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622407168:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143774.859108:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.859173:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622407424 00000100:00100000:2.0:1746143774.859181:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622407424 00000100:00100000:2.0:1746143774.859227:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4666 00000100:00100000:2.0:1746143774.859234:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32009:x1830963622407424:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143774.859671:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32009:x1830963622407424:12345-192.168.202.3@tcp:35:cat.0 Request processed in 436us (569us total) trans 8589943525 rc 0/0 00000100:00100000:2.0:1746143774.859677:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4666 00000100:00100000:3.0:1746143774.860906:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622407168:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5641us (5783us total) trans 0 rc 585728/585728 00000100:00100000:3.0:1746143774.860928:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3271 00002000:00100000:3.0:1746143774.860936:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880092b48700 x1830963622407168/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:170/0 lens 488/440 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143774.860953:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48700 with x1830963622407168 ext(4194304->4780031) 00002000:00010000:3.0:1746143774.860958:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b48700 00000100:00100000:0.0:1746143774.870207:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.870268:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622407680 00000100:00100000:2.0:1746143774.870277:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622407680 00000100:00100000:2.0:1746143774.870324:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4667 00000100:00100000:2.0:1746143774.870331:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:32008:x1830963622407680:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143774.872099:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:32008:x1830963622407680:12345-192.168.202.3@tcp:35:cat.0 Request processed in 1764us (1894us total) trans 8589943526 rc 0/0 00000100:00100000:2.0:1746143774.872108:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4667 00000100:00100000:0.0:1746143774.905481:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.905791:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622407936 00000100:00100000:2.0:1746143774.905798:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622407936 00000100:00100000:2.0:1746143774.905851:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12796 00000100:00100000:2.0:1746143774.905858:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:32016:x1830963622407936:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143774.905878:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.905892:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a84cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a91d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.905993:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906004:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906014:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906024:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a84db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906030:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a84db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906034:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a84db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906110:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906118:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906124:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143774.906132:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143774.906189:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906199:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906205:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906211:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906216:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143774.906219:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906225:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906234:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143774.906237:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143774.906240:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906245:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73a84d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906276:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a84db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906282:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a84db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906286:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a84db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906291:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143774.906294:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a84db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906298:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a84db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906305:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9dc00) 00010000:00010000:2.0:1746143774.906307:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143774.906309:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a84db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906314:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a84db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.906345:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a84cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a91d expref: 266 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.906356:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a91d expref: 265 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.906362:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.906364:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143774.906366:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33400, rc 0) 00000100:00100000:2.0:1746143774.906409:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+265:32016:x1830963622407936:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 551us (934us total) trans 8589943527 rc 0/0 00000100:00100000:2.0:1746143774.906415:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12796 00000100:00100000:0.0:1746143774.911446:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.911540:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622408192 00000100:00100000:2.0:1746143774.911547:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622408192 00000100:00100000:2.0:1746143774.911580:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4668 00000100:00100000:2.0:1746143774.911587:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+265:32016:x1830963622408192:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143774.911768:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+266:32016:x1830963622408192:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 181us (329us total) trans 8589943528 rc 0/0 00000100:00100000:2.0:1746143774.911774:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4668 00000100:00100000:0.0:1746143774.919634:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.919696:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622408320 00000100:00100000:3.0:1746143774.919704:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622408320 00000100:00100000:3.0:1746143774.919756:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12797 00000100:00100000:3.0:1746143774.919763:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:32017:x1830963622408320:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143774.919780:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.919796:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085000/0x87925e4cb73a84f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a924 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.919842:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.919852:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.919861:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.919874:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a84fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.919879:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a84fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.919883:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a84fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.921053:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.921065:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a891 expref: 265 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.921072:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.921098:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a891 expref: 265 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.921109:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a891 expref: 265 pid: 7245 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143774.921120:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626702720:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.921205:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143774.927107:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626702720:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.927130:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143774.927596:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.927658:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622408448 00000100:00100000:2.0:1746143774.927664:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622408448 00010000:00010000:2.0:1746143774.927689:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a891 expref: 266 pid: 7245 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.927725:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5407 00000100:00100000:2.0:1746143774.927732:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+266:2008:x1830963622408448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.927743:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.927749:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a891 expref: 266 pid: 7245 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.927757:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a891 expref: 266 pid: 7245 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.927776:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a8433 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a891 expref: 266 pid: 7245 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.927801:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.927805:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143774.927817:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143774.927823:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143774.927845:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.927876:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:2008:x1830963622408448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 144us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.927883:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5407 00010000:00010000:3.0:1746143774.927984:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.927991:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143774.928033:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:3.0:1746143774.928037:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143774.928051:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928059:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928069:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928074:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928079:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928085:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928089:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082084600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143774.928092:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928098:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928105:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143774.928108:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143774.928111:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928115:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73a84f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928134:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a84fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928139:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a84fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928144:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a84fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928148:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082085c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143774.928150:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a84fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928154:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a84fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928160:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092b0aa00) 00010000:00010000:3.0:1746143774.928162:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143774.928164:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a84fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928168:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a84fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.928194:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085000/0x87925e4cb73a84f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a924 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.928208:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a924 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.928214:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.928216:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143774.928218:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084e00, rc 0) 00000100:00100000:3.0:1746143774.928495:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32017:x1830963622408320:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8732us (8867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.928501:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12797 00000100:00100000:0.0:1746143774.935080:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.935116:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.936339:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.936356:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622408576 00000100:00100000:3.0:1746143774.936364:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622408576 00000100:00100000:3.0:1746143774.936398:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622408832 00000100:00100000:3.0:1746143774.936400:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622408832 00000100:00100000:3.0:1746143774.936416:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11541 00000100:00100000:3.0:1746143774.936423:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2009:x1830963622408576:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143774.936438:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.936451:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a850c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a92b expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.936470:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.936472:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.936480:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a850c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a92b expref: 7 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.936493:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a850c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a92b expref: 7 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.936506:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085c00, rc 0) 00000100:00100000:3.0:1746143774.936542:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622408576:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 120us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.936548:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11541 00000100:00100000:3.0:1746143774.936562:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11542 00000100:00100000:3.0:1746143774.936567:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622408832:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143774.936573:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.936582:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082084600/0x87925e4cb73a8513 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a939 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.936591:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.936592:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.936597:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082084600/0x87925e4cb73a8513 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a939 expref: 8 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.936606:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082084600/0x87925e4cb73a8513 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a939 expref: 8 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.936611:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084600, rc 0) 00000100:00100000:3.0:1746143774.936625:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622408832:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 58us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.936630:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11542 00000100:00100000:0.0:1746143774.937100:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622409088 00000100:00100000:0.0:1746143774.937104:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622409088 00000100:00100000:0.0:1746143774.937130:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11543 00000100:00100000:0.0:1746143774.937136:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622409088:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143774.937141:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143774.937148:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73a851a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a947 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.937158:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.937159:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.937164:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73a851a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a947 expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.937173:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73a851a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a947 expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.937179:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467200, rc 0) 00000100:00100000:0.0:1746143774.937195:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622409088:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 60us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.937200:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11543 00000100:00100000:1.0:1746143774.937368:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.937387:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143774.937407:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.937539:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622408704 00000100:00100000:0.0:1746143774.937543:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622408704 00000100:00100000:0.0:1746143774.937558:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622408960 00000100:00100000:0.0:1746143774.937559:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622408960 00000100:00100000:0.0:1746143774.937568:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622409216 00000100:00100000:0.0:1746143774.937569:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622409216 00000100:00100000:0.0:1746143774.937579:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11544 00000100:00100000:0.0:1746143774.937583:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622408704:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143774.937590:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143774.937597:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8521 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a932 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.937606:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.937608:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.937611:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8521 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a932 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.937621:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8521 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a932 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.937628:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:0.0:1746143774.937645:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622408704:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 61us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.937650:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11544 00000100:00100000:0.0:1746143774.937659:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11545 00000100:00100000:0.0:1746143774.937664:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622408960:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143774.937670:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143774.937676:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8528 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a940 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143774.937685:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.937686:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143774.937690:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8528 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a940 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.937698:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8528 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a940 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143774.937705:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467c00, rc 0) 00000100:00100000:0.0:1746143774.937724:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622408960:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 60us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.937729:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11545 00000100:00100000:3.0:1746143774.937736:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11546 00000100:00100000:3.0:1746143774.937743:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622409216:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143774.937752:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.937759:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a852f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a94e expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.937768:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.937770:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.937774:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a852f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a94e expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.937782:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a852f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a94e expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143774.937789:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085000, rc 0) 00000100:00100000:3.0:1746143774.937805:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622409216:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 63us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.937810:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11546 00000100:00100000:0.0:1746143774.943388:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.943518:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622409472 00000100:00100000:3.0:1746143774.943527:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622409472 00000100:00100000:3.0:1746143774.943882:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12798 00000100:00100000:3.0:1746143774.943890:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32017:x1830963622409472:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143774.943908:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.943963:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73a8536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a955 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.944388:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.944401:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a924 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.944408:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.944434:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a924 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.944443:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a924 expref: 8 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143774.944454:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626702848:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.944909:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.948342:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.949362:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622409600 00000100:00100000:2.0:1746143774.949369:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622409600 00010000:00010000:2.0:1746143774.949402:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a924 expref: 9 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.949442:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5408 00000100:00100000:2.0:1746143774.949449:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622409600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.949460:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.949465:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a924 expref: 9 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.949475:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a924 expref: 9 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.949494:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.949498:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143774.949505:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143774.949511:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143774.949526:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.949575:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622409600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 126us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.949582:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5408 00010000:00010000:3.0:1746143774.949677:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73a8505 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a924 expref: 8 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143774.949692:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626702848:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.949706:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.949713:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.949717:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143774.949732:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143774.949829:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73a8536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a955 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.949840:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a955 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.949846:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.949849:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143774.949851:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d66400, rc 0) 00000100:00100000:3.0:1746143774.949874:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32017:x1830963622409472:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5985us (6495us total) trans 8589943529 rc 0/0 00000100:00100000:3.0:1746143774.949879:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12798 00000100:00100000:0.0:1746143774.952212:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.952806:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622409728 00000100:00100000:3.0:1746143774.952814:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622409728 00000100:00100000:3.0:1746143774.952863:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12799 00000100:00100000:3.0:1746143774.952869:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32017:x1830963622409728:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143774.952887:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.952900:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a854b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a95c expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.953005:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.953107:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a955 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.953113:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.953137:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a955 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.953146:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a955 expref: 9 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143774.953159:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626702976:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143774.953881:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.958562:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.958584:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622409856 00000100:00100000:0.0:1746143774.958590:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622409856 00010000:00010000:0.0:1746143774.958616:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a955 expref: 10 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746143774.958653:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5409 00000100:00100000:0.0:1746143774.958659:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622409856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143774.958673:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143774.958678:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a955 expref: 10 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143774.958688:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a955 expref: 10 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143774.958706:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143774.958710:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143774.958718:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143774.958725:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143774.958738:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143774.958769:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622409856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 110us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.958776:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5409 00010000:00010000:3.0:1746143774.959199:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a853d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a955 expref: 9 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143774.959213:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626702976:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143774.959229:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.959236:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.959241:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143774.959279:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:3.0:1746143774.959282:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143774.959295:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.959319:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a854b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a95c expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.959330:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a95c expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.959336:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.959338:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143774.959341:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085e00, rc 0) 00000100:00100000:3.0:1746143774.959364:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32017:x1830963622409728:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 6495us (7157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.959370:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12799 00000100:00100000:0.0:1746143774.959746:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.959964:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622410112 00000100:00100000:3.0:1746143774.959968:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622410112 00000100:00100000:3.0:1746143774.959998:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12800 00000100:00100000:3.0:1746143774.960004:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32019:x1830963622410112:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143774.960020:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.960031:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504400/0x87925e4cb73a8559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a963 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.960075:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960083:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960089:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960099:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8567 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960104:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960109:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960166:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960177:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960182:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143774.960188:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143774.960239:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960245:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960250:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960255:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960260:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091380800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143774.960263:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960269:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960276:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143774.960278:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143774.960281:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960285:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091380800/0x87925e4cb73a8560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960296:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960301:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8567 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960305:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960308:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf14000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143774.960310:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960315:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8567 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960319:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092b0aa00) 00010000:00010000:3.0:1746143774.960321:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143774.960323:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8567 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960328:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8567 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.960364:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504400/0x87925e4cb73a8559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a963 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.960373:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a963 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.960378:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.960381:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143774.960383:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093973c00, rc 0) 00000100:00100000:3.0:1746143774.960406:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32019:x1830963622410112:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 402us (665us total) trans 8589943530 rc 0/0 00000100:00100000:3.0:1746143774.960412:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12800 00000100:00100000:0.0:1746143774.963297:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.963430:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622410368 00000100:00100000:2.0:1746143774.963438:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622410368 00000100:00100000:2.0:1746143774.963483:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12801 00000100:00100000:2.0:1746143774.963490:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32017:x1830963622410368:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143774.963505:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.963518:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a857c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a96a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.963586:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8583 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.963598:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8583 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.963606:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8583 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.963615:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8583 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.963621:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8583 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.963626:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8583 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.963631:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143774.963634:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8583 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.963644:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8583 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.963651:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143774.963654:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143774.963657:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8583 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.963661:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8583 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143774.963687:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a857c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a96a expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.963693:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a857c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a96a expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.963700:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32c00, rc 0) 00000100:00100000:2.0:1746143774.963733:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32017:x1830963622410368:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 243us (443us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143774.963739:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12801 00000100:00100000:0.0:1746143774.973511:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.973537:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622410624 00000100:00100000:0.0:1746143774.973543:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622410624 00000100:00100000:0.0:1746143774.973590:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4669 00000100:00100000:0.0:1746143774.973598:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32017:x1830963622410624:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1746143774.973760:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32017:x1830963622410624:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 162us (255us total) trans 8589943531 rc 0/0 00000100:00100000:0.0:1746143774.973767:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4669 00000100:00100000:0.0:1746143774.974124:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.974207:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622410752 00000100:00100000:2.0:1746143774.974211:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622410752 00000100:00100000:2.0:1746143774.974802:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11547 00000100:00100000:2.0:1746143774.974808:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:32019:x1830963622410752:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143774.974818:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143774.974832:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a971 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.974858:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.974867:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73a851a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a947 expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.974873:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a84c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a916 expref: 28 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.974879:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 28 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.974886:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.974892:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143774.974893:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143774.974896:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 8/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3158016->3457023] (req 3158016->3457023) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.974953:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.974965:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 37 pid: 1947 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.974981:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626703104:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.976432:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 28 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.976442:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 28 pid: 1947 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.976452:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626703232:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.976854:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a84c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a916 expref: 28 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.976863:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a84c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a916 expref: 28 pid: 3135 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746143774.976870:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626703360:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.976899:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73a851a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a947 expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143774.976906:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73a851a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a947 expref: 8 pid: 1945 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746143774.976927:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626703488:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.977358:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.977367:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 37 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.977374:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626703616:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143774.977397:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143774.982302:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626703104:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143774.982574:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.982786:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622411008 00000100:00100000:3.0:1746143774.982793:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622411008 00010000:00010000:3.0:1746143774.982822:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 29 pid: 1947 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143774.982865:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5410 00000100:00100000:3.0:1746143774.982872:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2011:x1830963622411008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.982883:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.982900:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 29 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143774.982932:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 29 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143774.982965:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.982998:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2011:x1830963622411008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 126us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.983004:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5410 00010000:00010000:2.0:1746143774.983070:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a84a3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8f3 expref: 28 pid: 1947 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.983085:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626703232:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143774.983258:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.983523:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622410880 00000100:00100000:2.0:1746143774.983527:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622410880 00010000:00010000:2.0:1746143774.983542:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 38 pid: 1947 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.983576:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5411 00000100:00100000:2.0:1746143774.983581:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963622410880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143774.983588:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143774.983596:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 38 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.983604:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 38 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.983619:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73a84aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8fa expref: 38 pid: 1947 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143774.983627:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143774.983647:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622410880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.983652:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5411 00000100:00100000:0.0:1746143774.986710:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.986738:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143774.986765:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.986830:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622411136 00000100:00100000:3.0:1746143774.986837:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622411136 00010000:00010000:3.0:1746143774.986864:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73a851a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a947 expref: 9 pid: 1945 timeout: 934 lvb_type: 1 00000100:00100000:3.0:1746143774.986889:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622411264 00000100:00100000:3.0:1746143774.986891:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622411264 00010000:00010000:3.0:1746143774.986901:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a84c6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a916 expref: 28 pid: 3135 timeout: 934 lvb_type: 1 00000100:00100000:3.0:1746143774.986935:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622411392 00000100:00100000:3.0:1746143774.986938:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622411392 00010000:00010000:3.0:1746143774.986956:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 37 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143774.986972:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5412 00000100:00100000:3.0:1746143774.986978:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622411136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.986988:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.987003:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73a851a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a947 expref: 9 pid: 1945 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746143774.987010:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73a851a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a947 expref: 9 pid: 1945 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746143774.987028:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.987071:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622411136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.987077:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5412 00000100:00100000:3.0:1746143774.987092:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5413 00000100:00100000:3.0:1746143774.987097:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963622411264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.987106:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.987112:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a84c6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a916 expref: 28 pid: 3135 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746143774.987120:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a84c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a916 expref: 28 pid: 3135 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746143774.987129:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.987141:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963622411264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.987147:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5413 00000100:00100000:3.0:1746143774.987155:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5414 00000100:00100000:3.0:1746143774.987159:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963622411392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.987164:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.987169:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 37 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143774.987177:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 37 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143774.987186:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.987188:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143774.987193:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.987201:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.987228:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143774.987239:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626703744:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143774.987282:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561180 going to sleep for 11 seconds 00010000:00010000:2.0:1746143774.987365:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32000/0x87925e4cb73a84c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a916 expref: 27 pid: 3135 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746143774.987378:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626703360:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.987386:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73a851a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a947 expref: 8 pid: 1945 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746143774.987394:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626703488:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.987401:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73a84bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4780031) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a90f expref: 37 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143774.987408:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626703616:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143774.987434:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.987442:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32400, rc 0) 00000100:00100000:2.0:1746143774.987460:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:32019:x1830963622410752:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 12653us (13336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143774.987466:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11547 00000100:00100000:0.0:1746143774.992777:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143774.992846:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622411648 00000100:00100000:2.0:1746143774.992854:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622411648 00002000:00100000:2.0:1746143774.992889:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3158016->3162111) req@ffff880092b45c00 x1830963622411648/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/0 e 0 to 0 dl 1746143785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.992897:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45c00 with x1830963622411648 ext(3158016->3162111) 00002000:00010000:2.0:1746143774.992902:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b45c00 00000100:00100000:2.0:1746143774.992955:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3272 00000100:00100000:2.0:1746143774.992961:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622411648:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143774.993072:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622411648:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 111us (302us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143774.993078:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3272 00002000:00100000:2.0:1746143774.993084:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3158016->3162111) req@ffff880092b45c00 x1830963622411648/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:170/0 lens 488/4536 e 0 to 0 dl 1746143785 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143774.993090:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45c00 with x1830963622411648 ext(3158016->3162111) 00002000:00010000:2.0:1746143774.993093:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b45c00 00000100:00100000:3.0:1746143774.996414:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626703744:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143774.996432:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.996488:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4da1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622411392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9327us (9720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.996498:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5414 00000100:00100000:0.0:1746143774.996856:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143774.997883:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622411904 00000100:00100000:3.0:1746143774.997889:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622411904 00000100:00100000:3.0:1746143774.997968:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12802 00000100:00100000:3.0:1746143774.997975:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32023:x1830963622411904:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143774.997994:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143774.998009:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73a8591 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a978 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.998086:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.998097:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143774.998105:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143774.998117:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143774.998189:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73a8591 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a978 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.998217:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a978 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143774.998224:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143774.998226:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143774.998228:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd86600, rc 0) 00000100:00100000:3.0:1746143774.998260:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32023:x1830963622411904:12345-192.168.202.3@tcp:101:cat.0 Request processed in 285us (1405us total) trans 8589943532 rc 0/0 00000100:00100000:3.0:1746143774.998266:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12802 00000100:00100000:0.0:1746143775.004880:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.004961:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622412160 00000100:00100000:1.0:1746143775.004968:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622412160 00002000:00100000:1.0:1746143775.005016:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3452928->3457023) req@ffff880092b45500 x1830963622412160/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.005024:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45500 with x1830963622412160 ext(3452928->3457023) 00002000:00010000:1.0:1746143775.005028:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b45500 00000100:00100000:1.0:1746143775.005092:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3273 00000100:00100000:1.0:1746143775.005098:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622412160:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143775.005390:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622412160:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 291us (516us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143775.005397:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3273 00002000:00100000:1.0:1746143775.005402:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3452928->3457023) req@ffff880092b45500 x1830963622412160/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.005408:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45500 with x1830963622412160 ext(3452928->3457023) 00002000:00010000:1.0:1746143775.005410:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b45500 00000100:00080000:3.0:1746143775.006741:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143775.009879:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.010070:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622412416 00000100:00100000:3.0:1746143775.010079:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622412416 00000100:00100000:3.0:1746143775.010142:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4670 00000100:00100000:3.0:1746143775.010150:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32019:x1830963622412416:12345-192.168.202.3@tcp:35:multiop.0 00000100:00080000:0.0:1746143775.010234:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143775.011370:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32019:x1830963622412416:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 1217us (1498us total) trans 8589943533 rc 0/0 00000100:00100000:3.0:1746143775.011378:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4670 00000100:00100000:0.0:1746143775.014506:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.014586:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622412672 00000100:00100000:1.0:1746143775.014593:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622412672 00002000:00100000:1.0:1746143775.014627:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b44000 x1830963622412672/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.014635:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44000 with x1830963622412672 ext(0->1048575) 00002000:00010000:1.0:1746143775.014640:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b44000 00000100:00100000:1.0:1746143775.014670:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3274 00000100:00100000:1.0:1746143775.014676:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622412672:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143775.024271:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622412672:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9586us (9762us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143775.024281:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3274 00002000:00100000:1.0:1746143775.024290:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b44000 x1830963622412672/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.024298:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44000 with x1830963622412672 ext(0->1048575) 00002000:00010000:1.0:1746143775.024303:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b44000 00000100:00100000:0.0:1746143775.026295:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.026384:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622412800 00000100:00100000:2.0:1746143775.026391:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622412800 00000100:00100000:2.0:1746143775.026450:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11548 00000100:00100000:2.0:1746143775.026458:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:32016:x1830963622412800:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143775.026472:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.026487:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a97f expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.026515:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.026521:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a852f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a94e expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.026527:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a849c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8e5 expref: 45 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.026532:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.026534:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.026536:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3194880->3866623] (req 3194880->3866623) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.026560:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a849c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8e5 expref: 45 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.026571:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a849c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8e5 expref: 45 pid: 1945 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.026582:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626703872:192.168.202.3@tcp:104: 00000100:00080000:0.0:1746143775.026672:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746143775.027320:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a852f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a94e expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.029008:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a852f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a94e expref: 9 pid: 12327 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746143775.029029:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626704000:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.029095:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.029104:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 21 pid: 1945 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.029112:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626704128:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.029128:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.030249:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626703872:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.032327:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626704000:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.032335:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626704128:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.032358:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3194880->3866623] (req 3194880->3866623) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.032371:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e600, rc 0) 00000100:00100000:2.0:1746143775.032400:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+45:32016:x1830963622412800:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5943us (6110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.032407:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11548 00000100:00100000:0.0:1746143775.037656:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.037700:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.037931:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622413056 00000100:00100000:1.0:1746143775.037939:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622413056 00000100:00100000:3.0:1746143775.037971:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622412928 00010000:00010000:1.0:1746143775.037979:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a849c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8e5 expref: 45 pid: 1945 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143775.037980:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622412928 00000100:00100000:1.0:1746143775.038021:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5415 00010000:00010000:3.0:1746143775.038023:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a852f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a94e expref: 10 pid: 12327 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746143775.038029:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622413056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.038041:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143775.038048:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5416 00000100:00100000:3.0:1746143775.038054:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622412928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.038059:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a849c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8e5 expref: 45 pid: 1945 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.038064:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.038069:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a849c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8e5 expref: 45 pid: 1945 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.038097:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096011c00/0x87925e4cb73a849c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8e5 expref: 45 pid: 1945 timeout: 934 lvb_type: 0 00000100:00080000:0.0:1746143775.038194:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746143775.040044:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a852f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a94e expref: 10 pid: 12327 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746143775.040060:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a852f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a94e expref: 10 pid: 12327 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746143775.040081:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a852f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a94e expref: 10 pid: 12327 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746143775.040115:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143775.040170:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622412928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2115us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.040180:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5416 00010000:00010000:1.0:1746143775.040455:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.040503:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622413056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2471us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.040513:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5415 00000100:00100000:0.0:1746143775.041100:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.041152:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622413184 00000100:00100000:2.0:1746143775.041162:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622413184 00010000:00010000:2.0:1746143775.041203:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 22 pid: 1945 timeout: 934 lvb_type: 0 00000100:00080000:1.0:1746143775.041226:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143775.041236:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5417 00000100:00100000:2.0:1746143775.041244:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622413184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.041514:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.041533:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 22 pid: 1945 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.041544:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 22 pid: 1945 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.041560:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73a848e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a8de expref: 22 pid: 1945 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.041576:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.041578:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.041585:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.041591:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.041624:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.041636:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626704256:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143775.041719:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143775.044255:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626704256:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143775.044279:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143775.045067:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622413184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3820us (3964us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.045078:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5417 00000100:00100000:1.0:1746143775.045259:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.045828:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622413440 00000100:00100000:0.0:1746143775.045835:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622413440 00002000:00100000:0.0:1746143775.045879:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3194880->3198975) req@ffff880091bca680 x1830963622413440/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.045888:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bca680 with x1830963622413440 ext(3194880->3198975) 00002000:00010000:0.0:1746143775.045893:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bca680 00000100:00100000:2.0:1746143775.046021:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.046276:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622413696 00000100:00100000:0.0:1746143775.046279:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622413696 00000100:00100000:3.0:1746143775.046370:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3275 00000100:00100000:3.0:1746143775.046385:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622413440:12345-192.168.202.3@tcp:3:multiop.0 00002000:00100000:0.0:1746143775.046568:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880092ef0000 x1830963622413696/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.046575:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0000 with x1830963622413696 ext(2097152->3145727) 00002000:00010000:0.0:1746143775.046579:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef0000 00000100:00100000:0.0:1746143775.046600:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3276 00000100:00100000:0.0:1746143775.046606:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622413696:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143775.047812:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622413440:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 1429us (2548us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143775.047820:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3275 00002000:00100000:3.0:1746143775.047829:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (3194880->3198975) req@ffff880091bca680 x1830963622413440/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.047837:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bca680 with x1830963622413440 ext(3194880->3198975) 00002000:00010000:3.0:1746143775.047840:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bca680 00000100:00100000:2.0:1746143775.062679:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622413696:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16059us (16648us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143775.062693:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3276 00002000:00100000:2.0:1746143775.062707:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880092ef0000 x1830963622413696/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.062716:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0000 with x1830963622413696 ext(2097152->3145727) 00002000:00010000:2.0:1746143775.062723:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef0000 00000100:00100000:0.0:1746143775.064975:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.065155:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622413952 00000100:00100000:2.0:1746143775.065166:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622413952 00002000:00100000:2.0:1746143775.065215:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3862528->3866623) req@ffff880092b45180 x1830963622413952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.065224:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45180 with x1830963622413952 ext(3862528->3866623) 00002000:00010000:2.0:1746143775.065229:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b45180 00000100:00100000:2.0:1746143775.065260:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3277 00000100:00100000:2.0:1746143775.065268:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622413952:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143775.065892:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622413952:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 624us (924us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143775.065902:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3277 00002000:00100000:2.0:1746143775.065908:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3862528->3866623) req@ffff880092b45180 x1830963622413952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.066534:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45180 with x1830963622413952 ext(3862528->3866623) 00002000:00010000:2.0:1746143775.066538:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b45180 00000100:00100000:0.0:1746143775.071629:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.071980:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622414080 00000100:00100000:2.0:1746143775.071992:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622414080 00000100:00100000:2.0:1746143775.072055:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11549 00000100:00100000:2.0:1746143775.072064:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32023:x1830963622414080:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143775.072085:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.072104:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a986 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.072135:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.072143:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143775.072145:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143775.072148:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.072180:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.072192:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 43 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.072204:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626704384:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.072294:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.078632:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626704384:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.078669:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.078697:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7f400, rc 0) 00000100:00100000:1.0:1746143775.078707:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.078776:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622414208 00000100:00100000:3.0:1746143775.078784:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622414208 00002000:00100000:3.0:1746143775.078831:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3194880->3866623) req@ffff880091bcbb80 x1830963622414208/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.078840:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcbb80 with x1830963622414208 ext(3194880->3866623) 00010000:00010000:3.0:1746143775.078848:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 44 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.078860:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 44 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143775.078866:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bcbb80 00000100:00100000:3.0:1746143775.078891:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1392 00000100:00100000:3.0:1746143775.078899:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622414208:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143775.080231:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:32023:x1830963622414080:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8162us (8608us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.080232:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.080239:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11549 00000100:00100000:3.0:1746143775.080298:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622414464 00000100:00100000:3.0:1746143775.080303:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622414464 00000100:00100000:3.0:1746143775.080342:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4671 00000100:00100000:3.0:1746143775.080349:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+265:32016:x1830963622414464:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143775.080527:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+266:32016:x1830963622414464:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 179us (296us total) trans 8589943534 rc 0/0 00000100:00100000:3.0:1746143775.080534:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4671 00000100:00080000:1.0:1746143775.080628:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143775.087235:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622414208:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8324us (8517us total) trans 17179872945 rc 0/0 00000100:00100000:3.0:1746143775.087248:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1392 00002000:00100000:3.0:1746143775.087261:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3194880->3866623) req@ffff880091bcbb80 x1830963622414208/t17179872945(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/448 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.087270:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcbb80 with x1830963622414208 ext(3194880->3866623) 00010000:00010000:3.0:1746143775.087280:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 46 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.087296:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 46 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143775.087304:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bcbb80 00000100:00100000:0.0:1746143775.092038:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.092199:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622414592 00000100:00100000:3.0:1746143775.092210:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622414592 00010000:00010000:3.0:1746143775.092251:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 46 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143775.092298:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5418 00000100:00100000:3.0:1746143775.092307:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622414592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143775.092328:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143775.092353:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 46 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.092365:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 46 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.092395:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7e600/0x87925e4cb73a85a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->3866623) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a97f expref: 46 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.092427:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.092429:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.092437:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.092444:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.092484:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.092496:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626704512:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143775.092584:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143775.096434:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626704512:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143775.096459:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143775.096503:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963622414592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4197us (4476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.096514:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5418 00000100:00100000:0.0:1746143775.099769:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.100084:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.100239:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622414848 00000100:00100000:2.0:1746143775.100249:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622414848 00002000:00100000:2.0:1746143775.100296:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880092b45880 x1830963622414848/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.100305:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45880 with x1830963622414848 ext(2097152->4194303) 00002000:00010000:2.0:1746143775.100310:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b45880 00000100:00100000:2.0:1746143775.100335:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622415104 00000100:00100000:2.0:1746143775.100336:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622415104 00002000:00100000:2.0:1746143775.100346:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092b62d80 x1830963622415104/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 504/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.100353:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62d80 with x1830963622415104 ext(3145728->4194303) 00002000:00010000:2.0:1746143775.100356:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b62d80 00000100:00100000:2.0:1746143775.100377:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3278 00000100:00100000:2.0:1746143775.100384:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622414848:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143775.100413:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3279 00000100:00100000:1.0:1746143775.100421:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622415104:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143775.103035:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.103126:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622415360 00000100:00100000:3.0:1746143775.103135:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622415360 00000100:00100000:3.0:1746143775.103180:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12803 00000100:00100000:3.0:1746143775.103187:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:32028:x1830963622415360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.103217:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.103237:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a85b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a98d expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.103317:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103329:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103339:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103352:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a85c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103357:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a85c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103362:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a85c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103459:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103468:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103473:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143775.103481:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143775.103556:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103565:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103570:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103575:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103580:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.103583:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103589:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103599:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143775.103602:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.103605:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.103610:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a85bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.106553:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a85c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.106570:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a85c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.106577:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a85c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.106583:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ecd800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.106589:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a85c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.106597:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a85c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.106614:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009632eb00) 00010000:00010000:3.0:1746143775.106617:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.106622:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a85c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.106627:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73a85c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.106705:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a85b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a98d expref: 269 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.106720:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a98d expref: 268 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.106726:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.106728:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143775.106730:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a45c00, rc 0) 00000100:00100000:3.0:1746143775.106950:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:32028:x1830963622415360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3751us (3912us total) trans 8589943535 rc 0/0 00000100:00100000:3.0:1746143775.106960:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12803 00000100:00100000:0.0:1746143775.108023:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622415104:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7599us (7935us total) trans 0 rc 749568/749568 00000100:00100000:0.0:1746143775.108034:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3279 00002000:00100000:0.0:1746143775.108044:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092b62d80 x1830963622415104/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 504/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 749568/749568 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.108054:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62d80 with x1830963622415104 ext(3145728->4194303) 00002000:00010000:0.0:1746143775.108059:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b62d80 00000100:00100000:2.0:1746143775.114087:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622414848:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13692us (14317us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143775.114100:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3278 00002000:00100000:2.0:1746143775.114111:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880092b45880 x1830963622414848/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.114126:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45880 with x1830963622414848 ext(2097152->4194303) 00002000:00010000:2.0:1746143775.114132:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b45880 00000100:00100000:0.0:1746143775.117041:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.117090:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.117174:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622415488 00000100:00100000:1.0:1746143775.117185:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622415488 00000100:00100000:1.0:1746143775.117249:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622415616 00000100:00100000:1.0:1746143775.117252:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622415616 00000100:00100000:1.0:1746143775.117269:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11550 00000100:00100000:1.0:1746143775.117276:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622415488:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143775.117282:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11551 00000100:00100000:3.0:1746143775.117288:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622415616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.117296:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143775.117296:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.117314:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a85d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a99b expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.117314:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e76200/0x87925e4cb73a85de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a994 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.117337:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.117338:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.117347:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a85d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a99b expref: 46 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.117361:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a85d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a99b expref: 46 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143775.117365:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626704640:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143775.117372:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ac00, rc 0) 00000100:00100000:3.0:1746143775.117412:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622415616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 123us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.117418:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11551 00000100:00080000:0.0:1746143775.117502:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143775.118168:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143775.122825:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626704640:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143775.122864:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e76200/0x87925e4cb73a85de lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a994 expref: 37 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.122879:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e76200/0x87925e4cb73a85de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a994 expref: 37 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.122895:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76200, rc 0) 00000100:00100000:1.0:1746143775.123093:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622415488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5815us (6060us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143775.123102:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11550 00000100:00100000:0.0:1746143775.125515:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.125627:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622415872 00000100:00100000:2.0:1746143775.125636:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622415872 00002000:00100000:2.0:1746143775.125685:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880092b63480 x1830963622415872/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.125695:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b63480 with x1830963622415872 ext(4194304->4780031) 00002000:00010000:2.0:1746143775.125704:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b63480 00000100:00100000:2.0:1746143775.125735:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3280 00000100:00100000:2.0:1746143775.125744:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622415872:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143775.129962:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.130036:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622416128 00000100:00100000:2.0:1746143775.130046:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622416128 00002000:00100000:2.0:1746143775.130092:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b60e00 x1830963622416128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.130101:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60e00 with x1830963622416128 ext(0->1048575) 00002000:00010000:2.0:1746143775.130107:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b60e00 00000100:00100000:3.0:1746143775.130330:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622415872:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4584us (4821us total) trans 0 rc 585728/585728 00000100:00100000:2.0:1746143775.130332:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3281 00000100:00100000:3.0:1746143775.130338:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3280 00000100:00100000:2.0:1746143775.130340:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622416128:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143775.130343:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880092b63480 x1830963622415872/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.130350:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b63480 with x1830963622415872 ext(4194304->4780031) 00002000:00010000:3.0:1746143775.130354:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b63480 00000100:00100000:3.0:1746143775.140043:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622416128:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9692us (10128us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143775.140055:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3281 00002000:00100000:3.0:1746143775.140066:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b60e00 x1830963622416128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.140081:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60e00 with x1830963622416128 ext(0->1048575) 00002000:00010000:3.0:1746143775.140087:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b60e00 00000100:00100000:0.0:1746143775.146036:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.146142:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622416384 00000100:00100000:2.0:1746143775.146153:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622416384 00000100:00100000:2.0:1746143775.146507:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12804 00000100:00100000:2.0:1746143775.146516:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32030:x1830963622416384:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143775.146544:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.146564:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a85e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9a2 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.146671:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.146686:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a95c expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.146693:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a963 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.146700:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a98d expref: 267 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.146707:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.146741:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a98d expref: 267 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.146752:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a98d expref: 267 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.146763:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626704768:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.149773:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a963 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.149794:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a963 expref: 16 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.149815:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626704896:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143775.150513:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.150640:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622416512 00000100:00100000:3.0:1746143775.150649:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622416512 00010000:00010000:3.0:1746143775.150681:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a98d expref: 268 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.150702:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a95c expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.150708:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5419 00010000:00010000:2.0:1746143775.150712:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a95c expref: 8 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143775.150717:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+268:2011:x1830963622416512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143775.150721:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626705024:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.150730:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143775.150736:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a98d expref: 268 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.150746:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a98d expref: 268 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.150754:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4600 going to sleep for 11 seconds 00010000:00010000:3.0:1746143775.150770:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.150775:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.150781:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a85c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a98d expref: 268 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.150784:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143775.150790:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.150798:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626704768:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.150818:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+267:2011:x1830963622416512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 102us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.150825:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5419 00000100:00100000:0.0:1746143775.154178:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.154232:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.154297:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622416640 00000100:00100000:1.0:1746143775.154306:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622416640 00000100:00100000:3.0:1746143775.154311:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622416768 00000100:00100000:3.0:1746143775.154315:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622416768 00010000:00010000:3.0:1746143775.154342:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a963 expref: 17 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.154342:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a95c expref: 9 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143775.154369:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5420 00000100:00100000:1.0:1746143775.154375:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5421 00000100:00100000:3.0:1746143775.154376:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622416768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143775.154380:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622416640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.154389:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143775.154390:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143775.154394:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a963 expref: 17 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.154394:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a95c expref: 9 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.154403:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a95c expref: 9 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.154414:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a963 expref: 17 pid: 7244 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.154418:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626704896:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.154427:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626705024:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143775.154434:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73a8552 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a95c expref: 9 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.154438:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73a856e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a963 expref: 17 pid: 7244 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.154449:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.154454:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143775.154463:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143775.154468:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143775.154474:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143775.154477:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143775.154483:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143775.154513:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622416768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 136us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.154513:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622416640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 131us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.154519:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5421 00000100:00100000:3.0:1746143775.154521:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5420 00010000:00010000:2.0:1746143775.154692:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.154702:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.154707:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143775.154728:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143775.154855:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a85e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a2 expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.154886:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a2 expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.154897:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.154900:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143775.154902:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7fa00, rc 0) 00000100:00100000:2.0:1746143775.154967:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32030:x1830963622416384:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8451us (8940us total) trans 8589943536 rc 0/0 00000100:00100000:2.0:1746143775.154973:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12804 00000100:00100000:0.0:1746143775.157103:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.157527:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622416896 00000100:00100000:1.0:1746143775.157537:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622416896 00000100:00100000:1.0:1746143775.157592:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11552 00000100:00100000:1.0:1746143775.157600:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:32028:x1830963622416896:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143775.157623:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143775.157641:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9a9 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.157672:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.157684:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143775.157686:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143775.157689:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.157720:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.157731:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 25 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143775.157743:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626705152:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143775.157824:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.163278:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626705152:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.163306:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.163320:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76800, rc 0) 00000100:00100000:2.0:1746143775.163373:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:32028:x1830963622416896:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5773us (6277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.163381:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11552 00000100:00100000:0.0:1746143775.164318:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.164355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.164424:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622417024 00000100:00100000:3.0:1746143775.164432:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622417024 00002000:00100000:3.0:1746143775.164475:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3158016->3457023) req@ffff880092b61c00 x1830963622417024/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.164484:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61c00 with x1830963622417024 ext(3158016->3457023) 00010000:00010000:3.0:1746143775.164491:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 26 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.164503:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 26 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143775.164510:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b61c00 00000100:00100000:3.0:1746143775.164670:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622417280 00000100:00100000:3.0:1746143775.164673:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622417280 00002000:00100000:3.0:1746143775.164687:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3518464->3719167) req@ffff880092b60700 x1830963622417280/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.164693:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60700 with x1830963622417280 ext(3518464->3719167) 00010000:00010000:3.0:1746143775.164697:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 27 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.164705:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 27 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143775.164710:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b60700 00000100:00100000:3.0:1746143775.164723:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1393 00000100:00100000:3.0:1746143775.164730:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622417024:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143775.164838:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1394 00000100:00100000:2.0:1746143775.164846:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963622417280:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143775.173229:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2008:x1830963622417024:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8486us (8900us total) trans 21474840267 rc 0/0 00000100:00100000:3.0:1746143775.173242:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1393 00002000:00100000:3.0:1746143775.173253:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3158016->3457023) req@ffff880092b61c00 x1830963622417024/t21474840267(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/448 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.173264:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61c00 with x1830963622417024 ext(3158016->3457023) 00010000:00010000:3.0:1746143775.173275:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 32 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.173291:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 32 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143775.173298:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b61c00 00000100:00100000:2.0:1746143775.173491:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622417280:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8646us (9134us total) trans 21474840266 rc 0/0 00000100:00100000:2.0:1746143775.173499:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1394 00002000:00100000:2.0:1746143775.173504:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3518464->3719167) req@ffff880092b60700 x1830963622417280/t21474840266(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/448 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.173515:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60700 with x1830963622417280 ext(3518464->3719167) 00010000:00010000:2.0:1746143775.173519:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.173529:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746143775.173534:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b60700 00000100:00100000:0.0:1746143775.177410:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.177563:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622417408 00000100:00100000:3.0:1746143775.177573:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622417408 00010000:00010000:3.0:1746143775.177614:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143775.177698:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5422 00000100:00100000:3.0:1746143775.177706:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622417408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143775.177723:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143775.177743:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.177759:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.177783:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73a858a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3158016->3457023) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a971 expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.177814:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.177816:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.177821:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.177827:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.177857:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.177867:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626705280:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143775.178144:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143775.180961:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626705280:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143775.180983:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143775.181024:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622417408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3318us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.181034:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5422 00000100:00100000:1.0:1746143775.187538:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.187593:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.187670:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622417792 00000100:00100000:2.0:1746143775.187680:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622417792 00002000:00100000:2.0:1746143775.187731:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091bcb100 x1830963622417792/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.187741:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcb100 with x1830963622417792 ext(2097152->4194303) 00002000:00010000:2.0:1746143775.187746:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bcb100 00000100:00100000:2.0:1746143775.187771:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622417920 00000100:00100000:2.0:1746143775.187774:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622417920 00002000:00100000:2.0:1746143775.187787:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bc9500 x1830963622417920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.187793:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc9500 with x1830963622417920 ext(2097152->4194303) 00002000:00010000:2.0:1746143775.187796:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc9500 00000100:00100000:2.0:1746143775.187807:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3282 00000100:00100000:2.0:1746143775.187814:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622417792:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143775.188009:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3283 00000100:00100000:3.0:1746143775.188019:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622417920:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143775.211172:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622417920:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23144us (23567us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143775.211185:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3283 00002000:00100000:3.0:1746143775.211196:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bc9500 x1830963622417920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.211206:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc9500 with x1830963622417920 ext(2097152->4194303) 00002000:00010000:3.0:1746143775.211212:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc9500 00000100:00100000:2.0:1746143775.213712:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622417792:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25887us (26175us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143775.213728:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3282 00002000:00100000:2.0:1746143775.213741:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091bcb100 x1830963622417792/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.213751:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcb100 with x1830963622417792 ext(2097152->4194303) 00002000:00010000:2.0:1746143775.213757:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bcb100 00000100:00100000:0.0:1746143775.226679:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.227574:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622418176 00000100:00100000:2.0:1746143775.227587:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622418176 00002000:00100000:2.0:1746143775.227642:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880092b61880 x1830963622418176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.227652:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61880 with x1830963622418176 ext(4194304->4780031) 00002000:00010000:2.0:1746143775.227659:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b61880 00000100:00100000:2.0:1746143775.227698:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3284 00000100:00100000:2.0:1746143775.227707:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963622418176:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143775.246486:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963622418176:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18767us (19805us total) trans 0 rc 585728/585728 00000100:00100000:2.0:1746143775.246497:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3284 00002000:00100000:2.0:1746143775.246510:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880092b61880 x1830963622418176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.246519:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61880 with x1830963622418176 ext(4194304->4780031) 00002000:00010000:2.0:1746143775.246525:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b61880 00000100:00100000:0.0:1746143775.258630:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.258747:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622418432 00000100:00100000:1.0:1746143775.258758:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622418432 00000100:00100000:3.0:1746143775.259720:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4672 00000100:00100000:3.0:1746143775.259733:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+267:32028:x1830963622418432:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143775.263734:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+268:32028:x1830963622418432:12345-192.168.202.3@tcp:35:cat.0 Request processed in 3947us (5057us total) trans 8589943537 rc 0/0 00000100:00100000:3.0:1746143775.263748:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4672 00000100:00100000:0.0:1746143775.264329:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.264414:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622418688 00000100:00100000:2.0:1746143775.264423:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622418688 00000100:00100000:2.0:1746143775.264475:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12805 00000100:00100000:2.0:1746143775.264483:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32035:x1830963622418688:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143775.264510:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.264530:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9b0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.264607:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264619:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264629:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264642:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a860f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264648:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264653:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264749:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264759:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264764:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143775.264773:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143775.264842:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264851:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264855:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264861:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264866:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7ec00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143775.264870:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264876:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264885:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143775.264888:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143775.264891:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264896:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a8608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264936:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264950:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a860f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264954:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a860f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264958:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7ea00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143775.264961:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a860f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264965:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a860f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264971:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d800) 00010000:00010000:2.0:1746143775.264973:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143775.264975:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a860f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.264979:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73a860f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143775.265014:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73a8601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b0 expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.265024:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b0 expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.265029:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.265031:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143775.265033:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e000, rc 0) 00000100:00100000:2.0:1746143775.265075:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32035:x1830963622418688:12345-192.168.202.3@tcp:101:cat.0 Request processed in 593us (748us total) trans 8589943538 rc 0/0 00000100:00100000:2.0:1746143775.265081:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12805 00000100:00100000:0.0:1746143775.268021:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.268112:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622418944 00000100:00100000:3.0:1746143775.268123:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622418944 00000100:00100000:3.0:1746143775.268212:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4673 00000100:00100000:3.0:1746143775.268223:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32035:x1830963622418944:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143775.268739:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32035:x1830963622418944:12345-192.168.202.3@tcp:35:cat.0 Request processed in 518us (727us total) trans 8589943539 rc 0/0 00000100:00100000:3.0:1746143775.268745:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4673 00000100:00100000:0.0:1746143775.280035:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.283531:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622419072 00000100:00100000:2.0:1746143775.283547:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622419072 00000100:00100000:2.0:1746143775.283635:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11553 00000100:00100000:2.0:1746143775.283645:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622419072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143775.283670:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.283689:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8624 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9b7 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.283715:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.283717:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.283726:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8624 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b7 expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.283743:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8624 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b7 expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.283755:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e600, rc 0) 00000100:00100000:2.0:1746143775.283816:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622419072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 172us (3792us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.283822:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11553 00000100:00100000:0.0:1746143775.297776:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.297881:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622419328 00000100:00100000:3.0:1746143775.297890:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622419328 00000100:00100000:3.0:1746143775.298040:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12806 00000100:00100000:3.0:1746143775.298049:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32038:x1830963622419328:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143775.298079:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.298101:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a862b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9be expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.298186:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298199:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298210:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298222:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8639 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298228:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298233:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298343:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73a8640 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298354:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73a8640 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298360:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73a8640 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143775.298369:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143775.298458:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298469:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298474:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298479:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298484:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8a200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.298488:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298494:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298504:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143775.298506:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.298509:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298514:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a8632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298528:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298533:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8639 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298538:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298542:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8ae00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.298545:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298549:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8639 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298554:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14000) 00010000:00010000:3.0:1746143775.298556:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.298558:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8639 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298562:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8639 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.298597:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a862b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9be expref: 22 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.298609:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73a8640 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9be expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.298614:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.298616:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143775.298619:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd87200, rc 0) 00000100:00100000:3.0:1746143775.298877:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32038:x1830963622419328:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 829us (1112us total) trans 8589943540 rc 0/0 00000100:00100000:3.0:1746143775.298885:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12806 00000100:00100000:0.0:1746143775.301390:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.301443:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.301654:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622419712 00000100:00100000:2.0:1746143775.301665:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622419712 00000100:00100000:2.0:1746143775.301712:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4674 00000100:00100000:2.0:1746143775.301719:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32038:x1830963622419712:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143775.301979:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:32038:x1830963622419712:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 260us (534us total) trans 8589943541 rc 0/0 00000100:00100000:2.0:1746143775.301986:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4674 00000100:00100000:3.0:1746143775.302370:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622419456 00000100:00100000:3.0:1746143775.302375:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622419456 00000100:00100000:3.0:1746143775.302405:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 742 00000100:00100000:3.0:1746143775.302410:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622419456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143775.302425:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143775.302450:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73a8640 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9be expref: 22 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.303559:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.303568:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143775.304258:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622419456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1843us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.304267:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 742 00000100:00100000:0.0:1746143775.312739:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.313409:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622419968 00000100:00100000:2.0:1746143775.313422:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622419968 00002000:00100000:2.0:1746143775.313483:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091d4fb80 x1830963622419968/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.313499:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4fb80 with x1830963622419968 ext(2097152->4194303) 00002000:00010000:2.0:1746143775.313506:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4fb80 00000100:00100000:2.0:1746143775.313556:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3285 00000100:00100000:2.0:1746143775.313568:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622419968:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143775.334735:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622419968:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21158us (21998us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143775.334747:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3285 00002000:00100000:3.0:1746143775.334760:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091d4fb80 x1830963622419968/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.334770:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4fb80 with x1830963622419968 ext(2097152->4194303) 00002000:00010000:3.0:1746143775.334775:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4fb80 00000100:00100000:1.0:1746143775.334923:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.334994:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622420224 00000100:00100000:3.0:1746143775.335002:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622420224 00000100:00100000:3.0:1746143775.335055:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12807 00000100:00100000:3.0:1746143775.335062:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:32040:x1830963622420224:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143775.335088:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.335107:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a864e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9c5 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.335181:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335197:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335206:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335215:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a865c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335218:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a865c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335221:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a865c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335311:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a8663 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335317:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a8663 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335320:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a8663 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143775.335325:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143775.335386:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335389:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335393:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335396:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335401:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.335405:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335409:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335416:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143775.335418:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.335420:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335423:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335441:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a865c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335446:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a865c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335450:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a865c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335455:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.335457:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a865c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335461:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a865c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335467:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14b00) 00010000:00010000:3.0:1746143775.335469:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.335471:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a865c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335475:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a865c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.335509:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73a864e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9c5 expref: 271 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.335519:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a8663 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9c5 expref: 270 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.335524:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.335526:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143775.335528:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74600, rc 0) 00000100:00100000:3.0:1746143775.335558:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:32040:x1830963622420224:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 496us (650us total) trans 8589943542 rc 0/0 00000100:00100000:3.0:1746143775.335564:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12807 00000100:00100000:0.0:1746143775.342179:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.342397:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622420352 00000100:00100000:3.0:1746143775.342407:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622420352 00000100:00100000:3.0:1746143775.342461:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 743 00000100:00100000:3.0:1746143775.342469:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+270:2008:x1830963622420352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143775.342487:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143775.342517:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73a8663 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9c5 expref: 270 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.342550:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.342554:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143775.342601:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+269:2008:x1830963622420352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 133us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.342608:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 743 00000100:00100000:3.0:1746143775.345204:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.345254:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622420608 00000100:00100000:0.0:1746143775.345265:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622420608 00002000:00100000:0.0:1746143775.345315:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88012457f100 x1830963622420608/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.345324:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f100 with x1830963622420608 ext(4194304->4780031) 00002000:00010000:0.0:1746143775.345330:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457f100 00000100:00100000:0.0:1746143775.345361:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3286 00000100:00100000:0.0:1746143775.345369:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622420608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143775.356767:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622420608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11386us (11560us total) trans 0 rc 585728/585728 00000100:00100000:2.0:1746143775.356780:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3286 00002000:00100000:2.0:1746143775.356793:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88012457f100 x1830963622420608/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.356803:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f100 with x1830963622420608 ext(4194304->4780031) 00002000:00010000:2.0:1746143775.356810:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457f100 00000100:00100000:0.0:1746143775.360175:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.361130:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622420736 00000100:00100000:3.0:1746143775.361146:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622420736 00000100:00100000:3.0:1746143775.361230:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11554 00000100:00100000:3.0:1746143775.361241:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:32040:x1830963622420736:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143775.361265:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.361287:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9cc expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.361323:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 38 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.361333:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8624 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b7 expref: 29 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.361340:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.361341:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.361345:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2916352->3145727] (req 2916352->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.361382:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8624 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b7 expref: 29 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.361395:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8624 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b7 expref: 29 pid: 13436 timeout: 934 lvb_type: 1 00000100:00100000:3.0:1746143775.361414:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626705408:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.362561:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 38 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.362570:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 38 pid: 13436 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746143775.362579:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626705536:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.362879:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143775.366834:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626705408:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.366853:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626705536:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.366894:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2916352->3145727] (req 2916352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.366964:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:3.0:1746143775.367041:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+38:32040:x1830963622420736:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5799us (6876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.367051:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11554 00000100:00100000:0.0:1746143775.369605:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.370381:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622420864 00000100:00100000:3.0:1746143775.370391:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622420864 00000100:00100000:2.0:1746143775.370830:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11555 00000100:00100000:2.0:1746143775.370838:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622420864:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143775.370856:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.370874:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8678 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9d3 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.370899:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.370909:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8678 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9d3 expref: 31 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.370932:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a8678 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9d3 expref: 31 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.371190:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33a00, rc 0) 00000100:00100000:2.0:1746143775.373038:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622420864:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2192us (3434us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143775.373047:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11555 00000100:00100000:0.0:1746143775.373847:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.373891:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.374666:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622421120 00000100:00100000:2.0:1746143775.374676:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622421120 00010000:00010000:2.0:1746143775.374713:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 38 pid: 13436 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.375363:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622420992 00000100:00100000:2.0:1746143775.375367:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622420992 00010000:00010000:2.0:1746143775.375382:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8624 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b7 expref: 30 pid: 13436 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746143775.375398:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5423 00000100:00100000:2.0:1746143775.375405:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963622421120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.375419:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.375439:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 38 pid: 13436 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.375449:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 38 pid: 13436 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.375472:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73a85fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a9 expref: 38 pid: 13436 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.375492:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.375534:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622421120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 129us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.375540:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5423 00000100:00100000:2.0:1746143775.375556:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5424 00000100:00100000:2.0:1746143775.375560:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622420992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.375568:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.375574:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8624 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b7 expref: 30 pid: 13436 timeout: 934 lvb_type: 1 00010000:00010000:2.0:1746143775.375583:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8624 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b7 expref: 30 pid: 13436 timeout: 934 lvb_type: 1 00010000:00010000:2.0:1746143775.375593:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a8624 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b7 expref: 30 pid: 13436 timeout: 934 lvb_type: 1 00010000:00010000:2.0:1746143775.375602:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.375605:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.375611:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.375618:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.375650:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.375663:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626705664:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143775.375715:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.377775:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626705664:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143775.377801:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.377851:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2010:x1830963622420992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2286us (3955us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.377861:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5424 00000100:00100000:0.0:1746143775.378200:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.380011:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.380043:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622421376 00000100:00100000:3.0:1746143775.380053:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622421376 00000100:00100000:2.0:1746143775.380080:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622421504 00000100:00100000:2.0:1746143775.380083:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622421504 00002000:00100000:3.0:1746143775.380106:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2916352->2920447) req@ffff880092b72d80 x1830963622421376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143775.380112:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11556 00000100:00100000:2.0:1746143775.380119:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32035:x1830963622421504:12345-192.168.202.3@tcp:101:cat.0 00002000:00100000:3.0:1746143775.380122:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72d80 with x1830963622421376 ext(2916352->2920447) 00002000:00010000:3.0:1746143775.380127:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72d80 00010000:00010000:2.0:1746143775.380133:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143775.380139:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3287 00000100:00100000:3.0:1746143775.380144:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622421376:12345-192.168.202.3@tcp:3:multiop.0 00010000:00010000:2.0:1746143775.380149:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9da expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.380174:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.380273:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622421376:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 127us (2075us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143775.380278:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3287 00002000:00100000:3.0:1746143775.380284:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2916352->2920447) req@ffff880092b72d80 x1830963622421376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.380289:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72d80 with x1830963622421376 ext(2916352->2920447) 00010000:00010000:3.0:1746143775.380294:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.380301:0:9590:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143775.380306:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b72d80 00010000:00010000:2.0:1746143775.380366:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143775.380368:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143775.380372:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4775936->5242879] (req 4775936->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.380403:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.380424:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 36 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.380435:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626705792:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.381124:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.386723:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626705792:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.386759:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4775936->5242879] (req 4775936->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.386776:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33c00, rc 0) 00000100:00100000:2.0:1746143775.389499:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32035:x1830963622421504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9364us (10090us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.389512:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11556 00000100:00100000:0.0:1746143775.390145:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.390238:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622421760 00000100:00100000:3.0:1746143775.390248:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622421760 00002000:00100000:3.0:1746143775.390297:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (2916352->3145727) req@ffff880092b72300 x1830963622421760/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.390306:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72300 with x1830963622421760 ext(2916352->3145727) 00010000:00010000:3.0:1746143775.390315:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 37 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.390334:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 37 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143775.390341:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b72300 00000100:00100000:3.0:1746143775.390371:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1395 00000100:00100000:3.0:1746143775.390378:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622421760:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143775.391383:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.393471:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622421888 00000100:00100000:2.0:1746143775.393484:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622421888 00000100:00100000:2.0:1746143775.393538:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11557 00000100:00100000:2.0:1746143775.393546:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:32040:x1830963622421888:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143775.393565:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.393583:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9e1 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.393614:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.393627:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a85d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a99b expref: 47 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.393634:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.393637:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.393640:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->2248703] (req 2097152->2248703) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 47 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.393673:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a85d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a99b expref: 47 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.393684:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a85d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a99b expref: 47 pid: 1947 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746143775.393696:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626705920:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.393788:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.393795:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 21 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.393803:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626706048:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.393822:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143775.401193:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622421760:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 10803us (11037us total) trans 21474840268 rc 0/0 00000100:00100000:3.0:1746143775.401206:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1395 00002000:00100000:3.0:1746143775.401219:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (2916352->3145727) req@ffff880092b72300 x1830963622421760/t21474840268(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/448 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.401229:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72300 with x1830963622421760 ext(2916352->3145727) 00010000:00010000:3.0:1746143775.401240:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 39 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.401254:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 39 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143775.401260:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b72300 00000100:00100000:0.0:1746143775.401652:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.401700:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.401769:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622422016 00000100:00100000:1.0:1746143775.401777:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622422016 00010000:00010000:1.0:1746143775.401807:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a85d7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a99b expref: 48 pid: 1947 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746143775.401830:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622422144 00000100:00100000:1.0:1746143775.401832:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622422144 00010000:00010000:1.0:1746143775.401844:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 22 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143775.401859:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5425 00000100:00100000:1.0:1746143775.401865:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+48:2011:x1830963622422016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.401880:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.401899:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a85d7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a99b expref: 48 pid: 1947 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746143775.401932:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a85d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a99b expref: 48 pid: 1947 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746143775.401965:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.401987:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+48:2011:x1830963622422016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 122us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.401993:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5425 00000100:00100000:1.0:1746143775.402005:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5426 00000100:00100000:1.0:1746143775.402010:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622422144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.402016:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.402023:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 22 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.402031:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 22 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.402042:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.402044:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.402052:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 47 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.402060:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 47 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.402090:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 47 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.402106:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626706176:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143775.402163:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746143775.402520:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73a85d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a99b expref: 47 pid: 1947 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746143775.402543:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626705920:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.402553:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7f400/0x87925e4cb73a85ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a986 expref: 22 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.402561:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626706048:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.402589:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.402598:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32a00, rc 0) 00000100:00100000:2.0:1746143775.402621:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:32040:x1830963622421888:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9077us (11243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.402628:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11557 00000100:00100000:1.0:1746143775.408095:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626706176:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143775.408123:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.408176:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963622422144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6163us (6473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.408189:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5426 00000100:00100000:0.0:1746143775.408754:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.409097:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622422400 00000100:00100000:3.0:1746143775.409105:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622422400 00002000:00100000:3.0:1746143775.409152:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (2244608->2248703) req@ffff880092b71c00 x1830963622422400/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.409163:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71c00 with x1830963622422400 ext(2244608->2248703) 00002000:00010000:3.0:1746143775.409169:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b71c00 00000100:00100000:3.0:1746143775.409202:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3288 00000100:00100000:3.0:1746143775.409210:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963622422400:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143775.409589:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963622422400:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 379us (835us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143775.409596:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3288 00002000:00100000:3.0:1746143775.409602:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (2244608->2248703) req@ffff880092b71c00 x1830963622422400/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.409609:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71c00 with x1830963622422400 ext(2244608->2248703) 00002000:00010000:3.0:1746143775.409612:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b71c00 00000100:00100000:0.0:1746143775.412155:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.412251:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622422528 00000100:00100000:1.0:1746143775.412261:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622422528 00010000:00010000:1.0:1746143775.412299:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 39 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143775.412339:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5427 00000100:00100000:1.0:1746143775.412346:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963622422528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.412360:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.412379:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 39 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.412395:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 39 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.412419:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a8671 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9cc expref: 39 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.412442:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.412444:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.412451:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.412459:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.412495:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.412506:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626706304:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143775.412583:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.419153:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.419222:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622422784 00000100:00100000:2.0:1746143775.419233:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622422784 00000100:00100000:0.0:1746143775.419238:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.419282:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4675 00000100:00100000:2.0:1746143775.419297:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:32040:x1830963622422784:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143775.419522:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:32040:x1830963622422784:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 226us (379us total) trans 8589943543 rc 0/0 00000100:00100000:2.0:1746143775.419529:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4675 00000100:00100000:3.0:1746143775.419607:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622422912 00000100:00100000:3.0:1746143775.419611:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622422912 00000100:00100000:3.0:1746143775.419639:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11558 00000100:00100000:3.0:1746143775.419644:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2010:x1830963622422912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.419655:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.419672:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a868d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9e8 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.419725:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626706432:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143775.419781:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143775.419866:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626706304:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143775.419885:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.419905:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963622422528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7559us (7760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.419936:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5427 00000100:00100000:3.0:1746143775.426814:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626706432:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143775.426854:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a868d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e8 expref: 22 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.426869:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a868d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e8 expref: 22 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.426901:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:3.0:1746143775.427014:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2010:x1830963622422912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7368us (7774us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143775.427023:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11558 00000100:00100000:0.0:1746143775.434551:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.434665:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622423168 00000100:00100000:3.0:1746143775.434675:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622423168 00002000:00100000:3.0:1746143775.434727:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (4775936->4780031) req@ffff880092b73b80 x1830963622423168/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.434738:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73b80 with x1830963622423168 ext(4775936->4780031) 00002000:00010000:3.0:1746143775.434743:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b73b80 00000100:00100000:3.0:1746143775.434766:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3289 00000100:00100000:3.0:1746143775.434774:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622423168:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143775.436110:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622423168:12345-192.168.202.3@tcp:3:cat.0 Request processed in 1330us (1565us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143775.436119:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3289 00002000:00100000:3.0:1746143775.436129:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (4775936->4780031) req@ffff880092b73b80 x1830963622423168/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.436139:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73b80 with x1830963622423168 ext(4775936->4780031) 00002000:00010000:3.0:1746143775.436143:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b73b80 00000100:00100000:0.0:1746143775.472053:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.472312:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622423296 00000100:00100000:3.0:1746143775.472322:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622423296 00000100:00100000:3.0:1746143775.472382:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11559 00000100:00100000:3.0:1746143775.472392:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32038:x1830963622423296:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143775.472415:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.472433:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9ef expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.472463:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a83df lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a844 expref: 45 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.472472:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8521 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a932 expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.472479:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a841e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a86e expref: 22 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.472485:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.472486:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.472490:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1179648->2060287] (req 1179648->2060287) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.472521:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a841e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a86e expref: 22 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.472532:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a841e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a86e expref: 22 pid: 3135 timeout: 934 lvb_type: 1 00000100:00100000:3.0:1746143775.472544:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626706560:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.475756:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8521 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a932 expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.475783:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8521 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a932 expref: 8 pid: 1945 timeout: 934 lvb_type: 1 00000100:00100000:3.0:1746143775.475799:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626706688:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.477448:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a83df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a844 expref: 45 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.477461:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a83df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a844 expref: 45 pid: 1945 timeout: 934 lvb_type: 1 00000100:00100000:3.0:1746143775.477471:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626706816:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.478615:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143775.478648:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626706560:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143775.480661:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.481047:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622423424 00000100:00100000:0.0:1746143775.481056:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622423424 00010000:00010000:0.0:1746143775.481095:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a841e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a86e expref: 23 pid: 3135 timeout: 934 lvb_type: 1 00000100:00100000:0.0:1746143775.481134:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5428 00000100:00100000:0.0:1746143775.481141:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963622423424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143775.481157:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143775.481178:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a841e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a86e expref: 23 pid: 3135 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746143775.481188:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a841e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a86e expref: 23 pid: 3135 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746143775.481211:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368dac00/0x87925e4cb73a841e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a86e expref: 23 pid: 3135 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746143775.481236:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143775.481288:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622423424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 147us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.481294:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5428 00000100:00100000:2.0:1746143775.481477:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626706688:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.481486:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626706816:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.481518:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1179648->2060287] (req 1179648->2060287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.481529:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:2.0:1746143775.481552:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32038:x1830963622423296:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9162us (9513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.481559:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11559 00000100:00100000:0.0:1746143775.482315:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.482347:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.482396:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622423680 00000100:00100000:1.0:1746143775.482402:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622423680 00010000:00010000:1.0:1746143775.482421:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a83df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a844 expref: 46 pid: 1945 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746143775.482439:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622423552 00000100:00100000:1.0:1746143775.482441:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622423552 00010000:00010000:1.0:1746143775.482449:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8521 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a932 expref: 9 pid: 1945 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746143775.482461:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5429 00000100:00100000:1.0:1746143775.482467:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622423680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.482477:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.482489:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a83df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a844 expref: 46 pid: 1945 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746143775.482497:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a83df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a844 expref: 46 pid: 1945 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746143775.482511:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a83df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a844 expref: 46 pid: 1945 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746143775.482523:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.482544:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622423680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.482549:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5429 00000100:00100000:1.0:1746143775.482559:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5430 00000100:00100000:1.0:1746143775.482563:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622423552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.482571:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.482577:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8521 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a932 expref: 9 pid: 1945 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746143775.482586:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8521 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a932 expref: 9 pid: 1945 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746143775.482597:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a8521 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a932 expref: 9 pid: 1945 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746143775.482606:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.482608:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.482614:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.482622:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.482650:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.482662:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626706944:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143775.482712:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143775.486553:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626706944:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143775.486576:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.486618:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622423552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4052us (4269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.486630:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5430 00000100:00100000:0.0:1746143775.496101:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.496239:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622423936 00000100:00100000:3.0:1746143775.496248:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622423936 00000100:00100000:3.0:1746143775.496818:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12808 00000100:00100000:3.0:1746143775.496828:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:32046:x1830963622423936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.496856:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.496875:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a869b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9f6 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.497097:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497111:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497123:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497136:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497142:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497147:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497244:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a86b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497254:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a86b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497259:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a86b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143775.497268:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143775.497339:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497345:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497351:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497357:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497362:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.497366:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497373:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497382:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143775.497385:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.497389:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.497393:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143775.499584:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143775.501393:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.501408:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.501413:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.501419:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.501453:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.501460:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.501476:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14700) 00010000:00010000:3.0:1746143775.501479:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.501483:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.501491:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.501560:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a869b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9f6 expref: 273 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.501573:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a86b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9f6 expref: 272 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.501580:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.501582:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143775.501584:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75800, rc 0) 00000100:00100000:3.0:1746143775.501646:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:32046:x1830963622423936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4819us (5555us total) trans 8589943544 rc 0/0 00000100:00100000:3.0:1746143775.501655:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12808 00000100:00100000:2.0:1746143775.505334:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622424192 00000100:00100000:2.0:1746143775.505351:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622424192 00002000:00100000:2.0:1746143775.505410:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x395:0x0] (2056192->2060287) req@ffff880092b73480 x1830963622424192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.505420:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73480 with x1830963622424192 ext(2056192->2060287) 00002000:00010000:2.0:1746143775.505426:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b73480 00000100:00100000:2.0:1746143775.505457:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3290 00000100:00100000:2.0:1746143775.506230:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622424192:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143775.506900:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622424192:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 672us (7321us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143775.506908:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3290 00002000:00100000:2.0:1746143775.506931:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x395:0x0] (2056192->2060287) req@ffff880092b73480 x1830963622424192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.506948:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73480 with x1830963622424192 ext(2056192->2060287) 00002000:00010000:2.0:1746143775.506952:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b73480 00000100:00100000:3.0:1746143775.512520:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.512598:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.512675:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622424320 00000100:00100000:1.0:1746143775.512686:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622424320 00000100:00100000:1.0:1746143775.512755:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 744 00000100:00100000:1.0:1746143775.512765:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+272:2009:x1830963622424320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.512783:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.512810:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a86b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9f6 expref: 272 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.512832:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143775.512837:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.513103:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+271:2009:x1830963622424320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 339us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.513110:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 744 00000100:00100000:2.0:1746143775.518496:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622424448 00000100:00100000:2.0:1746143775.518511:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622424448 00000100:00100000:2.0:1746143775.518592:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11560 00000100:00100000:2.0:1746143775.518601:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963622424448:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143775.518624:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.518643:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33600/0x87925e4cb73a86be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840a9fd expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.518707:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626707072:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143775.518810:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143775.524262:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.526741:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622424576 00000100:00100000:2.0:1746143775.526756:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622424576 00000100:00100000:2.0:1746143775.526822:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11561 00000100:00100000:2.0:1746143775.526831:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963622424576:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143775.526852:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.526873:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf14000/0x87925e4cb73a86c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa04 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.526898:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.526900:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.526909:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf14000/0x87925e4cb73a86c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa04 expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.526952:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf14000/0x87925e4cb73a86c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa04 expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.526964:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf14000, rc 0) 00000100:00100000:2.0:1746143775.527030:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622424576:12345-192.168.202.3@tcp:101:cat.0 Request processed in 199us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.527037:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11561 00002000:00010000:2.0:1746143775.527583:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime: 1746143774 -> 1746143775 00002000:00010000:2.0:1746143775.527588:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143774 -> 1746143775 00002000:00010000:2.0:1746143775.527591:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime: 1746143774 -> 1746143775 00000100:00100000:2.0:1746143775.527608:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626707072:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143775.527636:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33600/0x87925e4cb73a86be lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9fd expref: 46 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.527646:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e33600/0x87925e4cb73a86be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9fd expref: 46 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.527667:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33600, rc 0) 00000100:00100000:2.0:1746143775.527685:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963622424448:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9085us (15087us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143775.527690:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11560 00000100:00100000:2.0:1746143775.535324:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.535400:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622424704 00000100:00100000:0.0:1746143775.535412:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622424704 00000100:00100000:0.0:1746143775.535461:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11562 00000100:00100000:0.0:1746143775.535470:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+45:32046:x1830963622424704:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143775.535492:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143775.535511:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa0b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.535546:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.535554:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143775.535556:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143775.535560:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.535595:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.535612:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 20 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746143775.535624:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626707200:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143775.536936:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143775.537587:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626707200:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143775.537616:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.537634:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716600, rc 0) 00000100:00100000:1.0:1746143775.538634:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:32046:x1830963622424704:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3159us (3317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.538643:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11562 00000100:00100000:0.0:1746143775.540141:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.540202:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622424832 00000100:00100000:2.0:1746143775.540211:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622424832 00002000:00100000:2.0:1746143775.540259:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1179648->2060287) req@ffff88012b1daa00 x1830963622424832/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.540270:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1daa00 with x1830963622424832 ext(1179648->2060287) 00010000:00010000:2.0:1746143775.540279:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 21 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.540293:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 21 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746143775.540300:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1daa00 00000100:00100000:2.0:1746143775.540331:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1396 00000100:00100000:2.0:1746143775.540339:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622424832:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143775.550330:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622424832:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 9979us (10183us total) trans 17179872946 rc 0/0 00000100:00100000:2.0:1746143775.550344:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1396 00002000:00100000:2.0:1746143775.550357:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1179648->2060287) req@ffff88012b1daa00 x1830963622424832/t17179872946(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/448 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.550367:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1daa00 with x1830963622424832 ext(1179648->2060287) 00010000:00010000:2.0:1746143775.550379:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 23 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.550396:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 23 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746143775.550403:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1daa00 00000100:00100000:0.0:1746143775.553375:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.553481:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622424960 00000100:00100000:1.0:1746143775.553492:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622424960 00010000:00010000:1.0:1746143775.553535:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 23 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143775.553576:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5431 00000100:00100000:1.0:1746143775.553584:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963622424960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.553601:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.553621:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 23 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.554048:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 23 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.554073:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8694 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->2060287) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9ef expref: 23 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143775.554107:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.554109:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.554117:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.554125:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.554160:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.554174:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626707328:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143775.554866:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143775.557356:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626707328:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143775.557376:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.557727:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622424960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3842us (4062us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.557740:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5431 00000100:00100000:0.0:1746143775.560196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.560329:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622425216 00000100:00100000:2.0:1746143775.560339:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622425216 00002000:00100000:2.0:1746143775.560384:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b1da300 x1830963622425216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.560395:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da300 with x1830963622425216 ext(1048576->2097151) 00002000:00010000:2.0:1746143775.560400:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1da300 00000100:00100000:2.0:1746143775.560418:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3291 00000100:00100000:2.0:1746143775.560425:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963622425216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143775.566610:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963622425216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6172us (6409us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143775.566623:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3291 00002000:00100000:3.0:1746143775.566635:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b1da300 x1830963622425216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.566646:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da300 with x1830963622425216 ext(1048576->2097151) 00002000:00010000:3.0:1746143775.566653:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1da300 00000100:00100000:0.0:1746143775.567401:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.567584:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622425472 00000100:00100000:3.0:1746143775.567594:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622425472 00000100:00100000:3.0:1746143775.567673:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12809 00000100:00100000:3.0:1746143775.567682:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32050:x1830963622425472:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.567707:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.567726:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a86d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa12 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.567804:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.567818:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.567829:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.567841:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a86e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.567846:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a86e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.567851:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a86e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.567980:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86e8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.567991:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.567997:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143775.568009:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143775.568087:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568093:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568098:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568104:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568109:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.568113:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568118:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568128:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143775.568130:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.568134:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568139:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73a86da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568165:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a86e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568170:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a86e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568178:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a86e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568182:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.568184:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a86e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568187:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a86e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568192:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14100) 00010000:00010000:3.0:1746143775.568194:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.568196:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a86e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568200:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a86e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.568235:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a86d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa12 expref: 24 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.568245:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86e8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa12 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.568251:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.568253:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143775.568254:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:3.0:1746143775.569069:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32050:x1830963622425472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1386us (1667us total) trans 8589943545 rc 0/0 00000100:00100000:3.0:1746143775.569075:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12809 00000100:00100000:0.0:1746143775.574719:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.575067:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622425728 00000100:00100000:2.0:1746143775.575078:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622425728 00000100:00100000:2.0:1746143775.575145:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4676 00000100:00100000:2.0:1746143775.575154:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32050:x1830963622425728:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143775.575906:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32050:x1830963622425728:12345-192.168.202.3@tcp:35:cat.0 Request processed in 750us (1195us total) trans 8589943546 rc 0/0 00000100:00100000:2.0:1746143775.575948:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4676 00000100:00100000:0.0:1746143775.576334:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.577018:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622425856 00000100:00100000:1.0:1746143775.577025:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622425856 00000100:00100000:1.0:1746143775.577207:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 745 00000100:00100000:1.0:1746143775.577214:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622425856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.577231:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.577257:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73a86e8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa12 expref: 24 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.577286:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143775.577291:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.578131:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622425856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 915us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.578139:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 745 00000100:00100000:0.0:1746143775.580040:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.580088:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.580170:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622425984 00000100:00100000:1.0:1746143775.580180:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622425984 00000100:00100000:1.0:1746143775.580228:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622426112 00000100:00100000:1.0:1746143775.580230:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622426112 00000100:00100000:1.0:1746143775.580243:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11563 00000100:00100000:1.0:1746143775.580250:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622425984:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143775.580269:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11564 00010000:00010000:1.0:1746143775.580269:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143775.580277:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622426112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143775.580287:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73a86f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa19 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.580308:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.580310:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.580319:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73a86f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa19 expref: 24 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.580333:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73a86f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa19 expref: 24 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.580343:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77600, rc 0) 00000100:00100000:1.0:1746143775.580382:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622425984:12345-192.168.202.3@tcp:101:cat.0 Request processed in 132us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.580387:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11563 00010000:00010000:3.0:1746143775.580405:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.580415:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75a00/0x87925e4cb73a86fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa20 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.580469:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626707456:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143775.580533:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00002000:00010000:3.0:1746143775.583229:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143775 -> 1746143776 00000100:00100000:3.0:1746143775.583255:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626707456:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143775.583287:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75a00/0x87925e4cb73a86fd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa20 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.583302:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75a00/0x87925e4cb73a86fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa20 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.583706:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75a00, rc 0) 00000100:00100000:3.0:1746143775.583767:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622426112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3490us (3677us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143775.583777:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11564 00000100:00100000:0.0:1746143775.590335:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.590459:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622426624 00000100:00100000:3.0:1746143775.590470:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622426624 00002000:00100000:3.0:1746143775.590521:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b1d8e00 x1830963622426624/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.590531:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8e00 with x1830963622426624 ext(1048576->2097151) 00002000:00010000:3.0:1746143775.590536:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d8e00 00000100:00100000:3.0:1746143775.590892:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3292 00000100:00100000:3.0:1746143775.590902:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622426624:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143775.593367:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626707584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746143775.593433:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143775.594138:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626707584 00000100:00100000:2.0:1746143775.594147:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626707584 00000100:00100000:2.0:1746143775.594192:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1746143775.594209:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3771:x1830963626707584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746143775.594247:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446088704 avail 1316626432 00000100:00100000:2.0:1746143775.594511:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3771:x1830963626707584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 311us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.594518:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1746143775.594534:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626707584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746143775.594634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.594665:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.594694:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622426496 00000100:00100000:3.0:1746143775.594698:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622426496 00002000:00100000:3.0:1746143775.594725:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012457f800 x1830963622426496/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.594735:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f800 with x1830963622426496 ext(2097152->4194303) 00002000:00010000:3.0:1746143775.594741:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457f800 00000100:00100000:3.0:1746143775.594751:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622426880 00000100:00100000:3.0:1746143775.594753:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622426880 00002000:00100000:3.0:1746143775.594764:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2248704->4194303) req@ffff88012457ca80 x1830963622426880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.594770:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ca80 with x1830963622426880 ext(2248704->4194303) 00002000:00010000:3.0:1746143775.594773:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457ca80 00000100:00100000:3.0:1746143775.594783:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3293 00000100:00100000:3.0:1746143775.594788:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622426496:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143775.594847:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3294 00000100:00100000:0.0:1746143775.594856:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622426880:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143775.606043:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622426624:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15130us (15707us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143775.606055:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3292 00002000:00100000:2.0:1746143775.606068:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b1d8e00 x1830963622426624/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.606078:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8e00 with x1830963622426624 ext(1048576->2097151) 00002000:00010000:2.0:1746143775.606086:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d8e00 00000100:00100000:3.0:1746143775.618153:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622426496:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23352us (23509us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143775.618166:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3293 00002000:00100000:3.0:1746143775.618179:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012457f800 x1830963622426496/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.618189:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f800 with x1830963622426496 ext(2097152->4194303) 00002000:00010000:3.0:1746143775.618195:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457f800 00000100:00100000:2.0:1746143775.622165:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622426880:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27297us (27485us total) trans 0 rc 1945600/1945600 00000100:00100000:2.0:1746143775.622179:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3294 00002000:00100000:2.0:1746143775.622192:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2248704->4194303) req@ffff88012457ca80 x1830963622426880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1945600/1945600 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.622203:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ca80 with x1830963622426880 ext(2248704->4194303) 00002000:00010000:2.0:1746143775.622210:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457ca80 00000100:00100000:3.0:1746143775.625474:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b99f1f93-ef24-4932-a1b4-452b64359da1:3772:1830963626707712:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.625546:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143775.626666:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626707840:0@lo:400:kworker.0 00000100:00100000:2.0:1746143775.626708:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143775.626848:0:8215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626707712 00000100:00100000:1.0:1746143775.626858:0:8215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626707712 00000100:00100000:1.0:1746143775.626901:0:8215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1746143775.626908:0:8215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3772:x1830963626707712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143775.626971:0:8215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3772:x1830963626707712:12345-0@lo:400:kworker.0 Request processed in 62us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.626976:0:8215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1746143775.627056:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b99f1f93-ef24-4932-a1b4-452b64359da1:3772:1830963626707712:0@lo:400:kworker.0 00000100:00100000:2.0:1746143775.627119:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626707840 00000100:00100000:2.0:1746143775.627123:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626707840 00000100:00100000:2.0:1746143775.627159:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1746143775.627165:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963626707840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143775.627194:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963626707840:12345-0@lo:400:kworker.0 Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.627199:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1746143775.627224:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626707840:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.627731:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3773:1830963626708352:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.627758:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.627773:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626708864:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.627788:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.627798:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1746143775.627802:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3773:1830963626707968:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.627814:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.627822:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3773:1830963626708480:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.627834:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.627842:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626708992:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.627854:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.627875:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626708352 00000100:00100000:3.0:1746143775.627878:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626708352 00000100:00100000:3.0:1746143775.627927:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626707968 00000100:00100000:3.0:1746143775.627930:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626707968 00000100:00100000:3.0:1746143775.627949:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626708480 00000100:00100000:3.0:1746143775.627951:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626708480 00000100:00100000:3.0:1746143775.627965:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1746143775.627969:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3773:x1830963626708352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.627998:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3773:x1830963626708352:12345-0@lo:400:kworker.0 Request processed in 28us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.628003:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1746143775.628014:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1746143775.628018:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3773:x1830963626707968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628036:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3773:x1830963626707968:12345-0@lo:400:kworker.0 Request processed in 18us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.628040:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1746143775.628048:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1746143775.628051:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3773:x1830963626708480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628069:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3773:x1830963626708480:12345-0@lo:400:kworker.0 Request processed in 17us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.628073:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1746143775.628093:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626708864 00000100:00100000:3.0:1746143775.628095:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626708864 00000100:00100000:3.0:1746143775.628113:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626708992 00000100:00100000:3.0:1746143775.628114:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626708992 00000100:00100000:3.0:1746143775.628125:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1746143775.628129:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963626708864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628151:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963626708864:12345-0@lo:400:kworker.0 Request processed in 22us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.628156:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1746143775.628163:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1746143775.628167:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963626708992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628186:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963626708992:12345-0@lo:400:kworker.0 Request processed in 19us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.628193:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1746143775.628214:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3773:1830963626707968:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628221:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3773:1830963626708480:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628228:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626708992:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628234:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3773:1830963626708352:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628241:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626708864:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628262:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626708224:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628280:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.628293:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3772:1830963626708736:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628307:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.628318:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1746143775.628322:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626708096:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628336:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.628346:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3772:1830963626708608:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628358:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.628367:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3772:1830963626709120:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628378:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.628394:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626708736 00000100:00100000:3.0:1746143775.628396:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626708736 00000100:00100000:3.0:1746143775.628410:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626708608 00000100:00100000:3.0:1746143775.628411:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626708608 00000100:00100000:3.0:1746143775.628419:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626709120 00000100:00100000:3.0:1746143775.628421:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626709120 00000100:00100000:3.0:1746143775.628428:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1746143775.628432:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3772:x1830963626708736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628455:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3772:x1830963626708736:12345-0@lo:400:kworker.0 Request processed in 22us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.628459:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1746143775.628466:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1746143775.628470:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3772:x1830963626708608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628485:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3772:x1830963626708608:12345-0@lo:400:kworker.0 Request processed in 15us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.628489:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1746143775.628495:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1746143775.628498:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3772:x1830963626709120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628516:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3772:x1830963626709120:12345-0@lo:400:kworker.0 Request processed in 17us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.628520:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1746143775.628529:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626708224 00000100:00100000:3.0:1746143775.628531:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626708224 00000100:00100000:3.0:1746143775.628545:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626708096 00000100:00100000:3.0:1746143775.628546:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626708096 00000100:00100000:3.0:1746143775.628559:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1746143775.628563:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626708224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628582:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626708224:12345-0@lo:400:kworker.0 Request processed in 19us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.628586:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1746143775.628592:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1746143775.628596:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626708096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628620:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626708096:12345-0@lo:400:kworker.0 Request processed in 17us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.628625:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1746143775.628644:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626708096:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628651:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3772:1830963626708608:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628657:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3772:1830963626709120:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628664:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626708224:0@lo:400:kworker.0 00000100:00100000:3.0:1746143775.628670:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3772:1830963626708736:0@lo:400:kworker.0 00000100:00080000:1.0:1746143775.628709:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143775.628713:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143775.628716:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746143775.628718:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143775.631351:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.631513:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622427136 00000100:00100000:2.0:1746143775.631522:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622427136 00002000:00100000:2.0:1746143775.631570:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88012b1da680 x1830963622427136/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.631579:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da680 with x1830963622427136 ext(2097152->3145727) 00002000:00010000:2.0:1746143775.631584:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1da680 00000100:00100000:2.0:1746143775.631614:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3295 00000100:00100000:0.0:1746143775.631617:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.631621:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622427136:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143775.631684:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622427392 00000100:00100000:3.0:1746143775.631688:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622427392 00002000:00100000:3.0:1746143775.631708:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88012b1d8a80 x1830963622427392/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.631716:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8a80 with x1830963622427392 ext(4194304->4780031) 00002000:00010000:3.0:1746143775.631720:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d8a80 00000100:00100000:3.0:1746143775.631734:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3296 00000100:00100000:3.0:1746143775.631740:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622427392:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143775.637258:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622427392:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5505us (5628us total) trans 0 rc 585728/585728 00000100:00100000:3.0:1746143775.637273:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3296 00002000:00100000:3.0:1746143775.637286:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88012b1d8a80 x1830963622427392/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.637295:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8a80 with x1830963622427392 ext(4194304->4780031) 00002000:00010000:3.0:1746143775.637303:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d8a80 00000100:00100000:2.0:1746143775.641377:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622427136:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9745us (10023us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143775.641389:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3295 00002000:00100000:2.0:1746143775.641402:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88012b1da680 x1830963622427136/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.641412:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da680 with x1830963622427136 ext(2097152->3145727) 00002000:00010000:2.0:1746143775.641418:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1da680 00000100:00100000:0.0:1746143775.642241:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.642408:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622427648 00000100:00100000:2.0:1746143775.642417:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622427648 00000100:00100000:2.0:1746143775.642457:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4677 00000100:00100000:2.0:1746143775.642465:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+271:32046:x1830963622427648:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143775.642661:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+272:32046:x1830963622427648:12345-192.168.202.3@tcp:35:cat.0 Request processed in 196us (423us total) trans 8589943547 rc 0/0 00000100:00100000:2.0:1746143775.642667:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4677 00000100:00100000:0.0:1746143775.647029:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.647271:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622427776 00000100:00100000:2.0:1746143775.647281:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622427776 00000100:00100000:2.0:1746143775.647341:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11565 00000100:00100000:2.0:1746143775.647349:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32050:x1830963622427776:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143775.647370:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.647391:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa27 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.647422:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.647430:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143775.647432:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143775.647436:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 24 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.647472:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.647484:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 45 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.647496:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626709248:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.647594:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.652219:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.652459:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622427904 00000100:00100000:3.0:1746143775.652468:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622427904 00002000:00100000:3.0:1746143775.652524:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2248703) req@ffff88012b1d9c00 x1830963622427904/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.652535:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9c00 with x1830963622427904 ext(2097152->2248703) 00010000:00010000:3.0:1746143775.652544:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 46 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.652558:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 46 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143775.652565:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1d9c00 00000100:00100000:3.0:1746143775.652586:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1397 00000100:00100000:3.0:1746143775.652594:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963622427904:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143775.652964:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626709248:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.652995:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 24 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.653009:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380800, rc 0) 00000100:00100000:2.0:1746143775.653035:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32050:x1830963622427776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5687us (6018us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.653043:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11565 00000100:00100000:0.0:1746143775.653257:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.653542:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622428160 00000100:00100000:2.0:1746143775.653546:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622428160 00000100:00100000:2.0:1746143775.654381:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12810 00000100:00100000:2.0:1746143775.654390:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:32052:x1830963622428160:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143775.654411:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.654429:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73a870b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa2e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.654507:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654518:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654529:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654539:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a8719 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654544:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a8719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654548:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a8719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654646:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73a8720 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654653:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73a8720 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654658:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73a8720 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143775.654668:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143775.654742:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654747:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654756:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654762:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654767:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa16000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143775.654782:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654789:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654798:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143775.654801:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143775.654804:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654808:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654835:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a8719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654839:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a8719 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654843:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a8719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654847:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143775.654850:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a8719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654858:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a8719 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654864:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d000) 00010000:00010000:2.0:1746143775.654865:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143775.654867:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a8719 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654872:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a8719 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.654902:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73a870b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa2e expref: 275 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.654924:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73a8720 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa2e expref: 274 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.654930:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.654932:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143775.654934:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b800, rc 0) 00000100:00100000:2.0:1746143775.654980:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+274:32052:x1830963622428160:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 591us (1722us total) trans 8589943548 rc 0/0 00000100:00100000:2.0:1746143775.654987:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12810 00000100:00100000:3.0:1746143775.657380:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+48:2010:x1830963622427904:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4776us (5161us total) trans 17179872947 rc 0/0 00000100:00100000:3.0:1746143775.657392:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1397 00002000:00100000:3.0:1746143775.657404:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2248703) req@ffff88012b1d9c00 x1830963622427904/t17179872947(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/448 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.657413:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9c00 with x1830963622427904 ext(2097152->2248703) 00010000:00010000:3.0:1746143775.657424:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 48 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746143775.657437:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 48 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746143775.657444:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1d9c00 00000100:00100000:0.0:1746143775.659386:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.659447:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622428288 00000100:00100000:1.0:1746143775.659460:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622428288 00000100:00100000:1.0:1746143775.659521:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 746 00000100:00100000:1.0:1746143775.659531:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+274:2010:x1830963622428288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.659547:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.659572:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73a8720 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa2e expref: 274 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.659601:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143775.659605:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.659656:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+273:2010:x1830963622428288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 126us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.659663:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 746 00000100:00100000:0.0:1746143775.663724:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.663776:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622428416 00000100:00100000:2.0:1746143775.663786:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622428416 00010000:00010000:2.0:1746143775.663830:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 48 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.663875:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5432 00000100:00100000:2.0:1746143775.663885:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+48:2010:x1830963622428416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.663901:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.663962:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 48 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.663976:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 48 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.663998:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a8686 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9e1 expref: 48 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.664021:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.664024:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.664032:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 23 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.664040:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 23 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.664075:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 23 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.664087:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626709376:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143775.664333:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.667853:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626709376:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143775.667878:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.667969:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963622428416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4084us (4254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.667980:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5432 00000100:00100000:0.0:1746143775.670030:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.670114:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.670272:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622428672 00000100:00100000:3.0:1746143775.670281:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622428672 00000100:00100000:1.0:1746143775.670317:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622428928 00000100:00100000:1.0:1746143775.670321:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622428928 00002000:00100000:3.0:1746143775.670327:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880092b21880 x1830963622428672/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.670336:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092b20700 x1830963622428928/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.670337:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b21880 with x1830963622428672 ext(2097152->4194303) 00002000:00010000:3.0:1746143775.670342:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b21880 00002000:00100000:1.0:1746143775.670342:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20700 with x1830963622428928 ext(3145728->4194303) 00002000:00010000:1.0:1746143775.670346:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b20700 00000100:00100000:1.0:1746143775.670368:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3297 00000100:00100000:3.0:1746143775.670372:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3298 00000100:00100000:1.0:1746143775.670375:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622428928:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143775.670376:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622428672:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143775.686312:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622428928:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15921us (16181us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143775.686327:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3297 00002000:00100000:1.0:1746143775.686342:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092b20700 x1830963622428928/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.686353:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20700 with x1830963622428928 ext(3145728->4194303) 00002000:00010000:1.0:1746143775.686360:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b20700 00000100:00100000:3.0:1746143775.696239:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622428672:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25847us (26202us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143775.696254:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3298 00002000:00100000:3.0:1746143775.696268:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880092b21880 x1830963622428672/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.696277:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b21880 with x1830963622428672 ext(2097152->4194303) 00002000:00010000:3.0:1746143775.696283:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b21880 00000100:00100000:0.0:1746143775.706507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.706601:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622429056 00000100:00100000:2.0:1746143775.706612:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622429056 00000100:00100000:2.0:1746143775.706680:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11566 00000100:00100000:2.0:1746143775.706689:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+39:32052:x1830963622429056:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143775.706710:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.706730:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa35 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.706765:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.706773:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf14000/0x87925e4cb73a86c5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa04 expref: 40 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.706780:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.706781:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.706786:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2506752->3043327] (req 2506752->3043327) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 40 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.706819:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf14000/0x87925e4cb73a86c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa04 expref: 40 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.706832:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf14000/0x87925e4cb73a86c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa04 expref: 40 pid: 13436 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746143775.706851:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626709504:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.711952:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.711969:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 29 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.711983:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626709632:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.712823:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.719508:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.720108:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626709504:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143775.720234:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.720350:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626709632:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.720386:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2506752->3043327] (req 2506752->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 40 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.720405:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30600, rc 0) 00000100:00100000:3.0:1746143775.720455:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+40:32052:x1830963622429056:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 13766us (13956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.720464:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11566 00000100:00100000:2.0:1746143775.720553:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622429312 00000100:00100000:2.0:1746143775.720560:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622429312 00002000:00100000:2.0:1746143775.720599:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4775935) req@ffff880092b20000 x1830963622429312/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.720607:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20000 with x1830963622429312 ext(4194304->4775935) 00010000:00010000:2.0:1746143775.720614:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.720624:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746143775.720629:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b20000 00000100:00100000:2.0:1746143775.720645:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1398 00000100:00100000:2.0:1746143775.720652:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2011:x1830963622429312:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143775.720872:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622429440 00000100:00100000:0.0:1746143775.720876:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622429440 00010000:00010000:0.0:1746143775.720895:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf14000/0x87925e4cb73a86c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa04 expref: 40 pid: 13436 timeout: 934 lvb_type: 1 00000100:00100000:0.0:1746143775.720928:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5433 00000100:00100000:0.0:1746143775.720934:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622429440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143775.720955:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143775.720966:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf14000/0x87925e4cb73a86c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa04 expref: 40 pid: 13436 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746143775.720975:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf14000/0x87925e4cb73a86c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa04 expref: 40 pid: 13436 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746143775.721348:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf14000/0x87925e4cb73a86c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa04 expref: 40 pid: 13436 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746143775.721366:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.721514:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622429440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 579us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.721521:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5433 00000100:00100000:2.0:1746143775.727585:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2011:x1830963622429312:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6919us (8074us total) trans 0 rc 581632/581632 00000100:00100000:2.0:1746143775.727598:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1398 00002000:00100000:2.0:1746143775.727612:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4775935) req@ffff880092b20000 x1830963622429312/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 581632/581632 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.727621:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20000 with x1830963622429312 ext(4194304->4775935) 00010000:00010000:2.0:1746143775.727632:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.727647:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746143775.727654:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b20000 00000100:00100000:0.0:1746143775.733344:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.733393:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.733478:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622429568 00000100:00100000:3.0:1746143775.733488:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622429568 00000100:00100000:3.0:1746143775.733543:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11567 00000100:00100000:3.0:1746143775.733551:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622429568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.733570:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.733590:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a8735 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa3c expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.733613:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.733623:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a8735 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa3c expref: 31 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.733634:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a8735 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa3c expref: 31 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.733649:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:3.0:1746143775.733713:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622429568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 163us (380us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143775.733719:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11567 00000100:00100000:2.0:1746143775.733803:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622429696 00000100:00100000:2.0:1746143775.733807:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622429696 00010000:00010000:2.0:1746143775.733823:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746143775.733840:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5434 00000100:00100000:2.0:1746143775.733844:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622429696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.733853:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.733871:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.733885:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.733900:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73a867f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9da expref: 30 pid: 3135 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.733945:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.733947:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.733954:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 38 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.733962:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 38 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.733992:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 38 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.734003:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626709760:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143775.734053:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.736479:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626709760:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143775.736509:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.736570:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2010:x1830963622429696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2721us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.736581:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5434 00000100:00100000:2.0:1746143775.737685:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.737794:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.737883:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622430080 00000100:00100000:1.0:1746143775.737894:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622430080 00000100:00100000:0.0:1746143775.738296:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622429952 00000100:00100000:0.0:1746143775.738301:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622429952 00002000:00100000:0.0:1746143775.738349:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2506752->2510847) req@ffff880092ef0700 x1830963622429952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.738364:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0700 with x1830963622429952 ext(2506752->2510847) 00002000:00010000:0.0:1746143775.738368:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef0700 00000100:00100000:0.0:1746143775.738398:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3299 00000100:00100000:0.0:1746143775.738406:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622429952:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143775.738671:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11568 00000100:00100000:1.0:1746143775.738677:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32050:x1830963622430080:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143775.738687:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143775.738705:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa43 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.738732:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.738740:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143775.738742:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143775.738745:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4775936->5242879] (req 4775936->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.738776:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.738788:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143775.738799:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626709888:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143775.739080:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622429952:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 674us (1398us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143775.739087:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3299 00002000:00100000:0.0:1746143775.739093:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2506752->2510847) req@ffff880092ef0700 x1830963622429952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.739100:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0700 with x1830963622429952 ext(2506752->2510847) 00010000:00010000:0.0:1746143775.739106:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143775.739116:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 934 lvb_type: 0 00002000:00010000:0.0:1746143775.739121:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ef0700 00000100:00100000:1.0:1746143775.739522:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143775.743050:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626709888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143775.743089:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4775936->5242879] (req 4775936->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.743114:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55dc00, rc 0) 00000100:00100000:1.0:1746143775.743222:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32050:x1830963622430080:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4542us (5425us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.743231:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11568 00000100:00100000:0.0:1746143775.749085:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.749545:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622430336 00000100:00100000:1.0:1746143775.749556:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622430336 00000100:00100000:1.0:1746143775.749627:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12811 00000100:00100000:1.0:1746143775.749636:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32055:x1830963622430336:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143775.749685:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143775.749708:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8743 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa4a expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.749797:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.749811:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.749822:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.749836:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8751 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.749841:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.749847:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750020:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a8758 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750031:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a8758 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750038:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a8758 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:1.0:1746143775.750435:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143775.750517:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750524:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750530:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750536:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750541:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143775.750545:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750552:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750563:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143775.750565:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143775.750570:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750579:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a874a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750992:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.750998:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8751 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.751002:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8751 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.751006:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143775.751008:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8751 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.751013:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8751 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.751021:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e021600) 00010000:00010000:1.0:1746143775.751023:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143775.751025:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8751 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.751029:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8751 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.751080:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8743 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa4a expref: 26 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.751092:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a8758 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa4a expref: 25 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.751104:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143775.751106:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143775.751108:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c800, rc 0) 00000100:00100000:3.0:1746143775.751403:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626710016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746143775.751459:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143775.752459:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32055:x1830963622430336:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2817us (3377us total) trans 8589943549 rc 0/0 00000100:00100000:1.0:1746143775.752469:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12811 00000100:00100000:0.0:1746143775.753215:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.753324:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622430592 00000100:00100000:0.0:1746143775.753332:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622430592 00002000:00100000:0.0:1746143775.753375:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3039232->3043327) req@ffff880092b20e00 x1830963622430592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.753384:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20e00 with x1830963622430592 ext(3039232->3043327) 00010000:00010000:0.0:1746143775.753393:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143775.753405:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 934 lvb_type: 0 00002000:00010000:0.0:1746143775.753412:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b20e00 00000100:00100000:0.0:1746143775.753431:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1399 00000100:00100000:0.0:1746143775.753439:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963622430592:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143775.753593:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963622430592:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 155us (380us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143775.753599:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1399 00002000:00100000:0.0:1746143775.753605:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3039232->3043327) req@ffff880092b20e00 x1830963622430592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.753611:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20e00 with x1830963622430592 ext(3039232->3043327) 00010000:00010000:0.0:1746143775.753615:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143775.753623:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 934 lvb_type: 0 00002000:00010000:0.0:1746143775.753628:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b20e00 00000100:00100000:0.0:1746143775.754477:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626710016 00000100:00100000:0.0:1746143775.754485:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626710016 00000100:00100000:0.0:1746143775.756592:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1746143775.756609:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963626710016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746143775.756649:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1019736128 pending 7643136 free 3914395648 avail 3682873344 00000100:00100000:0.0:1746143775.756747:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963626710016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (5288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.756754:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1746143775.756853:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626710016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143775.758447:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.758500:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.758700:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622430720 00000100:00100000:2.0:1746143775.758709:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622430720 00000100:00100000:2.0:1746143775.759942:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 747 00000100:00100000:2.0:1746143775.759955:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622430720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.759973:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.760004:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a8758 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa4a expref: 25 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.760027:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.760032:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.760082:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622430720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.760088:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 747 00000100:00100000:1.0:1746143775.760795:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622430976 00000100:00100000:1.0:1746143775.760804:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622430976 00000100:00100000:1.0:1746143775.760845:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4678 00000100:00100000:1.0:1746143775.760852:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32055:x1830963622430976:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143775.761083:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32055:x1830963622430976:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 231us (2581us total) trans 8589943550 rc 0/0 00000100:00100000:1.0:1746143775.761090:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4678 00000100:00100000:0.0:1746143775.761433:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.761464:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.761508:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622431488 00000100:00100000:3.0:1746143775.761512:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622431488 00000100:00100000:3.0:1746143775.761545:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4679 00000100:00100000:3.0:1746143775.761551:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+273:32052:x1830963622431488:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143775.761657:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+274:32052:x1830963622431488:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 106us (192us total) trans 8589943551 rc 0/0 00000100:00100000:3.0:1746143775.761663:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4679 00000100:00100000:2.0:1746143775.761737:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622431232 00000100:00100000:2.0:1746143775.761741:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622431232 00002000:00100000:2.0:1746143775.761765:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2506752->3043327) req@ffff880092b22680 x1830963622431232/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.761776:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b22680 with x1830963622431232 ext(2506752->3043327) 00010000:00010000:2.0:1746143775.761784:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.761796:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 39 pid: 12328 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746143775.761803:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b22680 00000100:00100000:2.0:1746143775.761817:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1400 00000100:00100000:2.0:1746143775.761823:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963622431232:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143775.779143:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622431232:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 17311us (17702us total) trans 21474840269 rc 0/0 00000100:00100000:2.0:1746143775.779154:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1400 00002000:00100000:2.0:1746143775.779164:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2506752->3043327) req@ffff880092b22680 x1830963622431232/t21474840269(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/448 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.779173:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b22680 with x1830963622431232 ext(2506752->3043327) 00010000:00010000:2.0:1746143775.779182:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 41 pid: 12328 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746143775.779195:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 41 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746143775.779201:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b22680 00000100:00100000:0.0:1746143775.783372:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143775.783398:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626710144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143775.783470:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143775.783679:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626710144 00000100:00100000:1.0:1746143775.783688:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626710144 00000100:00100000:1.0:1746143775.783724:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1746143775.783730:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3774:x1830963626710144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746143775.783830:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1019071680 pending 6516736 free 3913007104 avail 3681484800 00000100:00100000:1.0:1746143775.783884:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3774:x1830963626710144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.783890:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1746143775.787077:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626710144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143775.787649:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.789612:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622431616 00000100:00100000:3.0:1746143775.789625:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622431616 00010000:00010000:3.0:1746143775.789668:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 41 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.789716:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5435 00000100:00100000:3.0:1746143775.789724:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622431616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143775.789741:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143775.789759:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143775 -> 1746143776 00002000:00010000:3.0:1746143775.789762:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143775 -> 1746143776 00010000:00010000:3.0:1746143775.789768:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 41 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143775.789780:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 41 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143775.789803:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73a872e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2506752->3043327) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa35 expref: 41 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143775.789831:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.789834:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.789842:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.789849:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.789883:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.789894:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626710272:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143775.789998:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143775.790843:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.791746:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622431744 00000100:00100000:2.0:1746143775.791753:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622431744 00000100:00100000:2.0:1746143775.792246:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11569 00000100:00100000:2.0:1746143775.792255:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32055:x1830963622431744:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143775.792273:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.792288:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa51 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.792316:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.792324:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73a86f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa19 expref: 25 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.792332:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.792333:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.792337:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.792364:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73a86f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa19 expref: 25 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.792376:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73a86f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa19 expref: 25 pid: 3135 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.792387:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626710400:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.792467:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.792475:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 46 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.792483:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626710528:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.792501:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.796486:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.796526:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626710272:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143775.796531:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143775.796553:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.796609:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622432000 00000100:00100000:2.0:1746143775.796617:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622432000 00000100:00100000:3.0:1746143775.796625:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622431616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6900us (8978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.796635:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5435 00010000:00010000:2.0:1746143775.796646:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73a86f6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa19 expref: 26 pid: 3135 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.796672:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5436 00000100:00100000:2.0:1746143775.796679:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622432000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.796690:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.796706:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73a86f6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa19 expref: 26 pid: 3135 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143775.796716:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73a86f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa19 expref: 26 pid: 3135 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143775.796738:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.796772:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622432000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.796778:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5436 00000100:00100000:3.0:1746143775.797463:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622431872 00000100:00100000:3.0:1746143775.797469:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622431872 00010000:00010000:0.0:1746143775.797518:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73a86f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa19 expref: 26 pid: 3135 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746143775.797533:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626710400:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143775.797541:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626710528:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143775.797561:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.797572:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00000100:00100000:3.0:1746143775.797586:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11570 00000100:00100000:3.0:1746143775.797596:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622431872:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143775.797597:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32055:x1830963622431744:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5343us (6754us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143775.797612:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.797627:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75a00/0x87925e4cb73a876d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa58 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.797646:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.797715:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75a00/0x87925e4cb73a876d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa58 expref: 26 pid: 12328 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143775.797715:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11569 00010000:00010000:3.0:1746143775.797727:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75a00/0x87925e4cb73a876d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa58 expref: 25 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.797746:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75a00, rc 0) 00000100:00100000:3.0:1746143775.797769:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622431872:12345-192.168.202.3@tcp:101:cat.0 Request processed in 176us (1292us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143775.797776:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11570 00000100:00100000:0.0:1746143775.798590:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.799270:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143775.799480:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626710656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746143775.799533:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143775.799785:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622432128 00000100:00100000:2.0:1746143775.799792:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622432128 00010000:00010000:2.0:1746143775.799819:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 47 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.799854:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5437 00000100:00100000:2.0:1746143775.799861:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963622432128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.799871:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.799886:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 47 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.799896:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 47 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.799945:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a86cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa0b expref: 47 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.799962:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.799964:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.799970:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.799977:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.800005:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.800016:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626710784:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143775.800093:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.800341:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626710656 00000100:00100000:0.0:1746143775.800346:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626710656 00000100:00100000:0.0:1746143775.800378:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1746143775.800384:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963626710656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746143775.800410:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445335040 avail 1315872768 00000100:00100000:0.0:1746143775.800452:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963626710656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.800457:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1746143775.800528:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626710656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746143775.800552:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.800582:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.800821:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622432256 00000100:00100000:1.0:1746143775.800825:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622432256 00000100:00100000:1.0:1746143775.800850:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12812 00000100:00100000:1.0:1746143775.800855:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32058:x1830963622432256:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143775.800866:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143775.800877:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c200/0x87925e4cb73a8774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa5f expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.800930:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.800950:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.800960:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143775.800969:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622432512 00010000:00010000:1.0:1746143775.800971:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8782 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143775.800974:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622432512 00010000:00010000:1.0:1746143775.800976:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.800980:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00002000:00100000:3.0:1746143775.801009:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4775936->4780031) req@ffff880092b4a300 x1830963622432512/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.801023:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4a300 with x1830963622432512 ext(4775936->4780031) 00002000:00010000:3.0:1746143775.801028:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b4a300 00010000:00010000:1.0:1746143775.801041:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143775.801046:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3300 00010000:00010000:1.0:1746143775.801050:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a2 expref: 24 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.801053:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622432512:12345-192.168.202.3@tcp:3:multiop.0 00010000:00010000:1.0:1746143775.801055:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.801077:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a2 expref: 24 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.801086:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a2 expref: 24 pid: 6587 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143775.801095:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626710912:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.801404:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622432512:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 351us (819us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143775.801410:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3300 00002000:00100000:3.0:1746143775.801415:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4775936->4780031) req@ffff880092b4a300 x1830963622432512/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.801423:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4a300 with x1830963622432512 ext(4775936->4780031) 00002000:00010000:3.0:1746143775.801426:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b4a300 00000100:00100000:1.0:1746143775.801830:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.802516:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.803201:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622432768 00000100:00100000:2.0:1746143775.803206:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626710784:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143775.803207:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622432768 00010000:00010000:2.0:1746143775.803222:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143775.803238:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x395:0x0] (1814528->1818623) req@ffff880092145c00 x1830963622432768/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.803247:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145c00 with x1830963622432768 ext(1814528->1818623) 00000100:00100000:2.0:1746143775.803249:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963622432128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3388us (4659us total) trans 0 rc 0/0 00002000:00010000:3.0:1746143775.803251:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092145c00 00000100:00100000:2.0:1746143775.803256:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5437 00000100:00100000:3.0:1746143775.803274:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3301 00000100:00100000:3.0:1746143775.803280:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622432768:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143775.803389:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622432768:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 109us (874us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143775.803395:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3301 00002000:00100000:3.0:1746143775.803400:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x395:0x0] (1814528->1818623) req@ffff880092145c00 x1830963622432768/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.803406:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145c00 with x1830963622432768 ext(1814528->1818623) 00002000:00010000:3.0:1746143775.803409:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092145c00 00000100:00100000:2.0:1746143775.804217:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626710912:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.804231:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143775.805057:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.805133:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622432896 00000100:00100000:2.0:1746143775.805138:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622432896 00010000:00010000:2.0:1746143775.805160:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a2 expref: 25 pid: 6587 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.805193:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5438 00000100:00100000:2.0:1746143775.805199:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2011:x1830963622432896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.805208:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.805213:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a2 expref: 25 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.805223:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a2 expref: 25 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.805240:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73a85ec lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9a2 expref: 25 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.805250:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.805254:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143775.805262:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143775.805269:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143775.805296:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.805320:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622432896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 121us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.805326:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5438 00010000:00010000:3.0:1746143775.805442:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.805449:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143775.805490:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:3.0:1746143775.805494:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143775.805509:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.805544:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.805554:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.805638:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.805644:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.805650:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.805654:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.805657:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.805663:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.805671:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143775.805674:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.805676:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.805680:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a877b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.807537:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.807552:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8782 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.807557:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.807561:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55d400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.807564:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.807569:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8782 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.807579:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e021600) 00010000:00010000:3.0:1746143775.807581:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.807584:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8782 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.807589:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8782 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.807625:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c200/0x87925e4cb73a8774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa5f expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.807635:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa5f expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.807641:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.807643:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143775.807645:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:3.0:1746143775.807698:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32058:x1830963622432256:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 6841us (7145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.807705:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12812 00000100:00100000:0.0:1746143775.812445:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.812480:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.812516:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.812596:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622433024 00000100:00100000:1.0:1746143775.812605:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622433024 00000100:00100000:1.0:1746143775.812654:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622433280 00000100:00100000:1.0:1746143775.812657:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622433280 00000100:00100000:1.0:1746143775.812670:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622433152 00000100:00100000:1.0:1746143775.812672:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622433152 00000100:00100000:2.0:1746143775.812681:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11571 00000100:00100000:2.0:1746143775.812691:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622433024:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143775.812710:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.812729:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73a8790 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa66 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.812779:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626711040:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143775.813006:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11572 00000100:00100000:1.0:1746143775.813012:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622433280:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143775.813019:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143775.813026:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73a8797 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa74 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.813037:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.813039:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.813046:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73a8797 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa74 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.813058:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73a8797 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa74 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.813070:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3ba00, rc 0) 00000100:00080000:0.0:1746143775.813126:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143775.813144:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143775.813218:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11573 00000100:00100000:3.0:1746143775.813226:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622433152:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143775.813233:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.813242:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73a879e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa6d expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.813256:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.813257:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.813261:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73a879e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa6d expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.813270:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73a879e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa6d expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.813277:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74000, rc 0) 00000100:00100000:1.0:1746143775.813508:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622433280:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 495us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.813514:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11572 00000100:00100000:3.0:1746143775.813694:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622433152:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 464us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.813699:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11573 00002000:00010000:2.0:1746143775.821203:0:12327:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime: 1746143775 -> 1746143776 00002000:00010000:2.0:1746143775.821210:0:12327:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143775 -> 1746143776 00002000:00010000:2.0:1746143775.821212:0:12327:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime: 1746143775 -> 1746143776 00010000:00010000:3.0:1746143775.821214:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143775.821230:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626711040:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143775.821258:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73a8790 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa66 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.821271:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73a8790 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa66 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.821285:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30800, rc 0) 00000100:00100000:2.0:1746143775.821527:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622433024:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8836us (9087us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143775.821535:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11571 00000100:00100000:0.0:1746143775.821735:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.821868:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622433408 00000100:00100000:2.0:1746143775.821874:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622433408 00000100:00100000:2.0:1746143775.821957:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11574 00000100:00100000:2.0:1746143775.821964:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32055:x1830963622433408:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143775.821978:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.821989:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa7b expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.822009:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a83e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a84b expref: 45 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.822016:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082084600/0x87925e4cb73a8513 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a939 expref: 8 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.822023:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73a8409 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a875 expref: 25 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.822029:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.822030:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.822033:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->1060863] (req 1048576->1060863) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.822055:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73a8409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a875 expref: 25 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.822065:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73a8409 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a875 expref: 25 pid: 9839 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.822075:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626711168:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.822130:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082084600/0x87925e4cb73a8513 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a939 expref: 8 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.822142:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082084600/0x87925e4cb73a8513 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a939 expref: 8 pid: 1947 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.822149:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626711296:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.822170:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a83e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a84b expref: 45 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.822177:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a83e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a84b expref: 45 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.822184:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626711424:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.822198:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.827075:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.827178:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626711168:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.827191:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626711296:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143775.827455:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622433536 00000100:00100000:1.0:1746143775.827461:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622433536 00010000:00010000:1.0:1746143775.827489:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082084600/0x87925e4cb73a8513 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a939 expref: 9 pid: 1947 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.827502:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626711424:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143775.827526:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5439 00010000:00010000:2.0:1746143775.827529:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->1060863] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.827532:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622433536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.827543:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30400, rc 0) 00010000:00010000:1.0:1746143775.827543:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.827561:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082084600/0x87925e4cb73a8513 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a939 expref: 9 pid: 1947 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.827570:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082084600/0x87925e4cb73a8513 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a939 expref: 9 pid: 1947 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.827589:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32055:x1830963622433408:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5625us (5854us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.827595:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11574 00010000:00010000:1.0:1746143775.828119:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084600/0x87925e4cb73a8513 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a939 expref: 9 pid: 1947 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.828140:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.828163:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622433536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 631us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.828169:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5439 00000100:00100000:0.0:1746143775.828717:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.828860:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622433792 00000100:00100000:3.0:1746143775.828865:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622433792 00000100:00100000:3.0:1746143775.828902:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12813 00000100:00100000:3.0:1746143775.828908:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32058:x1830963622433792:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143775.828950:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.828963:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a87ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa82 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.829214:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.829227:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa5f expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.829233:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.829256:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa5f expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.829407:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa5f expref: 10 pid: 14991 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.829418:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626711552:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.829476:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.829641:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.829719:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622433920 00000100:00100000:1.0:1746143775.829722:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622433920 00010000:00010000:1.0:1746143775.829735:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73a8409 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a875 expref: 25 pid: 9839 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143775.829760:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5440 00000100:00100000:1.0:1746143775.829765:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622433920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.829774:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.829785:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73a8409 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a875 expref: 25 pid: 9839 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.829793:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73a8409 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a875 expref: 25 pid: 9839 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.829805:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73a8409 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a875 expref: 25 pid: 9839 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.829815:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.829834:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622433920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 68us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.829839:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5440 00000100:00100000:0.0:1746143775.830739:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.830766:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626711552:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.830781:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143775.830796:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.830829:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622434048 00000100:00100000:1.0:1746143775.830833:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622434048 00000100:00100000:2.0:1746143775.830843:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622434176 00000100:00100000:2.0:1746143775.830846:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622434176 00010000:00010000:1.0:1746143775.830847:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a83e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a84b expref: 46 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143775.830857:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa5f expref: 11 pid: 14991 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143775.830871:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5441 00000100:00100000:2.0:1746143775.830874:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5442 00000100:00100000:1.0:1746143775.830876:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963622434048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143775.830878:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622434176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.830882:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.830882:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.830886:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa5f expref: 11 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.830890:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a83e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a84b expref: 46 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143775.830893:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa5f expref: 11 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.830898:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a83e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a84b expref: 46 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143775.830904:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8789 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa5f expref: 11 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.830907:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a83e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a84b expref: 46 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.830933:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.830944:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143775.830944:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.830947:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.830950:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.830953:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.830957:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.830958:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143775.830974:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143775.830977:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.830985:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626711680:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143775.830991:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622434176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 113us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.831000:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5442 00000100:00100000:1.0:1746143775.831015:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf540 going to sleep for 11 seconds 00010000:00010000:2.0:1746143775.831522:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143775.831529:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143775.831547:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143775.831641:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73a87ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa82 expref: 11 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.831654:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa82 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.831660:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.831662:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143775.831664:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8b000, rc 0) 00000100:00100000:2.0:1746143775.831699:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32058:x1830963622433792:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2792us (2983us total) trans 8589943552 rc 0/0 00000100:00100000:2.0:1746143775.831704:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12813 00000100:00100000:1.0:1746143775.832632:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626711680:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143775.832636:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143775.832644:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.832667:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963622434048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1790us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.832674:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5441 00000100:00100000:3.0:1746143775.832732:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622434432 00000100:00100000:3.0:1746143775.832737:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622434432 00002000:00100000:3.0:1746143775.832764:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1056768->1060863) req@ffff880096fd8a80 x1830963622434432/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.832772:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd8a80 with x1830963622434432 ext(1056768->1060863) 00002000:00010000:3.0:1746143775.832776:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd8a80 00000100:00100000:3.0:1746143775.832795:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3302 00000100:00100000:3.0:1746143775.832801:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622434432:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143775.833024:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622434432:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 222us (388us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143775.833031:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3302 00002000:00100000:3.0:1746143775.833036:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1056768->1060863) req@ffff880096fd8a80 x1830963622434432/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/4536 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.833043:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd8a80 with x1830963622434432 ext(1056768->1060863) 00002000:00010000:3.0:1746143775.833047:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd8a80 00000100:00100000:0.0:1746143775.834071:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.834237:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622434560 00000100:00100000:3.0:1746143775.834241:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622434560 00000100:00100000:3.0:1746143775.834266:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12814 00000100:00100000:3.0:1746143775.834272:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32058:x1830963622434560:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143775.834285:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.834297:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a87c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa89 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.834357:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.834369:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa82 expref: 11 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.834375:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.834400:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa82 expref: 11 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.834410:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa82 expref: 11 pid: 14991 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.834421:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626711808:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.834529:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.834597:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.834795:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622434816 00000100:00100000:1.0:1746143775.834799:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622434816 00000100:00100000:1.0:1746143775.834829:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4680 00000100:00100000:1.0:1746143775.834834:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32055:x1830963622434816:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143775.834987:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32055:x1830963622434816:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 152us (389us total) trans 8589943553 rc 0/0 00000100:00100000:1.0:1746143775.834993:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4680 00000100:00100000:3.0:1746143775.837243:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626711808:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.837261:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143775.837657:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.837717:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622434944 00000100:00100000:1.0:1746143775.837722:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622434944 00010000:00010000:1.0:1746143775.837745:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa82 expref: 12 pid: 14991 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143775.837836:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5443 00000100:00100000:1.0:1746143775.837843:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622434944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.837990:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.837997:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa82 expref: 12 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.838006:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa82 expref: 12 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.838053:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b000/0x87925e4cb73a87b3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa82 expref: 12 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.838066:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143775.838071:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.838079:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.838132:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.838156:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143775.838176:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.838182:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143775.838219:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:3.0:1746143775.838223:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143775.838237:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.838258:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73a87c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa89 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.838279:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa89 expref: 11 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.838285:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.838287:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143775.838289:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ae00, rc 0) 00000100:00100000:1.0:1746143775.838353:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622434944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 510us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.838359:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5443 00000100:00100000:3.0:1746143775.838495:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32058:x1830963622434560:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4222us (4425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.838501:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12814 00000100:00100000:0.0:1746143775.841048:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.841432:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.841487:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622435072 00000100:00100000:2.0:1746143775.841494:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622435072 00000100:00100000:2.0:1746143775.841524:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622435200 00000100:00100000:2.0:1746143775.841525:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622435200 00000100:00100000:2.0:1746143775.841536:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11575 00000100:00100000:2.0:1746143775.841542:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622435072:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143775.841554:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.841566:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73a87cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa90 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.841603:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626711936:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143775.841665:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143775.841719:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11576 00000100:00100000:3.0:1746143775.841726:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622435200:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143775.841732:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.841739:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a87d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa97 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.841759:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626712064:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143775.841790:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.843624:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626711936:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143775.843647:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73a87cf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa90 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.843658:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73a87cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa90 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.843666:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31c00, rc 0) 00000100:00100000:2.0:1746143775.843700:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622435072:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2158us (2656us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143775.843706:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11575 00002000:00010000:3.0:1746143775.843770:0:1947:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime: 1746143774 -> 1746143776 00002000:00010000:3.0:1746143775.843773:0:1947:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143773 -> 1746143776 00002000:00010000:3.0:1746143775.843774:0:1947:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime: 1746143774 -> 1746143776 00000100:00100000:3.0:1746143775.843782:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626712064:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143775.843795:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a87d6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa97 expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.843803:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73a87d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa97 expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143775.843813:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7de00, rc 0) 00000100:00100000:3.0:1746143775.843829:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622435200:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2104us (2397us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143775.843834:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11576 00000100:00100000:0.0:1746143775.845738:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.845827:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622435456 00000100:00100000:3.0:1746143775.845833:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622435456 00000100:00100000:3.0:1746143775.845876:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12815 00000100:00100000:3.0:1746143775.845883:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32058:x1830963622435456:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143775.845897:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.845943:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a87dd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aa9e expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.846019:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.846031:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.846040:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143775.846048:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143775.846113:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a87dd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa9e expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.846125:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa9e expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.846131:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.846134:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143775.846137:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c000, rc 0) 00000100:00100000:3.0:1746143775.846167:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32058:x1830963622435456:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 284us (433us total) trans 8589943554 rc 0/0 00000100:00100000:3.0:1746143775.846172:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12815 00000100:00100000:0.0:1746143775.847967:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.847996:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.848266:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.848295:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.848308:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.848331:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.848391:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622435712 00000100:00100000:1.0:1746143775.848397:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622435712 00000100:00100000:1.0:1746143775.848420:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622435584 00000100:00100000:1.0:1746143775.848421:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622435584 00000100:00100000:1.0:1746143775.848616:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622435840 00000100:00100000:1.0:1746143775.848619:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622435840 00000100:00100000:0.0:1746143775.848643:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622435968 00000100:00100000:0.0:1746143775.848645:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622435968 00000100:00100000:0.0:1746143775.848656:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622436096 00000100:00100000:0.0:1746143775.848657:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622436096 00000100:00100000:0.0:1746143775.848664:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622436224 00000100:00100000:0.0:1746143775.848665:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622436224 00000100:00100000:0.0:1746143775.848675:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11577 00000100:00100000:0.0:1746143775.848680:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622435712:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143775.848707:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.848720:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.848726:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143775.848727:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143775.848730:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.848751:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.848760:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 23 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143775.848771:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626712192:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143775.848815:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.848829:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11578 00000100:00100000:0.0:1746143775.848833:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622435584:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143775.848848:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.848857:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2e00/0x87925e4cb73a83d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a83d expref: 39 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.848862:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a850c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a92b expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.848868:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8402 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a867 expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.848872:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143775.848873:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143775.848875:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.848885:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8402 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a867 expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.848891:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8402 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a867 expref: 29 pid: 9839 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746143775.848899:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626712320:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143775.848956:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a850c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a92b expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.848963:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a850c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a92b expref: 11 pid: 1947 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746143775.848969:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626712448:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143775.848990:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801331d2e00/0x87925e4cb73a83d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a83d expref: 39 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.848996:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2e00/0x87925e4cb73a83d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a83d expref: 39 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746143775.849002:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626712576:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143775.849015:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.849385:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11579 00000100:00100000:2.0:1746143775.849398:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11580 00000100:00100000:2.0:1746143775.849403:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622435968:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143775.849419:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.849428:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d67200/0x87925e4cb73a83f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a852 expref: 39 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.849435:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8528 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a940 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.849447:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a8417 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a87c expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.849452:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.849453:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.849455:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.849468:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a8417 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a87c expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.849476:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a8417 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a87c expref: 29 pid: 12327 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.849483:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626712704:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.849511:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8528 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a940 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.849519:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8528 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a940 expref: 11 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.849526:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626712832:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.849541:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d67200/0x87925e4cb73a83f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a852 expref: 39 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.849552:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d67200/0x87925e4cb73a83f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a852 expref: 39 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.849559:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626712960:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.849571:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.849585:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11581 00000100:00100000:2.0:1746143775.849590:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622436096:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143775.849604:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.849612:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.849619:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73a879e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa6d expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.849624:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.849625:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.849627:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.849638:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73a879e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa6d expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.849645:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73a879e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa6d expref: 11 pid: 1947 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.849653:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626713088:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.849673:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.849680:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 29 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.849687:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626713216:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.849698:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.849707:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622435840:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143775.849720:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.849728:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.849733:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143775.849734:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143775.849736:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.849748:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.849755:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 23 pid: 12327 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.849762:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626713344:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.849775:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143775.849858:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11582 00000100:00100000:1.0:1746143775.849865:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622436224:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143775.849880:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.849888:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 23 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.849893:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73a8797 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa74 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.849901:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.849902:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.849903:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.849942:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73a8797 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa74 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.849950:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73a8797 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa74 expref: 10 pid: 9586 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143775.849957:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626713472:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143775.849987:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 23 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.849993:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 23 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143775.850000:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626713600:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143775.850016:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffafe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143775.860704:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.860751:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622436352 00000100:00100000:2.0:1746143775.860753:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.860759:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622436352 00000100:00100000:2.0:1746143775.860765:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:1.0:1746143775.860797:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x395:0x0] (1814528->2097151) req@ffff88012d842a00 x1830963622436352/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.860806:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842a00 with x1830963622436352 ext(1814528->2097151) 00010000:00010000:1.0:1746143775.860815:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 24 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.860825:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 24 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.860826:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626712704:192.168.202.3@tcp:104: 00002000:00010000:1.0:1746143775.860832:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d842a00 00000100:00100000:1.0:1746143775.860848:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1401 00000100:00100000:2.0:1746143775.860849:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626712832:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143775.860854:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622436352:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143775.860862:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.860876:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622436608 00000100:00100000:2.0:1746143775.860878:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622436608 00010000:00010000:2.0:1746143775.860895:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a850c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a92b expref: 12 pid: 1947 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.860929:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622436480 00000100:00100000:2.0:1746143775.860931:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622436480 00010000:00010000:2.0:1746143775.860950:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8402 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a867 expref: 30 pid: 9839 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.860963:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622436864 00000100:00100000:2.0:1746143775.860965:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622436864 00010000:00010000:2.0:1746143775.860971:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a8417 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a87c expref: 31 pid: 12327 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143775.860982:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5444 00000100:00100000:2.0:1746143775.860986:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622436608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.860997:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143775.860999:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5445 00000100:00100000:1.0:1746143775.861004:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2010:x1830963622436480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.861008:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.861011:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a850c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a92b expref: 12 pid: 1947 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861015:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8402 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a867 expref: 31 pid: 9839 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143775.861019:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a850c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a92b expref: 12 pid: 1947 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746143775.861065:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5446 00000100:00100000:3.0:1746143775.861072:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2010:x1830963622436864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143775.861078:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143775.861087:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a8417 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a87c expref: 31 pid: 12327 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143775.861095:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a8417 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a87c expref: 31 pid: 12327 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143775.861112:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a8417 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a87c expref: 31 pid: 12327 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143775.861124:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143775.861149:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622436864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.861154:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5446 00010000:00010000:1.0:1746143775.861371:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8402 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a867 expref: 29 pid: 9839 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861383:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.861399:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2010:x1830963622436480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 395us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.861404:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5445 00000100:00100000:1.0:1746143775.861419:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.861465:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.861474:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622436736 00000100:00100000:1.0:1746143775.861476:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622436736 00010000:00010000:1.0:1746143775.861486:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2e00/0x87925e4cb73a83d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a83d expref: 40 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143775.861496:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5447 00000100:00100000:1.0:1746143775.861500:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622436736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.861504:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.861510:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801331d2e00/0x87925e4cb73a83d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a83d expref: 40 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861516:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801331d2e00/0x87925e4cb73a83d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a83d expref: 40 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861525:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.861536:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622436736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 36us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.861540:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5447 00000100:00100000:1.0:1746143775.861580:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.861590:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622436992 00000100:00100000:1.0:1746143775.861592:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622436992 00010000:00010000:1.0:1746143775.861599:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8528 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a940 expref: 13 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143775.861609:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5448 00000100:00100000:1.0:1746143775.861612:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622436992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.861616:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.861622:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8528 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a940 expref: 13 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861632:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8528 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a940 expref: 13 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861641:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8528 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a940 expref: 13 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861651:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.861661:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622436992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 48us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.861665:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5448 00000100:00100000:1.0:1746143775.861745:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.861753:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622437120 00000100:00100000:1.0:1746143775.861755:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622437120 00010000:00010000:1.0:1746143775.861768:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d67200/0x87925e4cb73a83f4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a852 expref: 40 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143775.861780:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5449 00000100:00100000:1.0:1746143775.861784:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622437120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.861789:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.861795:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d67200/0x87925e4cb73a83f4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a852 expref: 40 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861802:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d67200/0x87925e4cb73a83f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a852 expref: 40 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861815:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.861816:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143775.861817:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8402 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a867 expref: 28 pid: 9839 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861820:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.861827:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143775.861830:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626712320:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143775.861838:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626712448:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143775.861841:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143775.861844:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2e00/0x87925e4cb73a83d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a83d expref: 40 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143775.861852:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622437120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 68us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.861856:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626712576:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143775.861857:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5449 00010000:00010000:0.0:1746143775.861874:0:9839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.861881:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.861889:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622437248 00000100:00100000:1.0:1746143775.861891:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622437248 00000100:00100000:0.0:1746143775.861892:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626712192:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143775.861899:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73a879e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa6d expref: 12 pid: 1947 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746143775.861900:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.861924:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5450 00000100:00100000:1.0:1746143775.861929:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622437248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.861945:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.861953:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73a879e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa6d expref: 12 pid: 1947 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.861960:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73a879e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa6d expref: 12 pid: 1947 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746143775.861967:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143775.861974:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.861985:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622437248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.861990:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5450 00000100:00100000:0.0:1746143775.861992:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.861997:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622437376 00000100:00100000:1.0:1746143775.861999:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622437376 00010000:00010000:1.0:1746143775.862006:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 28 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143775.862019:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622437632 00000100:00100000:1.0:1746143775.862021:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622437632 00010000:00010000:1.0:1746143775.862030:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73a8797 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa74 expref: 11 pid: 9586 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143775.862038:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5451 00000100:00100000:1.0:1746143775.862041:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2010:x1830963622437376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.862046:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.862051:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 28 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.862058:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 28 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.862068:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.862069:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.862071:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.862076:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.862084:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.862097:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2010:x1830963622437376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.862101:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5451 00000100:00100000:1.0:1746143775.862109:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5452 00000100:00100000:1.0:1746143775.862112:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622437632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.862119:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.862128:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73a8797 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa74 expref: 11 pid: 9586 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.862135:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73a8797 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa74 expref: 11 pid: 9586 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143775.862145:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.862157:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622437632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 44us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.862161:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5452 00010000:00010000:1.0:1746143775.862180:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73a8797 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa74 expref: 10 pid: 9586 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143775.862188:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626713472:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.862374:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622437504 00000100:00100000:3.0:1746143775.862380:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622437504 00002000:00100000:3.0:1746143775.862396:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1060863) req@ffff880091d4e680 x1830963622437504/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 12776/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.862403:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4e680 with x1830963622437504 ext(1048576->1060863) 00010000:00010000:3.0:1746143775.862407:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 26 pid: 12327 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143775.862414:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 26 pid: 12327 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746143775.862424:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d4e680 00000100:00100000:3.0:1746143775.862444:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1402 00000100:00100000:3.0:1746143775.862449:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2010:x1830963622437504:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143775.862970:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2010:x1830963622437504:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 520us (1548us total) trans 17179872948 rc 0/0 00000100:00100000:3.0:1746143775.862979:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1402 00002000:00100000:3.0:1746143775.862984:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1060863) req@ffff880091d4e680 x1830963622437504/t17179872948(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 12776/448 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143775.862991:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4e680 with x1830963622437504 ext(1048576->1060863) 00010000:00010000:3.0:1746143775.862995:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 28 pid: 12327 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143775.863002:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 28 pid: 12327 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746143775.863007:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d4e680 00010000:00010000:3.0:1746143775.865812:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73a879e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa6d expref: 11 pid: 1947 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746143775.865826:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626713088:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.865836:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a873c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4775936->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa43 expref: 27 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.865847:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626713216:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143775.865880:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.865890:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626713600:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143775.865899:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622437760 00000100:00100000:0.0:1746143775.865903:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622437760 00010000:00010000:1.0:1746143775.865926:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.865945:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 28 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143775.865991:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.865991:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085c00/0x87925e4cb73a850c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a92b expref: 10 pid: 1947 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143775.865998:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.866003:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.866004:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.866006:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.866009:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.866015:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.866020:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.866026:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.866029:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143775.866032:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.866037:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143775.866040:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.866046:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.866053:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622436608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5066us (5299us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143775.866059:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.866060:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5444 00010000:00010000:3.0:1746143775.866064:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73a8807 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.866094:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622436096:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 16504us (17785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.866095:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5453 00000100:00100000:3.0:1746143775.866100:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11581 00000100:00100000:2.0:1746143775.866101:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2011:x1830963622437760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.866110:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.866120:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 28 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143775.866127:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d67200/0x87925e4cb73a83f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a852 expref: 38 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143775.866133:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 28 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.866134:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626712960:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143775.866144:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73a8704 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa27 expref: 28 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143775.866149:0:3134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.866152:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.866153:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.866155:0:3134:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.866156:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.866161:0:3134:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.866162:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.866170:0:3134:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.866171:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143775.866180:0:3134:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.866182:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2011:x1830963622437760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 82us (303us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143775.866185:0:3134:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.866187:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5453 00010000:00010000:3.0:1746143775.866190:0:3134:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143775.866192:0:3134:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.866198:0:3134:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.866205:0:3134:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.866209:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73a8800 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.866232:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622435968:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 16830us (17936us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.866237:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11580 00000100:00100000:3.0:1746143775.866260:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626713344:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.866269:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866315:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866321:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866333:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866338:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866343:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866347:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143775.866349:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866354:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866362:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866369:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a87f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.866408:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2009:x1830963622435584:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 17574us (18411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.866414:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11578 00010000:00010000:1.0:1746143775.866430:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866435:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866444:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866449:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866453:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866457:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e3aa00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143775.866459:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866463:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866470:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.866475:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a8815 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.866500:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622436224:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 16636us (18168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.866504:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11582 00000100:00100000:0.0:1746143775.868161:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.868275:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622437888 00000100:00100000:2.0:1746143775.868280:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622437888 00010000:00010000:2.0:1746143775.868319:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 27 pid: 12327 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.868488:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5454 00000100:00100000:2.0:1746143775.868495:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2011:x1830963622437888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.868503:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.868516:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 27 pid: 12327 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.868525:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 27 pid: 12327 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.868537:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73a87a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa7b expref: 27 pid: 12327 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.868546:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.868548:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.868550:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.868557:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.868862:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.869124:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2011:x1830963622437888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 629us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.869130:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5454 00010000:00010000:3.0:1746143775.869685:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.869694:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.869708:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.869715:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.869722:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.869727:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c1800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143775.869730:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.869736:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.869746:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.869752:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a880e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.869794:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622435840:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 20402us (21528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.869801:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11579 00000100:00100000:1.0:1746143775.870801:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622436352:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 9945us (10103us total) trans 17179872949 rc 0/0 00000100:00100000:1.0:1746143775.870809:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1401 00002000:00100000:1.0:1746143775.870817:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x395:0x0] (1814528->2097151) req@ffff88012d842a00 x1830963622436352/t17179872949(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:171/0 lens 488/448 e 0 to 0 dl 1746143786 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.870825:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842a00 with x1830963622436352 ext(1814528->2097151) 00010000:00010000:1.0:1746143775.870832:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 26 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.870842:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 26 pid: 3135 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143775.870848:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d842a00 00000100:00100000:0.0:1746143775.873228:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.873386:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622438016 00000100:00100000:2.0:1746143775.873394:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622438016 00010000:00010000:2.0:1746143775.873425:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 26 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.873463:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5455 00000100:00100000:2.0:1746143775.873470:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2010:x1830963622438016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.873484:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.873498:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 26 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.873507:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 26 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.873526:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73a8766 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa51 expref: 26 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.873540:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.873542:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.873545:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.873553:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.873582:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143775.873599:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.873609:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622438016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 140us (388us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143775.873611:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.873615:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5455 00010000:00010000:1.0:1746143775.873624:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.873630:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.873637:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.873642:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d550a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143775.873645:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.873653:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.873662:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.873668:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73a87f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.873702:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622435712:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 25021us (25739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.873710:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11577 00000100:00100000:0.0:1746143775.876177:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.876480:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622438272 00000100:00100000:3.0:1746143775.876488:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622438272 00000100:00100000:3.0:1746143775.876525:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12816 00000100:00100000:3.0:1746143775.876532:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32058:x1830963622438272:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1746143775.876572:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143775.876593:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a87c8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa89 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876606:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.876610:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143775.876630:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.876640:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a91d expref: 273 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876646:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b0 expref: 24 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876652:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a898 expref: 24 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876658:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 273 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876667:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a978 expref: 24 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876673:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 8/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.876697:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a978 expref: 24 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876708:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a978 expref: 24 pid: 7244 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.876718:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626713728:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.876792:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 273 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876799:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 273 pid: 7245 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.876806:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b62680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626713856:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.876829:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a898 expref: 24 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876836:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a898 expref: 24 pid: 6587 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.876842:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626713984:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.876864:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b0 expref: 24 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876870:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b0 expref: 24 pid: 6587 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.876877:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b60380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626714112:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.876900:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a91d expref: 273 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.876907:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a91d expref: 273 pid: 6587 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.876930:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626714240:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.876962:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.879019:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.879112:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626713728:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.879125:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b62680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626713856:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.879131:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626713984:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.879137:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b60380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626714112:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143775.879203:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622438528 00000100:00100000:2.0:1746143775.879209:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622438528 00000100:00100000:2.0:1746143775.879931:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4681 00000100:00100000:2.0:1746143775.879949:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:30659:x1830963622438528:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143775.880627:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:30659:x1830963622438528:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 678us (1612us total) trans 8589943555 rc 0/0 00000100:00100000:2.0:1746143775.880635:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4681 00000100:00100000:2.0:1746143775.880889:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.881000:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.881013:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.881026:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622438656 00000100:00100000:2.0:1746143775.881030:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622438656 00010000:00010000:2.0:1746143775.881046:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 274 pid: 7245 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.881062:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622438912 00000100:00100000:2.0:1746143775.881064:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622438912 00010000:00010000:2.0:1746143775.881072:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a898 expref: 26 pid: 6587 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.881082:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622438784 00000100:00100000:2.0:1746143775.881083:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622438784 00010000:00010000:2.0:1746143775.881090:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b0 expref: 27 pid: 6587 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.881101:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5456 00000100:00100000:2.0:1746143775.881106:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+274:2008:x1830963622438656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.881113:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.881118:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 274 pid: 7245 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.881126:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 274 pid: 7245 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.881146:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a844f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a89f expref: 274 pid: 7245 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.881156:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.881160:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.881167:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.881185:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+273:2008:x1830963622438656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 79us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.881190:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5456 00000100:00100000:2.0:1746143775.881200:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5457 00000100:00100000:2.0:1746143775.881205:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622438912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.881211:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.881214:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a898 expref: 27 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.881222:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a898 expref: 27 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.881232:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550600/0x87925e4cb73a8441 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a898 expref: 27 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.881239:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.881242:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.881250:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.881261:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622438912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.881265:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5457 00000100:00100000:2.0:1746143775.881293:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5458 00000100:00100000:2.0:1746143775.881297:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622438784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.881302:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.881306:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b0 expref: 25 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.881311:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b0 expref: 25 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.881320:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e000/0x87925e4cb73a8616 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a9b0 expref: 25 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.881327:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.881330:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.881334:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.881347:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622438784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 49us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.881351:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5458 00000100:00100000:3.0:1746143775.881488:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626714240:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.881512:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143775.882333:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.882435:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622439040 00000100:00100000:2.0:1746143775.882440:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622439040 00010000:00010000:2.0:1746143775.882454:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a91d expref: 273 pid: 6587 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.882483:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5459 00000100:00100000:2.0:1746143775.882489:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:2011:x1830963622439040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.882495:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.882499:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a91d expref: 273 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.882506:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a91d expref: 273 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.882516:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73a84e2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a91d expref: 273 pid: 6587 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.882526:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.882529:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.882533:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.882564:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:2011:x1830963622439040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.882569:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5459 00000100:00100000:0.0:1746143775.883107:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.883339:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622439296 00000100:00100000:3.0:1746143775.883344:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622439296 00000100:00100000:3.0:1746143775.883368:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12817 00000100:00100000:3.0:1746143775.883374:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+272:32063:x1830963622439296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.883389:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.883399:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ac00/0x87925e4cb73a8823 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aaa5 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.883455:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.883464:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.883472:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.883484:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8831 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.883489:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.883494:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143775.883639:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.883717:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622439424 00000100:00100000:1.0:1746143775.883721:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622439424 00010000:00010000:1.0:1746143775.883736:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a978 expref: 24 pid: 7244 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143775.883760:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5460 00000100:00100000:1.0:1746143775.883765:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622439424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143775.883772:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.883775:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a978 expref: 24 pid: 7244 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.883783:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a978 expref: 24 pid: 7244 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.883795:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86600/0x87925e4cb73a8598 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840a978 expref: 24 pid: 7244 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.883803:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143775.883826:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143775.883833:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143775.883839:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143775.883862:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.883892:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963622439424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 126us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.883897:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5460 00010000:00010000:3.0:1746143775.883972:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.883978:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000040:00080000:3.0:1746143775.884164:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2617, 88 off218008 00000004:00080000:3.0:1746143775.884171:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835108257942ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143775.884205:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2585, 88 off215544 00000004:00080000:3.0:1746143775.884210:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835108298190ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143775.884222:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2586, 88 off215632 00000004:00080000:3.0:1746143775.884224:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835108312316ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143775.884232:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2618, 88 off218096 00000004:00080000:3.0:1746143775.884235:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835108323162ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143775.884242:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2619, 88 off218184 00000004:00080000:3.0:1746143775.884244:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835108332302ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143775.884252:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2587, 88 off215720 00000004:00080000:3.0:1746143775.884254:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835108341808ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143775.884260:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2588, 88 off215808 00000004:00080000:3.0:1746143775.884262:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835108350396ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143775.884269:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2589, 88 off215896 00000004:00080000:3.0:1746143775.884271:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835108359225ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143775.884278:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2620, 88 off218272 00000004:00080000:3.0:1746143775.884281:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835108368496ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143775.884289:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2590, 88 off215984 00000004:00080000:3.0:1746143775.884292:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835108379617ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143775.884299:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2621, 88 off218360 00000004:00080000:3.0:1746143775.884301:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835108389182ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143775.884308:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2591, 88 off216072 00000004:00080000:3.0:1746143775.884310:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835108398412ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143775.884317:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2622, 88 off218448 00000004:00080000:3.0:1746143775.884320:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835108407521ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143775.884327:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2623, 88 off218536 00000004:00080000:3.0:1746143775.884329:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835108416930ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143775.884336:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2624, 88 off218624 00000004:00080000:3.0:1746143775.884338:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835108426010ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143775.884345:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2625, 88 off218712 00000004:00080000:3.0:1746143775.884347:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835108435288ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143775.884354:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2592, 88 off216160 00000004:00080000:3.0:1746143775.884357:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835108444831ns, next at 770855090093ns, rc = 0 00000001:00080000:0.0:1746143775.885639:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943556 is committed 00000004:00080000:0.0:1746143775.885644:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1822 committed 00000004:00080000:0.0:1746143775.885657:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1853 committed 00000004:00080000:0.0:1746143775.885668:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1852 committed 00000004:00080000:0.0:1746143775.885670:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1851 committed 00000004:00080000:0.0:1746143775.885671:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1850 committed 00000004:00080000:0.0:1746143775.885672:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1821 committed 00000004:00080000:0.0:1746143775.885674:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1849 committed 00000004:00080000:0.0:1746143775.885675:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1820 committed 00000004:00080000:0.0:1746143775.885676:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1848 committed 00000004:00080000:0.0:1746143775.885677:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1819 committed 00000004:00080000:0.0:1746143775.885679:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1818 committed 00000004:00080000:0.0:1746143775.885680:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1817 committed 00000004:00080000:0.0:1746143775.885681:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1847 committed 00000004:00080000:0.0:1746143775.885682:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1846 committed 00000004:00080000:0.0:1746143775.885684:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1816 committed 00000004:00080000:0.0:1746143775.885685:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1815 committed 00000004:00080000:0.0:1746143775.885687:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1845 committed 00000001:00080000:0.0:1746143775.885693:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943555 is committed 00000001:00080000:0.0:1746143775.885703:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943551 is committed 00000100:00100000:0.0:1746143775.885762:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143775.885785:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626714752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143775.885787:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626714368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143775.885826:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.885846:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626714880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143775.885859:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.885874:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626715392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143775.885891:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143775.885964:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626714368 00000100:00100000:1.0:1746143775.885969:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626714368 00000100:00100000:3.0:1746143775.885979:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626715904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143775.885991:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626714880 00000100:00100000:1.0:1746143775.885993:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626714880 00000100:00100000:3.0:1746143775.885995:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.886009:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746143775.886013:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626714496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143775.886026:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143775.886060:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626715392 00000100:00100000:1.0:1746143775.886063:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626715392 00000100:00100000:3.0:1746143775.886076:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626715008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143775.886076:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626715904 00000100:00100000:1.0:1746143775.886077:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626715904 00000100:00100000:1.0:1746143775.886084:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626714496 00000100:00100000:1.0:1746143775.886086:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626714496 00000100:00100000:3.0:1746143775.886089:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.886101:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626715520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143775.886112:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.886118:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626715136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143775.886122:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626715008 00000100:00100000:1.0:1746143775.886124:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626715008 00000100:00100000:1.0:1746143775.886139:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11583 00000100:00100000:3.0:1746143775.886143:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11584 00000100:00100000:1.0:1746143775.886145:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3771:x1830963626714368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143775.886149:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3771:x1830963626714880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143775.886151:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11585 00000100:00100000:2.0:1746143775.886157:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3771:x1830963626715392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143775.886224:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11586 00000100:00100000:3.0:1746143775.886229:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3771:x1830963626715904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143775.886244:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963626714368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (418us total) trans 21474840270 rc 0/0 00000100:00100000:1.0:1746143775.886249:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11583 00000100:00100000:1.0:1746143775.886260:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11587 00000100:00100000:1.0:1746143775.886272:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3771:x1830963626714496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143775.886279:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143775.886282:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143775.886283:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143775.886285:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143775.886287:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746143775.886306:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626715904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (310us total) trans 17179872950 rc 0/0 00000100:00100000:3.0:1746143775.886311:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11586 00000100:00100000:3.0:1746143775.886322:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11588 00000100:00100000:1.0:1746143775.886322:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963626714496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (295us total) trans 21474840272 rc 0/0 00000100:00100000:3.0:1746143775.886327:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963626715008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143775.886327:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11587 00000100:00100000:3.0:1746143775.886384:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963626715008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (293us total) trans 21474840273 rc 0/0 00000100:00100000:3.0:1746143775.886389:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11588 00000100:00100000:3.0:1746143775.886403:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626714752 00000100:00100000:3.0:1746143775.886406:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626714752 00000100:00100000:3.0:1746143775.886419:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11589 00000100:00100000:3.0:1746143775.886424:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963626714752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143775.886446:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626715264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143775.886474:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963626714752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (361us total) trans 21474840274 rc 0/0 00000100:00100000:3.0:1746143775.886479:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11589 00000100:00100000:3.0:1746143775.886511:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963626714880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 362us (650us total) trans 21474840271 rc 0/0 00000100:00100000:3.0:1746143775.886515:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11584 00000100:00100000:3.0:1746143775.886527:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.886539:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626716032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143775.886555:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143775.886581:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143775.886585:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626715392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 428us (692us total) trans 17179872951 rc 0/0 00000100:00100000:2.0:1746143775.886590:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11585 00000004:00080000:3.0:1746143775.886591:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092146a00/2, rc 0, transno 17179872951 00000100:00100000:3.0:1746143775.886595:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626715392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143775.886599:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626715520 00000004:00080000:3.0:1746143775.886601:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092144700/2, rc 0, transno 17179872950 00000100:00100000:2.0:1746143775.886602:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626715520 00000100:00100000:3.0:1746143775.886603:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626715904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143775.886605:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626714624:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143775.886611:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d840000/2, rc 0, transno 21474840270 00000100:00100000:2.0:1746143775.886613:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626716032 00000100:00100000:2.0:1746143775.886615:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626716032 00000100:00100000:3.0:1746143775.886616:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626714368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143775.886621:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626715264 00000004:00080000:3.0:1746143775.886622:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d841c00/2, rc 0, transno 21474840271 00000100:00100000:2.0:1746143775.886623:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626715264 00000100:00100000:3.0:1746143775.886624:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626714880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143775.886628:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143775.886631:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d843480/2, rc 0, transno 21474840272 00000100:00100000:3.0:1746143775.886634:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626714496:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143775.886640:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d841f80/2, rc 0, transno 21474840273 00000100:00100000:3.0:1746143775.886642:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626715008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143775.886644:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626714624 00000100:00100000:2.0:1746143775.886646:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626714624 00000100:00100000:0.0:1746143775.886655:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626715776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143775.886656:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11590 00000100:00100000:2.0:1746143775.886660:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11591 00000100:00100000:3.0:1746143775.886661:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3771:x1830963626715520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143775.886664:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3771:x1830963626716032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143775.886673:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143775.886681:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626716288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143775.886695:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143775.886717:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3771:x1830963626715520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (188us total) trans 17179872952 rc 0/0 00000004:00080000:0.0:1746143775.886719:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d840e00/2, rc 0, transno 21474840274 00000100:00100000:2.0:1746143775.886720:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3771:x1830963626716032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (163us total) trans 17179872953 rc 0/0 00000100:00100000:3.0:1746143775.886722:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11590 00000100:00100000:0.0:1746143775.886724:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626714752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143775.886725:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11591 00000100:00100000:3.0:1746143775.886731:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626715776 00000100:00100000:3.0:1746143775.886734:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626715776 00000100:00100000:2.0:1746143775.886734:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626716288 00000100:00100000:2.0:1746143775.886736:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626716288 00000100:00100000:3.0:1746143775.886744:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11592 00000100:00100000:2.0:1746143775.886747:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11593 00000100:00100000:3.0:1746143775.886748:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963626715264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143775.886748:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143775.886751:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963626714624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143775.886761:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626715648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143775.886776:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143775.886777:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626715136 00000100:00100000:1.0:1746143775.886781:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626715136 00000100:00100000:0.0:1746143775.886784:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626716160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143775.886791:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626715648 00000100:00100000:1.0:1746143775.886793:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626715648 00000100:00100000:0.0:1746143775.886799:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143775.886801:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11594 00000100:00100000:1.0:1746143775.886805:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3774:x1830963626715776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143775.886846:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143775.886848:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143775.886850:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:1.0:1746143775.886852:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143775.886854:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143775.886899:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963626715264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (318us total) trans 21474840275 rc 0/0 00000100:00100000:2.0:1746143775.886903:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963626714624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (274us total) trans 21474840276 rc 0/0 00000100:00100000:3.0:1746143775.886904:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11592 00000100:00100000:1.0:1746143775.886904:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963626715776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (231us total) trans 17179872954 rc 0/0 00000100:00100000:2.0:1746143775.886908:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11593 00000100:00100000:1.0:1746143775.886924:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11594 00000100:00100000:2.0:1746143775.886931:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626716160 00000100:00100000:1.0:1746143775.886932:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11595 00000100:00100000:2.0:1746143775.886933:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626716160 00000100:00100000:3.0:1746143775.886946:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11596 00000100:00100000:1.0:1746143775.886946:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963626716288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143775.886952:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3773:x1830963626715136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143775.886956:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11597 00000100:00100000:2.0:1746143775.886963:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11598 00000100:00100000:0.0:1746143775.886966:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3773:x1830963626715648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143775.886968:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3773:x1830963626716160:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143775.886991:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092147800/2, rc 0, transno 17179872954 00002000:00010000:3.0:1746143775.886992:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143775.886995:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00000100:00100000:0.0:1746143775.886995:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626715776:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143775.886997:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143775.886998:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143775.887000:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143775.887002:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963626716288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (305us total) trans 17179872955 rc 0/0 00000004:00080000:0.0:1746143775.887004:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457d880/2, rc 0, transno 17179872955 00000100:00100000:0.0:1746143775.887007:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626716288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143775.887008:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11595 00000100:00100000:2.0:1746143775.887015:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3773:x1830963626716160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (216us total) trans 17179872956 rc 0/0 00000004:00080000:0.0:1746143775.887015:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d842300/2, rc 0, transno 21474840275 00000100:00100000:0.0:1746143775.887018:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626715264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143775.887020:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11598 00000100:00100000:3.0:1746143775.887021:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3773:x1830963626715136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (273us total) trans 21474840277 rc 0/0 00000004:00080000:0.0:1746143775.887025:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d840380/2, rc 0, transno 21474840276 00000100:00100000:3.0:1746143775.887026:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11596 00000100:00100000:0.0:1746143775.887028:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626714624:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143775.887046:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d843100/2, rc 0, transno 21474840277 00000004:00080000:3.0:1746143775.887047:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092147100/2, rc 0, transno 17179872952 00000100:00100000:0.0:1746143775.887049:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626715136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143775.887050:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626715520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143775.887058:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092145880/2, rc 0, transno 17179872956 00000004:00080000:3.0:1746143775.887060:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092144a80/2, rc 0, transno 17179872953 00000100:00100000:0.0:1746143775.887062:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626716160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143775.887063:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626716032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143775.887070:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626716416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143775.887087:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143775.887100:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626716416 00000100:00100000:2.0:1746143775.887104:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626716416 00000100:00100000:2.0:1746143775.887119:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11599 00000100:00100000:2.0:1746143775.887122:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3771:x1830963626716416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143775.887175:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3771:x1830963626716416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (86us total) trans 21474840278 rc 0/0 00000100:00100000:2.0:1746143775.887179:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11599 00000100:00100000:0.0:1746143775.887182:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3773:x1830963626715648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (404us total) trans 17179872957 rc 0/0 00000100:00100000:0.0:1746143775.887188:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11597 00000004:00080000:0.0:1746143775.887210:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092146300/2, rc 0, transno 17179872957 00000100:00100000:0.0:1746143775.887214:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626715648:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746143775.887318:0:7244:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b7e1880 reply state ffff88012b1cfc00 transno 8589943556 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.887332:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.887340:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.887342:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746143775.887345:0:7244:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746143775.887416:0:7244:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143775.887429:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32058:x1830963622438272:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 10897us (11258us total) trans 8589943556 rc 0/0 00000100:00100000:3.0:1746143775.887438:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12816 00010000:00010000:2.0:1746143775.887453:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.887460:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00000004:00080000:3.0:1746143775.887464:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac8a80/2, rc 0, transno 21474840278 00010000:00010000:2.0:1746143775.887467:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143775.887468:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626716416:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143775.887472:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7d400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143775.887475:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.887481:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.887490:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.887493:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143775.887495:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143775.887500:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a881c lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143775.887575:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73a8838 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887589:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73a8838 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887599:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73a8838 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143775.887611:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143775.887670:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73a8838 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887677:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73a8838 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887682:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73a8838 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887686:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e24de00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143775.887690:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73a8838 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887695:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73a8838 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887703:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143775.887705:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143775.887708:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73a8838 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887714:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73a8838 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887734:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887739:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887744:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887747:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887750:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8aa00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143775.887752:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887756:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887761:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143775.887763:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143775.887764:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887768:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73a882a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887775:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887779:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8831 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887784:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887788:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf14000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143775.887790:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887794:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8831 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887799:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14100) 00010000:00010000:0.0:1746143775.887801:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143775.887803:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8831 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887807:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf14000/0x87925e4cb73a8831 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.887847:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ac00/0x87925e4cb73a8823 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaa5 expref: 262 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.887854:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ac00/0x87925e4cb73a8823 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaa5 expref: 262 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.887861:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ac00, rc 0) 00000100:00100000:0.0:1746143775.887890:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+261:32063:x1830963622439296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4517us (4783us total) trans 8589943557 rc 301/301 00000100:00100000:0.0:1746143775.887897:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12817 00000100:00100000:2.0:1746143775.890568:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.890635:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.890724:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622439552 00000100:00100000:3.0:1746143775.890732:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622439552 00000100:00100000:0.0:1746143775.890748:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622439680 00000100:00100000:0.0:1746143775.890757:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622439680 00000100:00100000:3.0:1746143775.890785:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12818 00000100:00100000:3.0:1746143775.890986:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32058:x1830963622439552:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143775.891006:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143775.891007:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12819 00000100:00100000:0.0:1746143775.891015:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+261:32063:x1830963622439680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.891021:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a8846 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aaac expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.891032:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143775.891045:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e03b600/0x87925e4cb73a884d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aab3 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.891125:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a8846 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaac expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.891135:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a8846 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaac expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.891147:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.891149:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143775.891152:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048c00, rc 0) 00010000:00010000:0.0:1746143775.891189:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.891200:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.891209:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143775.891238:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32058:x1830963622439552:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 255us (676us total) trans 0 rc 0/0 00000004:00200000:0.0:1746143775.891241:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:3.0:1746143775.891244:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12818 00000004:00200000:0.0:1746143775.891245:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143775.891260:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143775.891280:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e03b600/0x87925e4cb73a884d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aab3 expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.891294:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aab3 expref: 262 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.891300:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143775.891303:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143775.891305:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ae00, rc 0) 00000100:00100000:0.0:1746143775.891338:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+262:32063:x1830963622439680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 324us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.891347:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12819 00000100:00100000:0.0:1746143775.894664:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.894719:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622439808 00000100:00100000:2.0:1746143775.894727:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622439808 00000100:00100000:2.0:1746143775.894782:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12820 00000100:00100000:2.0:1746143775.894790:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32058:x1830963622439808:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143775.894806:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.894820:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73a885b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aaba expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.894900:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a8862 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143775.894929:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a8862 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143775.894948:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a8862 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143775.894972:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:2.0:1746143775.894976:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143775.894988:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a8862 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143775.894999:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143775.895008:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73a885b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaba expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143775.895014:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143775.895022:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a8862 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaba expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.895029:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.895032:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143775.895035:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:0.0:1746143775.895041:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.895053:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.895069:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32058:x1830963622439808:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 280us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.895070:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.895075:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12820 00000100:00100000:2.0:1746143775.895095:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622439936 00000100:00100000:1.0:1746143775.895096:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622440064 00000100:00100000:2.0:1746143775.895098:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622439936 00000100:00100000:1.0:1746143775.895099:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622440064 00000100:00100000:1.0:1746143775.895121:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622440192 00000100:00100000:1.0:1746143775.895122:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622440192 00000100:00100000:1.0:1746143775.895129:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622440320 00000100:00100000:1.0:1746143775.895129:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622440320 00000100:00100000:1.0:1746143775.895135:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622440448 00000100:00100000:1.0:1746143775.895136:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622440448 00000100:00100000:1.0:1746143775.895143:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11600 00000100:00100000:1.0:1746143775.895147:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622439936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143775.895154:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143775.895162:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a8869 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aac1 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.895164:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11601 00000100:00100000:3.0:1746143775.895171:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622440064:12345-192.168.202.3@tcp:101:cat.0 00002000:00010000:1.0:1746143775.895175:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a1e, atime: 0x68140a1e, ctime: 0x68140a1e, blocks: 0x7d8 00010000:00010000:3.0:1746143775.895180:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143775.895184:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.895186:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.895190:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a8870 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aac8 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.895190:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a8869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac1 expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.895197:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a8869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac1 expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.895202:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635400, rc 0) 00002000:00010000:3.0:1746143775.895203:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a20, atime: 0x68140a1f, ctime: 0x68140a20, blocks: 0x808 00010000:00010000:3.0:1746143775.895212:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.895213:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.895217:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a8870 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac8 expref: 47 pid: 9587 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143775.895217:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622439936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.895220:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11600 00010000:00010000:3.0:1746143775.895227:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a8870 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac8 expref: 47 pid: 9587 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143775.895227:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11602 00000100:00100000:1.0:1746143775.895230:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963622440192:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.895233:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049c00, rc 0) 00010000:00010000:1.0:1746143775.895234:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143775.895239:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a8877 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aacf expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143775.895247:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a20, atime: 0x68140a1d, ctime: 0x68140a20, blocks: 0x800 00000100:00100000:3.0:1746143775.895249:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963622440064:12345-192.168.202.3@tcp:101:cat.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.895255:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11601 00010000:00010000:1.0:1746143775.895255:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.895256:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.895259:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a8877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aacf expref: 48 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143775.895267:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11603 00010000:00010000:1.0:1746143775.895267:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a8877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aacf expref: 47 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143775.895272:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622440320:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143775.895274:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634e00, rc 0) 00010000:00010000:3.0:1746143775.895277:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.895284:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a887e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aad6 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143775.895294:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a1d, atime: 0x68140a1d, ctime: 0x68140a1d, blocks: 0x808 00000100:00100000:1.0:1746143775.895296:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963622440192:12345-192.168.202.3@tcp:101:cat.0 Request processed in 64us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.895300:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11602 00010000:00010000:3.0:1746143775.895302:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.895303:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.895306:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a887e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aad6 expref: 41 pid: 9587 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143775.895310:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11604 00000100:00100000:1.0:1746143775.895315:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622440448:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.895318:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a887e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aad6 expref: 41 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.895321:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.895324:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00010000:00010000:1.0:1746143775.895329:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a8885 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aadd expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143775.895338:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4778304, mtime: 0x68140a20, atime: 0x68140a1f, ctime: 0x68140a20, blocks: 0x1480 00000100:00100000:3.0:1746143775.895342:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622440320:12345-192.168.202.3@tcp:101:cat.0 Request processed in 66us (284us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143775.895346:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143775.895347:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11603 00010000:00010000:1.0:1746143775.895347:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.895351:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a8885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aadd expref: 42 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.895360:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a8885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aadd expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.895367:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634400, rc 0) 00000100:00100000:1.0:1746143775.895386:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622440448:12345-192.168.202.3@tcp:101:cat.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.895391:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11604 00000100:00100000:0.0:1746143775.895993:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.896108:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622440576 00000100:00100000:1.0:1746143775.896112:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622440576 00000100:00100000:1.0:1746143775.896128:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11605 00000100:00100000:1.0:1746143775.896132:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963622440576:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143775.896139:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143775.896146:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a888c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aae4 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143775.896156:0:3135:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a1f, atime: 0x68140a20, ctime: 0x68140a1f, blocks: 0x1008 00010000:00010000:1.0:1746143775.896165:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.896166:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.896170:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a888c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aae4 expref: 48 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.896178:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a888c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aae4 expref: 48 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143775.896184:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634000, rc 0) 00000100:00100000:1.0:1746143775.896202:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963622440576:12345-192.168.202.3@tcp:101:cat.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.896206:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11605 00000100:00100000:0.0:1746143775.897194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.897217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.897239:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622440704 00000100:00100000:0.0:1746143775.897240:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.897244:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622440704 00000100:00100000:0.0:1746143775.897253:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.897280:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.897499:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622440832 00000100:00100000:2.0:1746143775.897503:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622440832 00000100:00100000:2.0:1746143775.897516:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622440960 00000100:00100000:2.0:1746143775.897518:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622440960 00000100:00100000:0.0:1746143775.897524:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.897532:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622441088 00000100:00100000:2.0:1746143775.897533:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622441088 00000100:00100000:2.0:1746143775.897542:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622441216 00000100:00100000:2.0:1746143775.897544:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622441216 00000100:00100000:2.0:1746143775.897552:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622441344 00000100:00100000:2.0:1746143775.897554:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622441344 00000100:00100000:0.0:1746143775.897561:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11606 00000100:00100000:2.0:1746143775.897567:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11607 00000100:00100000:0.0:1746143775.897569:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622440704:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:2.0:1746143775.897572:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622440832:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143775.897579:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143775.897583:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.897587:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73a8893 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aaf2 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.897591:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a889a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aaeb expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.897599:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.897601:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143775.897602:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143775.897604:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.897605:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73a8893 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf2 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.897609:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a889a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaeb expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.897614:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73a8893 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf2 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.897618:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a889a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaeb expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.897622:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096010200, rc 0) 00010000:00010000:0.0:1746143775.897629:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8b400, rc 0) 00000100:00100000:2.0:1746143775.897644:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622440832:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 71us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.897645:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622440704:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 78us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.897649:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11607 00000100:00100000:0.0:1746143775.897652:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11606 00000100:00100000:2.0:1746143775.897661:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11608 00000100:00100000:0.0:1746143775.897665:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11609 00000100:00100000:2.0:1746143775.897666:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622440960:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143775.897670:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622441088:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143775.897671:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143775.897675:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143775.897677:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73a88a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aaf9 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.897682:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a88a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab00 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.897685:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.897686:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.897690:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73a88a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf9 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.897690:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143775.897691:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143775.897695:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a88a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab00 expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.897698:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73a88a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf9 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.897703:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a88a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab00 expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.897704:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096010c00, rc 0) 00010000:00010000:0.0:1746143775.897708:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8be00, rc 0) 00000100:00100000:2.0:1746143775.897715:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622440960:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 49us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.897719:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11608 00000100:00100000:0.0:1746143775.897722:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622441088:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 52us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.897727:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11609 00000100:00100000:2.0:1746143775.897729:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11610 00000100:00100000:2.0:1746143775.897734:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622441216:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143775.897737:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11611 00010000:00010000:2.0:1746143775.897739:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143775.897742:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622441344:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143775.897744:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73a88af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab07 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.897749:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143775.897755:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73a88b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab0e expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.897756:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.897757:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.897761:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73a88af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab07 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.897763:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143775.897764:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.897768:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73a88af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab07 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.897768:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73a88b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab0e expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143775.897773:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31e00, rc 0) 00010000:00010000:0.0:1746143775.897775:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73a88b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab0e expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143775.897781:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8aa00, rc 0) 00000100:00100000:2.0:1746143775.897786:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622441216:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 52us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.897791:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11610 00000100:00100000:0.0:1746143775.897795:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622441344:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 53us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.897800:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11611 00000100:00100000:0.0:1746143775.900430:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.900458:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.900487:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.900500:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.900510:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.900543:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.900564:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622441472 00000100:00100000:3.0:1746143775.900572:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622441472 00000100:00100000:3.0:1746143775.900601:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622441728 00000100:00100000:3.0:1746143775.900603:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622441728 00000100:00100000:1.0:1746143775.900607:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622441984 00000100:00100000:1.0:1746143775.900611:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622441984 00000100:00100000:3.0:1746143775.900612:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622441600 00000100:00100000:3.0:1746143775.900613:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622441600 00000100:00100000:3.0:1746143775.900621:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622441856 00000100:00100000:3.0:1746143775.900623:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622441856 00000100:00100000:1.0:1746143775.900625:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622442112 00000100:00100000:1.0:1746143775.900626:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622442112 00000100:00100000:1.0:1746143775.900637:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11612 00000100:00100000:1.0:1746143775.900643:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622441472:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143775.900675:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11613 00000100:00100000:0.0:1746143775.900682:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622441728:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143775.900712:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11614 00000100:00100000:3.0:1746143775.900717:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622441600:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143775.900717:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622441472:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 74us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.900722:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622441728:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 40us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.900725:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11612 00000100:00100000:0.0:1746143775.900728:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11613 00000100:00100000:1.0:1746143775.900738:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11615 00000100:00100000:0.0:1746143775.900741:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11616 00000100:00100000:1.0:1746143775.900742:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622441984:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143775.900745:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622442112:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143775.900747:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622441600:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.900752:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11614 00000100:00100000:3.0:1746143775.900760:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11617 00000100:00100000:3.0:1746143775.900764:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622441856:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143775.900764:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622441984:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 22us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.900768:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11615 00000100:00100000:0.0:1746143775.900772:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622442112:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143775.900777:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11616 00000100:00100000:3.0:1746143775.900787:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622441856:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 22us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.900792:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11617 00000100:00100000:0.0:1746143775.903029:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.903062:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.903090:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.903101:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.903112:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.903141:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.903202:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622442240 00000100:00100000:2.0:1746143775.903210:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622442240 00000100:00100000:2.0:1746143775.903238:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622442496 00000100:00100000:2.0:1746143775.903240:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622442496 00000100:00100000:2.0:1746143775.903248:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622442752 00000100:00100000:2.0:1746143775.903250:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622442752 00000100:00100000:2.0:1746143775.903258:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622442368 00000100:00100000:2.0:1746143775.903259:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622442368 00000100:00100000:2.0:1746143775.903268:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622442624 00000100:00100000:2.0:1746143775.903269:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622442624 00000100:00100000:2.0:1746143775.903277:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622442880 00000100:00100000:2.0:1746143775.903279:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622442880 00000100:00100000:2.0:1746143775.903291:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11618 00000100:00100000:2.0:1746143775.903297:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622442240:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143775.903377:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622442240:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.903386:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11618 00000100:00100000:2.0:1746143775.903400:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11619 00000100:00100000:2.0:1746143775.903405:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dd46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622442496:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143775.903433:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dd46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622442496:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 28us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.903473:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11620 00000100:00100000:3.0:1746143775.903480:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622442752:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143775.903512:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622442752:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 33us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.903516:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11620 00000100:00100000:3.0:1746143775.903527:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11621 00000100:00100000:3.0:1746143775.903531:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622442368:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143775.903553:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622442368:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 22us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.903557:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11621 00000100:00100000:3.0:1746143775.903565:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11622 00000100:00100000:3.0:1746143775.903569:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622442624:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143775.903591:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622442624:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 21us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.903595:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11622 00000100:00100000:3.0:1746143775.903602:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11623 00000100:00100000:3.0:1746143775.903606:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622442880:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143775.903628:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622442880:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 22us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.903632:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11623 00000100:00100000:2.0:1746143775.904054:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11619 00000100:00100000:0.0:1746143775.905550:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.905598:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622443136 00000100:00100000:1.0:1746143775.905604:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622443136 00002000:00100000:1.0:1746143775.905632:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880090e27480 x1830963622443136/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.905640:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e27480 with x1830963622443136 ext(0->1048575) 00002000:00010000:1.0:1746143775.905644:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e27480 00000100:00100000:1.0:1746143775.905676:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3303 00000100:00100000:1.0:1746143775.905682:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622443136:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143775.906323:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.906673:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622443392 00000100:00100000:2.0:1746143775.906680:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622443392 00000100:00100000:2.0:1746143775.907350:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11624 00000100:00100000:2.0:1746143775.907358:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622443392:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:2.0:1746143775.907499:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143775.907502:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143775.907504:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:2.0:1746143775.907505:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143775.907507:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:2.0:1746143775.907534:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622443392:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 177us (1210us total) trans 17179872958 rc 0/0 00000100:00100000:2.0:1746143775.907540:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11624 00000100:00100000:0.0:1746143775.907670:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.907738:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.907751:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622443648 00000100:00100000:0.0:1746143775.907755:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622443648 00002000:00100000:0.0:1746143775.907774:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880090e25500 x1830963622443648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.907783:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25500 with x1830963622443648 ext(1048576->2097151) 00002000:00010000:0.0:1746143775.907788:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e25500 00000100:00100000:0.0:1746143775.907798:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622443776 00000100:00100000:0.0:1746143775.907799:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622443776 00002000:00100000:0.0:1746143775.907809:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880090e27800 x1830963622443776/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.907818:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e27800 with x1830963622443776 ext(1048576->2097151) 00002000:00010000:0.0:1746143775.907823:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e27800 00000100:00100000:1.0:1746143775.908023:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.908383:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622443904 00000100:00100000:0.0:1746143775.908386:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622443904 00000100:00100000:2.0:1746143775.908391:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3304 00002000:00100000:0.0:1746143775.908398:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012457d180 x1830963622443904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143775.908399:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622443648:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:0.0:1746143775.908404:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457d180 with x1830963622443904 ext(1048576->2097151) 00002000:00010000:0.0:1746143775.908407:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457d180 00000100:00100000:0.0:1746143775.908424:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3305 00000100:00100000:0.0:1746143775.908429:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+49:2009:x1830963622443776:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143775.908994:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3306 00000100:00100000:0.0:1746143775.909002:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+50:2009:x1830963622443904:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143775.914975:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.915417:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622443136:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9733us (9867us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143775.915426:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3303 00002000:00100000:1.0:1746143775.915435:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880090e27480 x1830963622443136/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.915442:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e27480 with x1830963622443136 ext(0->1048575) 00002000:00010000:1.0:1746143775.915447:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e27480 00000100:00100000:3.0:1746143775.915876:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622444160 00000100:00100000:3.0:1746143775.915883:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622444160 00000100:00100000:3.0:1746143775.915908:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11625 00000100:00100000:3.0:1746143775.915964:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622444160:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:3.0:1746143775.916123:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143775.916127:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143775.916128:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143775.916130:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143775.916132:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143775.916152:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622444160:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 188us (1185us total) trans 21474840279 rc 0/0 00000100:00100000:3.0:1746143775.916158:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11625 00000100:00100000:0.0:1746143775.922491:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+50:2009:x1830963622443776:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14052us (14743us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143775.922501:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3305 00002000:00100000:0.0:1746143775.922511:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880090e27800 x1830963622443776/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.922520:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e27800 with x1830963622443776 ext(1048576->2097151) 00002000:00010000:0.0:1746143775.922526:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e27800 00000100:00100000:2.0:1746143775.923868:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622443648:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15467us (16194us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143775.923875:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3304 00002000:00100000:2.0:1746143775.923882:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880090e25500 x1830963622443648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.924152:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25500 with x1830963622443648 ext(1048576->2097151) 00002000:00010000:2.0:1746143775.924156:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e25500 00000100:00100000:0.0:1746143775.924201:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.924574:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622444416 00000100:00100000:2.0:1746143775.924580:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622444416 00000100:00100000:2.0:1746143775.924627:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3307 00000100:00100000:2.0:1746143775.924634:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622444416:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143775.924662:0:29555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73a88bd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.924781:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143775.924785:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.924786:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.924791:0:29555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73a88bd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.924803:0:29555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73a88bd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143775.927206:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963622443904:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18198us (19176us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143775.927218:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3306 00002000:00100000:0.0:1746143775.927229:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012457d180 x1830963622443904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143775.927237:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457d180 with x1830963622443904 ext(1048576->2097151) 00002000:00010000:0.0:1746143775.927242:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457d180 00000100:00100000:0.0:1746143775.927264:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622444672 00000100:00100000:0.0:1746143775.927270:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622444672 00000100:00100000:0.0:1746143775.927301:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3308 00000100:00100000:0.0:1746143775.927307:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622444672:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143775.927331:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73a88c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.927341:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143775.927344:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143775.927348:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73a88c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143775.927358:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73a88c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143775.930039:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.930083:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.930155:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622445056 00000100:00100000:2.0:1746143775.930163:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622445056 00000100:00100000:1.0:1746143775.930163:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622445184 00000100:00100000:2.0:1746143775.930210:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3309 00000100:00100000:2.0:1746143775.930217:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622445056:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143775.930245:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73a88cb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.930257:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.930259:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.930263:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73a88cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.930274:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73a88cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.931003:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622445184 00000100:00100000:1.0:1746143775.931042:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3310 00000100:00100000:1.0:1746143775.931048:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622445184:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143775.931065:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a88d2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.931072:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.931073:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.931076:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a88d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.931084:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a88d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143775.934542:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.934651:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622445440 00000100:00100000:2.0:1746143775.934660:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622445440 00000100:00100000:2.0:1746143775.934727:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3311 00000100:00100000:2.0:1746143775.934734:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622445440:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143775.934764:0:29558:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a88d9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.934776:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.934777:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.934781:0:29558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a88d9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.934793:0:29558:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a88d9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143775.935704:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.936062:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622445696 00000100:00100000:3.0:1746143775.936067:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622445696 00000100:00100000:3.0:1746143775.936107:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3312 00000100:00100000:3.0:1746143775.936113:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622445696:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143775.936133:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a88e0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.936141:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.936142:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143775.936145:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a88e0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.936153:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a88e0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143775.949122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.949163:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143775.949184:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622445952 00000100:00100000:2.0:1746143775.949192:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622445952 00000100:00100000:2.0:1746143775.949229:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622446208 00000100:00100000:2.0:1746143775.949231:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622446208 00000100:00100000:2.0:1746143775.949246:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3313 00000100:00100000:2.0:1746143775.949253:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963622445952:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143775.949282:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a88e7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.949302:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.949303:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143775.949309:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a88e7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.949322:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a88e7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.949332:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73a88c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.949343:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73a88c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.949350:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73a88c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.949356:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143775.949359:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73a88c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.949367:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73a88c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.949381:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73a88c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.949387:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73a88c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.949448:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963622444672:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 22140us (24667us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143775.949454:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3308 00000100:00100000:1.0:1746143775.949476:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3314 00000100:00100000:1.0:1746143775.949482:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622446208:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143775.949500:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880082087c00/0x87925e4cb73a88ee lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.949508:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.949510:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143775.949514:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082087c00/0x87925e4cb73a88ee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.949522:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082087c00/0x87925e4cb73a88ee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.951824:0:29555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73a88bd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.951838:0:29555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73a88bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.951846:0:29555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73a88bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.951852:0:29555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143775.951855:0:29555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73a88bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.951861:0:29555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73a88bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.951875:0:29555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73a88bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.951881:0:29555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73a88bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.951965:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2008:x1830963622444416:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 27328us (27761us total) trans 0 rc 1024000/1024000 00000100:00100000:2.0:1746143775.951974:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3307 00010000:00010000:2.0:1746143775.954119:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73a88cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.954133:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73a88cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.954140:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73a88cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.954146:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ae56000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143775.954149:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73a88cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.954156:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73a88cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.954168:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73a88cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143775.954174:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73a88cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143775.954236:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622445056:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 24016us (24201us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143775.954247:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3309 00010000:00010000:3.0:1746143775.958857:0:29558:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a88d9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.958871:0:29558:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a88d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.958880:0:29558:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a88d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.958886:0:29558:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a53c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143775.958889:0:29558:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a88d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.958896:0:29558:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a88d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.958942:0:29558:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a88d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.958949:0:29558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73a88d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.959013:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622445440:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 24276us (24475us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143775.959021:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3311 00010000:00010000:1.0:1746143775.959083:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a88d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.959092:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a88d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.959098:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a88d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.959102:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7c800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143775.959105:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a88d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.959110:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a88d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.959120:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a88d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.959125:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a88d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.959160:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2008:x1830963622445184:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 28112us (29075us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143775.959166:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3310 00010000:00010000:3.0:1746143775.966315:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a88e0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.966328:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a88e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.966334:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a88e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.966340:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7c200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143775.966343:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a88e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.966349:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a88e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.966364:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a88e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.966369:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a88e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.966697:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622445696:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 30579us (30990us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143775.966706:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3312 00010000:00010000:1.0:1746143775.968451:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880082087c00/0x87925e4cb73a88ee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.968461:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880082087c00/0x87925e4cb73a88ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.968467:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880082087c00/0x87925e4cb73a88ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.968478:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082087c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143775.968481:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880082087c00/0x87925e4cb73a88ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.968488:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880082087c00/0x87925e4cb73a88ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.968499:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880082087c00/0x87925e4cb73a88ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143775.968505:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082087c00/0x87925e4cb73a88ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143775.970083:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622446208:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 20594us (20912us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143775.970092:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3314 00000100:00100000:0.0:1746143775.970574:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.970654:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143775.970706:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622446592 00000100:00100000:1.0:1746143775.970713:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622446592 00002000:00100000:1.0:1746143775.970742:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800938dc700 x1830963622446592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.970750:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc700 with x1830963622446592 ext(2097152->4194303) 00002000:00010000:1.0:1746143775.970754:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dc700 00000100:00100000:1.0:1746143775.970765:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622446720 00000100:00100000:1.0:1746143775.970767:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622446720 00002000:00100000:1.0:1746143775.970775:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8801373ba300 x1830963622446720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/0 e 0 to 0 dl 1746143786 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.970787:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373ba300 with x1830963622446720 ext(2097152->4194303) 00002000:00010000:1.0:1746143775.970789:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373ba300 00000100:00100000:1.0:1746143775.970803:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3315 00000100:00100000:1.0:1746143775.970816:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622446592:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143775.971114:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3316 00000100:00100000:0.0:1746143775.971121:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+48:2008:x1830963622446720:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143775.972239:0:13453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a88e7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.972249:0:13453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a88e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.972256:0:13453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a88e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.972261:0:13453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a53800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143775.972266:0:13453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a88e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.972272:0:13453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a88e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.972287:0:13453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a88e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.972291:0:13453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73a88e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143775.972998:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622445952:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 23742us (23880us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143775.973007:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3313 00000100:00100000:2.0:1746143775.989054:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+48:2008:x1830963622446720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17926us (18392us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143775.989065:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3316 00002000:00100000:2.0:1746143775.989076:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8801373ba300 x1830963622446720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143775.989084:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373ba300 with x1830963622446720 ext(2097152->4194303) 00002000:00010000:2.0:1746143775.989090:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373ba300 00000100:00100000:1.0:1746143775.989210:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.990231:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622446976 00000100:00100000:3.0:1746143775.990238:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622446976 00000100:00100000:3.0:1746143775.990283:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12821 00000100:00100000:3.0:1746143775.990289:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32058:x1830963622446976:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1746143775.990329:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143775.990350:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a8862 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaba expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.990370:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.990374:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143775.990408:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.990418:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aab3 expref: 261 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.990424:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.990447:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aab3 expref: 261 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.990457:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aab3 expref: 261 pid: 14991 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.990468:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626716544:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.990534:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.992464:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.992606:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626716544:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.992624:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143775.992641:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622447232 00000100:00100000:1.0:1746143775.992641:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622446592:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21830us (22065us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143775.992646:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622447232 00000100:00100000:1.0:1746143775.992651:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3315 00002000:00100000:1.0:1746143775.992660:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800938dc700 x1830963622446592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:171/0 lens 488/440 e 0 to 0 dl 1746143786 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143775.992668:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc700 with x1830963622446592 ext(2097152->4194303) 00002000:00010000:1.0:1746143775.992673:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dc700 00000100:00100000:3.0:1746143775.992677:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12822 00000100:00100000:3.0:1746143775.992682:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+262:32065:x1830963622447232:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143775.992695:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.992705:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73a88fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab15 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.992755:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.992764:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.992772:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.992781:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a890a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.992786:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a890a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.992791:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a890a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.992864:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.992872:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa9e expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.992878:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.992896:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa9e expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.992904:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa9e expref: 8 pid: 14991 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143775.992943:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626716672:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143775.992987:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143775.994851:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143775.994885:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.995100:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626716672:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143775.995122:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:2.0:1746143775.995364:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622447488 00000100:00100000:1.0:1746143775.995364:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622447360 00000100:00100000:2.0:1746143775.995369:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622447488 00000100:00100000:1.0:1746143775.995369:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622447360 00010000:00010000:2.0:1746143775.995392:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa9e expref: 9 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.995393:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aab3 expref: 264 pid: 14991 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143775.995423:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5461 00000100:00100000:1.0:1746143775.995428:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5462 00000100:00100000:2.0:1746143775.995429:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622447488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143775.995434:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+264:2010:x1830963622447360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143775.995439:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143775.995441:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143775.995443:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa9e expref: 9 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.995445:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aab3 expref: 264 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.995450:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa9e expref: 9 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.995539:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aab3 expref: 264 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.995557:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8854 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aab3 expref: 264 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143775.995565:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73a87e4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aa9e expref: 9 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143775.995581:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143775.995585:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143775.995593:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143775.995598:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143775.995604:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.995608:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.995611:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.995629:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143775.995658:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+263:2010:x1830963622447360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 223us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143775.995664:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5462 00010000:00010000:1.0:1746143775.995682:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143775.995689:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.995741:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.995746:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143775.995758:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00010000:1.0:1746143775.995795:0:7244:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880092b44700 reply state ffff880096f23000 transno 8589943558 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143775.995801:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.995981:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.995988:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143775.995991:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143775.995997:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143775.995999:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746143775.996001:0:7244:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746143775.996002:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7da00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.996005:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996012:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996021:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.996023:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143775.996025:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996030:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7da00/0x87925e4cb73a8911 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996047:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143775.996055:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32058:x1830963622446976:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 5766us (6845us total) trans 8589943558 rc 0/0 00010000:00010000:3.0:1746143775.996056:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996060:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143775.996060:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12821 00010000:00010000:3.0:1746143775.996064:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996067:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7de00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.996069:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996074:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996079:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143775.996081:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.996084:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996088:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a8903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996095:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a890a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996100:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a890a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996105:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a890a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996108:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7ca00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143775.996110:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a890a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996115:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a890a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996120:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14f00) 00010000:00010000:3.0:1746143775.996122:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143775.996124:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a890a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996127:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a890a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143775.996157:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73a88fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab15 expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.996164:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73a88fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab15 expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.996171:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7dc00, rc 0) 00000100:00100000:3.0:1746143775.996211:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+262:32065:x1830963622447232:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3527us (3749us total) trans 8589943559 rc 301/301 00000100:00100000:3.0:1746143775.996216:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12822 00010000:00010000:2.0:1746143775.996557:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143775.996562:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143775.996582:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622447488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1153us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143775.996589:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5461 00000100:00100000:0.0:1746143775.998516:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143775.998589:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622447616 00000100:00100000:3.0:1746143775.998595:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622447616 00000100:00100000:3.0:1746143775.998634:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12823 00000100:00100000:3.0:1746143775.998639:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+262:32063:x1830963622447616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143775.998652:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143775.998663:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73a891f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab1c expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.998698:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73a891f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab1c expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.998708:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73a891f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab1c expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143775.998720:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143775.998722:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143775.998725:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d200, rc 0) 00000100:00100000:3.0:1746143775.998752:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+263:32063:x1830963622447616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 112us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143775.998757:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12823 00000100:00100000:0.0:1746143776.002567:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.002609:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.002639:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.002654:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.002683:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.002709:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.002823:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622447744 00000100:00100000:2.0:1746143776.002832:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622447744 00000100:00100000:2.0:1746143776.002867:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622448000 00000100:00100000:2.0:1746143776.002870:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622448000 00000100:00100000:2.0:1746143776.002879:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622448256 00000100:00100000:2.0:1746143776.002881:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622448256 00000100:00100000:2.0:1746143776.002889:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622447872 00000100:00100000:2.0:1746143776.002890:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622447872 00000100:00100000:2.0:1746143776.002897:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622448128 00000100:00100000:2.0:1746143776.002899:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622448128 00000100:00100000:2.0:1746143776.002909:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622448384 00000100:00100000:2.0:1746143776.002929:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622448384 00000100:00100000:2.0:1746143776.002954:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11626 00000100:00100000:2.0:1746143776.002961:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622447744:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143776.003083:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143776.003086:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143774 -> 1746143776 00002000:00010000:2.0:1746143776.003088:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143774 -> 1746143776 00002000:00010000:2.0:1746143776.003090:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143774 -> 1746143776 00002000:00010000:2.0:1746143776.003092:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:2.0:1746143776.003129:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622447744:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 167us (568us total) trans 21474840280 rc 0/0 00000100:00100000:2.0:1746143776.003135:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11626 00000100:00100000:2.0:1746143776.003149:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11627 00000100:00100000:2.0:1746143776.003153:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622448000:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143776.003210:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143776.003212:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143776 -> 1746143776 00002000:00010000:2.0:1746143776.003214:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143773 -> 1746143776 00002000:00010000:2.0:1746143776.003215:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143776 -> 1746143776 00002000:00010000:2.0:1746143776.003217:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746143776.003232:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622448000:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 78us (623us total) trans 17179872959 rc 0/0 00000100:00100000:2.0:1746143776.003236:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11627 00000100:00100000:2.0:1746143776.003245:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11628 00000100:00100000:2.0:1746143776.003250:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622448256:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143776.003287:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4778304 -> 4778304 00002000:00010000:2.0:1746143776.003289:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143776 -> 1746143776 00002000:00010000:2.0:1746143776.003290:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143775 -> 1746143776 00002000:00010000:2.0:1746143776.003292:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143776 -> 1746143776 00002000:00010000:2.0:1746143776.003293:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5248 -> 5248 00000100:00100000:2.0:1746143776.003308:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622448256:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 57us (668us total) trans 21474840281 rc 0/0 00000100:00100000:2.0:1746143776.003313:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11628 00000100:00100000:2.0:1746143776.003321:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11629 00000100:00100000:2.0:1746143776.003326:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622447872:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143776.003366:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143776.003368:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143776 -> 1746143776 00002000:00010000:2.0:1746143776.003369:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143775 -> 1746143776 00002000:00010000:2.0:1746143776.003371:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143776 -> 1746143776 00002000:00010000:2.0:1746143776.003373:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143776.003388:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622447872:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 61us (733us total) trans 17179872960 rc 0/0 00000100:00100000:2.0:1746143776.003392:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11629 00000100:00100000:2.0:1746143776.003401:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11630 00000100:00100000:2.0:1746143776.003405:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622448128:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143776.003439:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143776.003442:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143773 -> 1746143776 00002000:00010000:2.0:1746143776.003443:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143773 -> 1746143776 00002000:00010000:2.0:1746143776.003445:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143773 -> 1746143776 00002000:00010000:2.0:1746143776.003446:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143776.003461:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622448128:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 55us (778us total) trans 21474840282 rc 0/0 00000100:00100000:2.0:1746143776.003465:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11630 00000100:00100000:2.0:1746143776.003473:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11631 00000100:00100000:2.0:1746143776.003478:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622448384:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143776.003511:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143776.003513:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143775 -> 1746143776 00002000:00010000:2.0:1746143776.003515:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143776 -> 1746143776 00002000:00010000:2.0:1746143776.003516:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143775 -> 1746143776 00002000:00010000:2.0:1746143776.003518:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746143776.003532:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622448384:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 54us (822us total) trans 17179872961 rc 0/0 00000100:00100000:2.0:1746143776.003536:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11631 00000100:00100000:0.0:1746143776.007377:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.007424:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622448640 00000100:00100000:1.0:1746143776.007432:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622448640 00002000:00100000:1.0:1746143776.007477:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880082ed7480 x1830963622448640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.007487:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed7480 with x1830963622448640 ext(4194304->4780031) 00002000:00010000:1.0:1746143776.007493:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed7480 00000100:00100000:1.0:1746143776.007545:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3317 00000100:00100000:1.0:1746143776.007555:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622448640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143776.012496:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.013372:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622448896 00000100:00100000:2.0:1746143776.013384:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622448896 00000100:00100000:2.0:1746143776.013466:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4682 00000100:00100000:2.0:1746143776.013477:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32058:x1830963622448896:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143776.014274:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622448640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6717us (6901us total) trans 0 rc 585728/585728 00000100:00100000:1.0:1746143776.014283:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3317 00002000:00100000:1.0:1746143776.014293:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880082ed7480 x1830963622448640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.014301:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed7480 with x1830963622448640 ext(4194304->4780031) 00002000:00010000:1.0:1746143776.014307:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880082ed7480 00000100:00080000:0.0:1746143776.014399:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143776.015336:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32058:x1830963622448896:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 1859us (2847us total) trans 8589943560 rc 0/0 00000100:00100000:2.0:1746143776.015345:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4682 00000100:00100000:0.0:1746143776.023905:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.024064:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622449152 00000100:00100000:2.0:1746143776.024073:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622449152 00000100:00100000:2.0:1746143776.024117:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4683 00000100:00100000:2.0:1746143776.024124:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32058:x1830963622449152:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1746143776.024291:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32058:x1830963622449152:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 167us (392us total) trans 8589943561 rc 0/0 00000100:00100000:2.0:1746143776.024298:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4683 00000100:00100000:1.0:1746143776.025084:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.025196:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622449408 00000100:00100000:2.0:1746143776.025200:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622449408 00000100:00100000:2.0:1746143776.025219:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4684 00000100:00100000:2.0:1746143776.025224:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:32063:x1830963622449408:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143776.025313:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+264:32063:x1830963622449408:12345-192.168.202.3@tcp:35:cat.0 Request processed in 88us (231us total) trans 8589943562 rc 0/0 00000100:00100000:2.0:1746143776.025319:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4684 00000100:00100000:0.0:1746143776.041254:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.041351:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622449664 00000100:00100000:1.0:1746143776.041359:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622449664 00000100:00100000:3.0:1746143776.041617:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12824 00000100:00100000:3.0:1746143776.041627:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+264:32065:x1830963622449664:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143776.041652:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.041655:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1746143776.041963:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.042005:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622449920 00000100:00100000:1.0:1746143776.042009:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622449920 00000100:00100000:1.0:1746143776.042028:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12825 00000100:00100000:1.0:1746143776.042033:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:32070:x1830963622449920:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.042034:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73a891f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab1c expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.042042:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.042049:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143776.042052:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a8926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab2a expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.042053:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143776.042057:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a892d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab23 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.042090:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143776.042099:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.042103:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a8846 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaac expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.042105:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.042109:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143776.042112:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042121:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a8942 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042125:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a8942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.042130:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a8846 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaac expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.042130:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a8942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.042138:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a8846 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaac expref: 10 pid: 7244 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143776.042147:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626716800:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.042200:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8949 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042209:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8949 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042214:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8949 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143776.042221:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00000004:00200000:1.0:1746143776.042221:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143776.042279:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8949 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042285:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8949 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042291:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8949 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042296:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d428600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143776.042303:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8949 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042309:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8949 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042315:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143776.042318:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1746143776.042320:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8949 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042324:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8949 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042346:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042355:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042359:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042364:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042368:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d429e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143776.042370:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042375:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042380:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143776.042382:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143776.042385:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042389:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73a893b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042395:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a8942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042399:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a8942 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042403:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a8942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042406:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d429a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143776.042409:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a8942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042413:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a8942 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042417:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e030200) 00010000:00010000:1.0:1746143776.042418:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143776.042420:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a8942 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042423:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73a8942 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.042447:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a8926 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab2a expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.042452:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a8926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab2a expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.042458:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428000, rc 0) 00000100:00100000:1.0:1746143776.042490:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32070:x1830963622449920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 457us (527us total) trans 8589943563 rc 301/301 00000100:00100000:1.0:1746143776.042496:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12825 00000100:00100000:0.0:1746143776.044140:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.044257:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622450048 00000100:00100000:2.0:1746143776.044264:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622450048 00010000:00010000:2.0:1746143776.044288:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a8846 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaac expref: 11 pid: 7244 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143776.044325:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626716800:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.044325:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5463 00000100:00100000:2.0:1746143776.044332:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622450048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143776.044342:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143776.044342:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143776.044346:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a8846 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaac expref: 11 pid: 7244 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.044355:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a8846 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaac expref: 11 pid: 7244 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.044373:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73a8846 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaac expref: 11 pid: 7244 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.044384:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.044387:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143776.044394:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143776.044399:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143776.044415:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143776.044437:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622450048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.044442:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5463 00010000:00010000:3.0:1746143776.044611:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.044618:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000040:00080000:3.0:1746143776.044827:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2626, 88 off218800 00000004:00080000:3.0:1746143776.044833:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835268920973ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143776.045277:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2593, 88 off216248 00000004:00080000:3.0:1746143776.045283:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835269370885ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143776.045619:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2594, 88 off216336 00000004:00080000:3.0:1746143776.045624:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835269711317ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143776.045631:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2627, 88 off218888 00000004:00080000:3.0:1746143776.045633:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835269721317ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143776.045749:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2628, 88 off218976 00000004:00080000:3.0:1746143776.045753:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835269841075ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143776.045760:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2595, 88 off216424 00000004:00080000:3.0:1746143776.045762:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835269850138ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143776.045770:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2596, 88 off216512 00000004:00080000:3.0:1746143776.045772:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835269860118ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143776.045779:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2597, 88 off216600 00000004:00080000:3.0:1746143776.045781:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835269868782ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143776.045789:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2629, 88 off219064 00000004:00080000:3.0:1746143776.045791:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835269879075ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143776.045798:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2598, 88 off216688 00000004:00080000:3.0:1746143776.045799:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835269887500ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143776.045805:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2630, 88 off219152 00000004:00080000:3.0:1746143776.045807:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835269895233ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143776.045813:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2599, 88 off216776 00000004:00080000:3.0:1746143776.045814:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835269902487ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143776.045820:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2631, 88 off219240 00000004:00080000:3.0:1746143776.045822:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835269910293ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143776.045828:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2632, 88 off219328 00000004:00080000:3.0:1746143776.045830:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835269917830ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143776.045837:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2633, 88 off219416 00000004:00080000:3.0:1746143776.045839:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835269926692ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143776.045845:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2634, 88 off219504 00000004:00080000:3.0:1746143776.045849:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 835269937365ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143776.045857:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2600, 88 off216864 00000004:00080000:3.0:1746143776.045860:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835269947587ns, next at 770855090093ns, rc = 0 00000100:00100000:0.0:1746143776.046771:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.046953:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622450176 00000100:00100000:1.0:1746143776.046961:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622450176 00000100:00100000:1.0:1746143776.046992:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12826 00000100:00100000:1.0:1746143776.046998:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32070:x1830963622450176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143776.047016:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.047029:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a8957 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab31 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.047087:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.047095:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143776.047100:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.047111:0:7244:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143776.047119:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000001:00080000:2.0:1746143776.050611:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943564 is committed 00000004:00080000:2.0:1746143776.050622:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1830 committed 00000004:00080000:2.0:1746143776.050639:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1862 committed 00000004:00080000:2.0:1746143776.050653:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1861 committed 00000004:00080000:2.0:1746143776.050656:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1860 committed 00000004:00080000:2.0:1746143776.050658:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1859 committed 00000004:00080000:2.0:1746143776.050659:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1829 committed 00000004:00080000:2.0:1746143776.050661:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1858 committed 00000004:00080000:2.0:1746143776.050662:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1828 committed 00000004:00080000:2.0:1746143776.050664:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1857 committed 00000004:00080000:2.0:1746143776.050665:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1827 committed 00000004:00080000:2.0:1746143776.050666:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1826 committed 00000004:00080000:2.0:1746143776.050668:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1825 committed 00000004:00080000:2.0:1746143776.050669:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1856 committed 00000004:00080000:2.0:1746143776.050670:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1855 committed 00000004:00080000:2.0:1746143776.050671:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1824 committed 00000004:00080000:2.0:1746143776.050673:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1823 committed 00000004:00080000:2.0:1746143776.050674:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1854 committed 00000001:00080000:2.0:1746143776.050679:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943563 is committed 00000001:00080000:2.0:1746143776.050693:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943561 is committed 00010000:00010000:2.0:1746143776.050719:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.050729:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.050734:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.050739:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7c200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.050742:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.050748:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.050761:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.050764:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.050766:0:3757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.050775:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.050780:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a88f5 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143776.050954:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626717312:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746143776.050998:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab23 expref: 262 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.051007:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.051010:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1746143776.051011:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143776.051012:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.051019:0:14991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.051023:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143776.051032:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626717824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143776.051044:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143776.051047:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d800/0x87925e4cb73a892d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab23 expref: 262 pid: 14991 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1746143776.051053:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626718336:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143776.051058:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab23 expref: 261 pid: 14991 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.051065:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143776.051076:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626718848:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143776.051079:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d400, rc 0) 00000100:00100000:1.0:1746143776.051086:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143776.051095:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746143776.051099:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626716928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143776.051112:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143776.051123:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+261:32065:x1830963622449664:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9495us (9875us total) trans 8589943564 rc 0/0 00000100:00100000:3.0:1746143776.051130:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12824 00010000:00010000:2.0:1746143776.051149:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143776.051155:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626717312 00010000:00010000:2.0:1746143776.051155:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143776.051161:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626717312 00000004:00200000:2.0:1746143776.051187:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:3.0:1746143776.051188:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626717824 00000100:00100000:3.0:1746143776.051189:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626717824 00000004:00200000:2.0:1746143776.051192:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1746143776.051198:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626718336 00000100:00100000:3.0:1746143776.051200:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626718336 00000004:00010000:2.0:1746143776.051207:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143776.051212:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626718848 00000100:00100000:3.0:1746143776.051213:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626718848 00000100:00100000:3.0:1746143776.051221:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626716928 00000100:00100000:3.0:1746143776.051223:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626716928 00010000:00010000:2.0:1746143776.051230:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a8957 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab31 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.051241:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab31 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143776.051242:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11632 00010000:00010000:2.0:1746143776.051246:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00000100:00100000:3.0:1746143776.051248:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3771:x1830963626717312:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143776.051248:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746143776.051249:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d600, rc 0) 00000100:00100000:2.0:1746143776.051264:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11633 00000100:00100000:2.0:1746143776.051271:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3771:x1830963626717824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143776.051348:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143776.051350:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143776 -> 1746143776 00002000:00010000:3.0:1746143776.051352:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143776 -> 1746143776 00002000:00010000:3.0:1746143776.051354:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143776 -> 1746143776 00002000:00010000:3.0:1746143776.051355:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143776.051358:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626717056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143776.051526:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3771:x1830963626717824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 256us (479us total) trans 17179872962 rc 0/0 00000100:00100000:2.0:1746143776.051532:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11633 00000100:00100000:2.0:1746143776.051544:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11634 00000100:00100000:2.0:1746143776.051549:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3771:x1830963626718336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143776.051615:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3771:x1830963626718336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (549us total) trans 21474840283 rc 0/0 00000100:00100000:2.0:1746143776.051620:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11634 00000100:00100000:2.0:1746143776.051628:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11635 00000100:00100000:2.0:1746143776.051632:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3771:x1830963626718848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143776.051679:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3771:x1830963626718848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (591us total) trans 21474840284 rc 0/0 00000100:00100000:2.0:1746143776.051684:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11635 00000100:00100000:2.0:1746143776.051692:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11636 00000100:00100000:2.0:1746143776.051696:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3771:x1830963626716928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143776.051730:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143776.051733:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143776 -> 1746143776 00002000:00010000:2.0:1746143776.051735:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143776 -> 1746143776 00002000:00010000:2.0:1746143776.051736:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143776 -> 1746143776 00002000:00010000:2.0:1746143776.051738:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143776.051754:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3771:x1830963626716928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (641us total) trans 17179872964 rc 0/0 00000100:00100000:2.0:1746143776.051759:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11636 00000100:00100000:2.0:1746143776.051777:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32070:x1830963622450176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4779us (5009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.051782:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12826 00000100:00100000:3.0:1746143776.051860:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3771:x1830963626717312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 610us (847us total) trans 17179872963 rc 0/0 00000100:00100000:3.0:1746143776.051866:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11632 00000100:00080000:3.0:1746143776.051881:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143776.051883:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143776.051941:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143776.051955:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626717568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143776.051974:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143776.051986:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626718080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143776.051997:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143776.052003:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626718592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143776.052012:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143776.052022:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746143776.052026:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626717184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143776.052041:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143776.052048:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626717696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143776.052058:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143776.052064:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626718208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143776.052073:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143776.052080:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626718720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143776.052089:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143776.052105:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626717056 00000100:00100000:0.0:1746143776.052108:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626717056 00000100:00100000:0.0:1746143776.052119:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626717568 00000100:00100000:0.0:1746143776.052121:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626717568 00000100:00100000:0.0:1746143776.052125:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626718080 00000100:00100000:0.0:1746143776.052127:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626718080 00000100:00100000:0.0:1746143776.052131:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626718592 00000100:00100000:0.0:1746143776.052132:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626718592 00000100:00100000:0.0:1746143776.052136:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626717184 00000100:00100000:0.0:1746143776.052137:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626717184 00000100:00100000:0.0:1746143776.052141:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626717696 00000100:00100000:0.0:1746143776.052142:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626717696 00000100:00100000:0.0:1746143776.052146:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626718208 00000100:00100000:0.0:1746143776.052147:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626718208 00000100:00100000:0.0:1746143776.052151:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626718720 00000100:00100000:0.0:1746143776.052152:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626718720 00000100:00100000:0.0:1746143776.052157:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11637 00000100:00100000:0.0:1746143776.052160:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3773:x1830963626717056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143776.052199:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143776.052201:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143776 -> 1746143776 00002000:00010000:0.0:1746143776.052203:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143776 -> 1746143776 00002000:00010000:0.0:1746143776.052205:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143776 -> 1746143776 00002000:00010000:0.0:1746143776.052207:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:0.0:1746143776.052223:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963626717056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (290us total) trans 21474840285 rc 0/0 00000100:00100000:0.0:1746143776.052227:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11637 00000100:00100000:0.0:1746143776.052234:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11638 00000100:00100000:0.0:1746143776.052238:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3773:x1830963626717568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143776.052265:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143776.052267:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143776 -> 1746143776 00002000:00010000:0.0:1746143776.052268:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143776 -> 1746143776 00002000:00010000:0.0:1746143776.052270:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143776 -> 1746143776 00002000:00010000:0.0:1746143776.052271:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143776.052283:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963626717568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (309us total) trans 21474840286 rc 0/0 00000100:00100000:0.0:1746143776.052286:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11638 00000100:00100000:0.0:1746143776.052292:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11639 00000100:00100000:0.0:1746143776.052295:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3773:x1830963626718080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143776.052329:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963626718080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 33us (331us total) trans 17179872965 rc 0/0 00000100:00100000:0.0:1746143776.052333:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11639 00000100:00100000:0.0:1746143776.052339:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11640 00000100:00100000:0.0:1746143776.052342:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3773:x1830963626718592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143776.052378:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963626718592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 35us (364us total) trans 21474840287 rc 0/0 00000100:00100000:0.0:1746143776.052382:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11640 00000100:00100000:0.0:1746143776.052391:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11641 00000100:00100000:0.0:1746143776.052395:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3773:x1830963626717184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143776.052428:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143776.052430:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143776 -> 1746143776 00002000:00010000:0.0:1746143776.052431:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143776 -> 1746143776 00002000:00010000:0.0:1746143776.052433:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143776 -> 1746143776 00002000:00010000:0.0:1746143776.052434:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746143776.052449:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963626717184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (406us total) trans 17179872966 rc 0/0 00000100:00100000:0.0:1746143776.052453:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11641 00000100:00100000:0.0:1746143776.052461:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11642 00000100:00100000:0.0:1746143776.052465:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3773:x1830963626717696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143776.052499:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143776.052501:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143776.052502:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143776.052504:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143776.052505:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746143776.052521:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963626717696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (461us total) trans 17179872967 rc 0/0 00000100:00100000:0.0:1746143776.052525:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11642 00000100:00100000:0.0:1746143776.052533:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11643 00000100:00100000:0.0:1746143776.052537:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3773:x1830963626718208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143776.052543:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11644 00000100:00100000:3.0:1746143776.052549:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3773:x1830963626718720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143776.052581:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963626718208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (505us total) trans 21474840288 rc 0/0 00000100:00100000:0.0:1746143776.052586:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11643 00002000:00010000:3.0:1746143776.052592:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143776.052594:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143776.052596:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143776.052597:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143776.052599:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000004:00080000:0.0:1746143776.052611:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b47480/2, rc 0, transno 17179872966 00000100:00100000:0.0:1746143776.052616:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626717184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143776.052622:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963626718720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (531us total) trans 21474840289 rc 0/0 00000004:00080000:0.0:1746143776.052622:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d9500/2, rc 0, transno 17179872967 00000100:00100000:0.0:1746143776.052625:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626717696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143776.052626:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11644 00000004:00080000:0.0:1746143776.052630:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b23480/2, rc 0, transno 21474840288 00000100:00100000:0.0:1746143776.052641:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626718208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143776.052647:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b23b80/2, rc 0, transno 21474840289 00000100:00100000:0.0:1746143776.052649:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626718720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143776.052655:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b22a00/2, rc 0, transno 21474840285 00000100:00100000:0.0:1746143776.052657:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626717056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143776.052665:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b21500/2, rc 0, transno 21474840286 00000100:00100000:0.0:1746143776.052668:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626717568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143776.052673:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ef1880/2, rc 0, transno 17179872965 00000100:00100000:0.0:1746143776.052675:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626718080:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143776.052680:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b20380/2, rc 0, transno 21474840287 00000100:00100000:0.0:1746143776.052683:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626718592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143776.052713:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626718976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143776.052730:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143776.053076:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b46300/2, rc 0, transno 17179872964 00000100:00100000:1.0:1746143776.053080:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626716928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143776.053085:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626717440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143776.053102:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143776.053113:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626717952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143776.053127:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143776.053136:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626718464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143776.053148:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143776.053160:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626718976 00000004:00080000:1.0:1746143776.053161:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b21f80/2, rc 0, transno 21474840284 00000100:00100000:3.0:1746143776.053164:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626718976 00000100:00100000:1.0:1746143776.053164:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626718848:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143776.053170:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b44e00/2, rc 0, transno 17179872963 00000100:00100000:1.0:1746143776.053172:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626717312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143776.053178:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626717440 00000004:00080000:1.0:1746143776.053178:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1dbb80/2, rc 0, transno 17179872962 00000100:00100000:3.0:1746143776.053179:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626717440 00000100:00100000:1.0:1746143776.053180:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626717824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143776.053185:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626717952 00000004:00080000:1.0:1746143776.053185:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b23800/2, rc 0, transno 21474840283 00000100:00100000:3.0:1746143776.053186:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626717952 00000100:00100000:1.0:1746143776.053187:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626718336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143776.053191:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626718464 00000100:00100000:3.0:1746143776.053192:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626718464 00000100:00100000:3.0:1746143776.053199:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11645 00000100:00100000:1.0:1746143776.053203:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11646 00000100:00100000:3.0:1746143776.053204:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963626718976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143776.053208:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963626717440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143776.053251:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143776.053254:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143776.053255:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:1.0:1746143776.053257:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143776.053258:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143776.053274:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3772:x1830963626718976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (542us total) trans 21474840290 rc 0/0 00000100:00100000:3.0:1746143776.053279:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11645 00000100:00100000:1.0:1746143776.053282:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963626717440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (178us total) trans 17179872968 rc 0/0 00000100:00100000:3.0:1746143776.053289:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11647 00000100:00100000:3.0:1746143776.053293:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3771:x1830963626717952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143776.053329:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4778304 -> 4778304 00002000:00010000:3.0:1746143776.053336:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143776 -> 1746143776 00002000:00010000:3.0:1746143776.053338:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143776 -> 1746143776 00002000:00010000:3.0:1746143776.053339:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143776 -> 1746143776 00002000:00010000:3.0:1746143776.053341:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5248 -> 5248 00000100:00100000:3.0:1746143776.053359:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3771:x1830963626717952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (231us total) trans 21474840291 rc 0/0 00000100:00100000:1.0:1746143776.053486:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11646 00000100:00100000:1.0:1746143776.053498:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11648 00000100:00100000:1.0:1746143776.053503:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963626718464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143776.053554:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963626718464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (405us total) trans 17179872969 rc 0/0 00000100:00100000:1.0:1746143776.053559:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11648 00000004:00080000:1.0:1746143776.053588:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d9180/2, rc 0, transno 17179872968 00000100:00100000:1.0:1746143776.053591:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626717440:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143776.053598:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b22300/2, rc 0, transno 21474840291 00000100:00100000:1.0:1746143776.053600:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626717952:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143776.053604:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ef1c00/2, rc 0, transno 17179872969 00000100:00100000:1.0:1746143776.053606:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626718464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143776.055172:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11647 00000004:00080000:0.0:1746143776.055572:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7ab100/2, rc 0, transno 21474840290 00000100:00100000:0.0:1746143776.055578:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626718976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143776.057230:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.057290:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622450304 00000100:00100000:3.0:1746143776.057297:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622450304 00000100:00100000:3.0:1746143776.057345:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12827 00000100:00100000:3.0:1746143776.057352:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32070:x1830963622450304:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.057368:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.057383:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a8965 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab38 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.057428:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a8965 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab38 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.057439:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a8965 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab38 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.057453:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.057456:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143776.057459:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e200, rc 0) 00000100:00100000:3.0:1746143776.057503:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32070:x1830963622450304:12345-192.168.202.3@tcp:101:cat.0 Request processed in 151us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.057508:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12827 00000100:00100000:2.0:1746143776.060989:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.061020:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.061037:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.061047:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.061056:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622450688 00000100:00100000:2.0:1746143776.061057:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.061064:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622450688 00000100:00100000:2.0:1746143776.061070:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622450944 00000100:00100000:2.0:1746143776.061073:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622450944 00000100:00100000:3.0:1746143776.061094:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622451200 00000100:00100000:3.0:1746143776.061096:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622451200 00000100:00100000:2.0:1746143776.061096:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622450816 00000100:00100000:2.0:1746143776.061098:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622450816 00000100:00100000:3.0:1746143776.061106:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622451072 00000100:00100000:3.0:1746143776.061108:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622451072 00000100:00100000:0.0:1746143776.061251:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.061268:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.061470:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622451328 00000100:00100000:2.0:1746143776.061474:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622451328 00000100:00100000:3.0:1746143776.061477:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11649 00000100:00100000:3.0:1746143776.061484:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622450688:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.061498:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143776.061503:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11650 00000100:00100000:2.0:1746143776.061508:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622450944:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.061512:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a896c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab46 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.061515:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.061524:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4fbb000/0x87925e4cb73a8973 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab54 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.061528:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.061530:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.061535:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.061536:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.061538:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a896c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab46 expref: 30 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.061540:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4fbb000/0x87925e4cb73a8973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab54 expref: 28 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.061549:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a896c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab46 expref: 30 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.061550:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4fbb000/0x87925e4cb73a8973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab54 expref: 28 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.061557:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00010000:00010000:2.0:1746143776.061557:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4fbb000, rc 0) 00000100:00100000:3.0:1746143776.061587:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622450688:12345-192.168.202.3@tcp:101:cat.0 Request processed in 104us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.061592:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11649 00000100:00100000:3.0:1746143776.061604:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11651 00000100:00100000:3.0:1746143776.061608:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622451200:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143776.061609:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11652 00010000:00010000:3.0:1746143776.061612:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.061616:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a897a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab62 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143776.061616:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622450816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143776.061622:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.061623:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.061624:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.061627:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a897a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab62 expref: 30 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143776.061628:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a8981 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab4d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.061634:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a897a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab62 expref: 30 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143776.061636:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.061638:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.061640:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ec00, rc 0) 00010000:00010000:0.0:1746143776.061641:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a8981 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab4d expref: 29 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143776.061649:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a8981 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab4d expref: 29 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143776.061655:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086200, rc 0) 00000100:00100000:1.0:1746143776.061687:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11653 00000100:00100000:1.0:1746143776.061694:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622451072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143776.061699:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.061705:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a8988 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab5b expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.061714:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.061715:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.061719:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a8988 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab5b expref: 31 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.061727:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a8988 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab5b expref: 31 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.061736:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7cc00, rc 0) 00000100:00100000:2.0:1746143776.061776:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622450944:12345-192.168.202.3@tcp:101:cat.0 Request processed in 267us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.061780:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622451200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 172us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.061781:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11650 00000100:00100000:3.0:1746143776.061787:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11651 00000100:00100000:2.0:1746143776.061792:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11654 00000100:00100000:2.0:1746143776.061797:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622451328:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143776.061803:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143776.061809:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622450560 00010000:00010000:2.0:1746143776.061809:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a898f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab69 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143776.061811:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622450560 00010000:00010000:2.0:1746143776.061817:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.061819:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.061823:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a898f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab69 expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.061830:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a898f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab69 expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143776.061831:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12828 00000100:00100000:3.0:1746143776.061836:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32072:x1830963622450560:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143776.061836:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2c00, rc 0) 00010000:00010000:3.0:1746143776.061844:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143776.061850:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622451328:12345-192.168.202.3@tcp:101:cat.0 Request processed in 53us (580us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143776.061854:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a8996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab3f expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143776.061855:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11654 00010000:00010000:3.0:1746143776.061908:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.061940:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.061949:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.061959:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097338000/0x87925e4cb73a89a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.061964:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097338000/0x87925e4cb73a89a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.061969:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097338000/0x87925e4cb73a89a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062052:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062059:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062065:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143776.062072:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:0.0:1746143776.062112:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622450816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 496us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143776.062117:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11652 00010000:00010000:3.0:1746143776.062135:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062140:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062144:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062149:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062153:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096fcf200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143776.062156:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062161:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062168:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143776.062171:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143776.062174:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143776.062177:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622451072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 484us (1118us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143776.062178:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096fcf200/0x87925e4cb73a899d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143776.062183:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11653 00010000:00010000:3.0:1746143776.062187:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097338000/0x87925e4cb73a89a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062196:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097338000/0x87925e4cb73a89a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062200:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097338000/0x87925e4cb73a89a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062204:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097338000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143776.062206:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097338000/0x87925e4cb73a89a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062211:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097338000/0x87925e4cb73a89a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062215:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14100) 00010000:00010000:3.0:1746143776.062217:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143776.062219:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097338000/0x87925e4cb73a89a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062222:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097338000/0x87925e4cb73a89a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.062251:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a8996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab3f expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.062260:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab3f expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.062266:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.062268:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143776.062270:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e0de00, rc 0) 00000100:00100000:3.0:1746143776.062303:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32072:x1830963622450560:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 466us (1052us total) trans 8589943565 rc 0/0 00000100:00100000:3.0:1746143776.062310:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12828 00000100:00100000:0.0:1746143776.073432:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.073963:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622451456 00000100:00100000:1.0:1746143776.073971:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622451456 00000100:00100000:1.0:1746143776.074019:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11655 00000100:00100000:1.0:1746143776.074026:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+41:32065:x1830963622451456:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143776.074042:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.074058:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab70 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.074080:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a8885 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aadd expref: 42 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.074088:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a897a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab62 expref: 29 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.074095:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73a88af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab07 expref: 12 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.074101:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.074102:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.074105:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2969600->3145727] (req 2969600->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 42 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.074133:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73a88af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab07 expref: 12 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.074143:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73a88af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab07 expref: 12 pid: 3134 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.074152:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626719104:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.074236:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a897a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab62 expref: 29 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.074244:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a897a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab62 expref: 29 pid: 1947 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.074251:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626719232:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.074274:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a8885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aadd expref: 42 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.074282:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a8885 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aadd expref: 42 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.074288:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626719360:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.074301:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.075991:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626719104:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.076007:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626719232:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.076015:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626719360:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.076040:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2969600->3145727] (req 2969600->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 42 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.076053:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e600, rc 0) 00000100:00100000:1.0:1746143776.076092:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+42:32065:x1830963622451456:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2063us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.076099:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11655 00000100:00100000:0.0:1746143776.076877:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.076979:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.077032:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622451712 00000100:00100000:2.0:1746143776.077038:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622451712 00000100:00100000:0.0:1746143776.077041:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143776.077059:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a8885 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aadd expref: 42 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746143776.077061:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622451840 00000100:00100000:3.0:1746143776.077065:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622451840 00000100:00100000:2.0:1746143776.077077:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622451584 00000100:00100000:2.0:1746143776.077078:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622451584 00010000:00010000:3.0:1746143776.077080:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a897a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab62 expref: 30 pid: 1947 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143776.077086:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73a88af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab07 expref: 13 pid: 3134 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746143776.077099:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5464 00000100:00100000:2.0:1746143776.077103:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5465 00000100:00100000:3.0:1746143776.077104:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622451712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143776.077108:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622451840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143776.077114:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143776.077114:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143776.077127:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a897a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab62 expref: 30 pid: 1947 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.077128:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a8885 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aadd expref: 42 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143776.077135:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a897a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab62 expref: 30 pid: 1947 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.077335:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a8885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aadd expref: 42 pid: 1945 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143776.077353:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73a897a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab62 expref: 30 pid: 1947 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.077360:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a8885 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aadd expref: 42 pid: 1945 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.077369:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5466 00010000:00010000:3.0:1746143776.077371:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143776.077374:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143776.077394:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622451712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 289us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.077394:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2010:x1830963622451840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 286us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.077778:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5464 00000100:00100000:1.0:1746143776.077782:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622451584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.077792:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.077804:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73a88af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab07 expref: 13 pid: 3134 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.077814:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73a88af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab07 expref: 13 pid: 3134 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.077828:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73a88af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab07 expref: 13 pid: 3134 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.077844:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.077846:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.077854:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 40 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.077866:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 40 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.077893:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 40 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.077903:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626719488:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143776.078024:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5465 00000100:00100000:1.0:1746143776.078291:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.080723:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.080757:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.080781:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.080820:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622452224 00000100:00100000:1.0:1746143776.080827:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622452224 00000100:00100000:0.0:1746143776.080838:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:1.0:1746143776.080858:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880094197b80 x1830963622452224/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.080866:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197b80 with x1830963622452224 ext(0->1048575) 00002000:00010000:1.0:1746143776.080870:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197b80 00000100:00100000:2.0:1746143776.081757:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622452480 00000100:00100000:2.0:1746143776.081763:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622452480 00000100:00100000:1.0:1746143776.081771:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622452608 00000100:00100000:1.0:1746143776.081775:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622452608 00002000:00100000:2.0:1746143776.081783:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880094194a80 x1830963622452480/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.081789:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880094196680 x1830963622452608/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.081791:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194a80 with x1830963622452480 ext(1048576->2097151) 00002000:00010000:2.0:1746143776.081794:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094194a80 00002000:00100000:1.0:1746143776.081796:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196680 with x1830963622452608 ext(1048576->2097151) 00002000:00010000:1.0:1746143776.081799:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094196680 00000100:00100000:2.0:1746143776.081810:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622452864 00000100:00100000:2.0:1746143776.081812:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622452864 00000100:00100000:1.0:1746143776.081813:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3318 00000100:00100000:1.0:1746143776.081819:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622452224:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143776.081824:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880094197480 x1830963622452864/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.081831:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197480 with x1830963622452864 ext(1048576->2097151) 00002000:00010000:2.0:1746143776.081833:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197480 00000100:00100000:2.0:1746143776.081843:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3319 00000100:00100000:2.0:1746143776.081847:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622452480:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143776.082055:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3320 00000100:00100000:3.0:1746143776.082063:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622452608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143776.082169:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.082454:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622453120 00000100:00100000:2.0:1746143776.082458:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622453120 00002000:00100000:2.0:1746143776.082473:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2969600->2973695) req@ffff880094194700 x1830963622453120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.082480:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194700 with x1830963622453120 ext(2969600->2973695) 00002000:00010000:2.0:1746143776.082483:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094194700 00000100:00100000:2.0:1746143776.082496:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3321 00000100:00100000:2.0:1746143776.082501:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2008:x1830963622452864:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143776.082625:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3322 00000100:00100000:3.0:1746143776.082631:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622453120:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143776.082661:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626719488:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143776.082680:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143776.082688:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622453120:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 56us (518us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143776.082693:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3322 00002000:00100000:3.0:1746143776.082700:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (2969600->2973695) req@ffff880094194700 x1830963622453120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143776.082702:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622451584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4924us (5663us total) trans 0 rc 0/0 00002000:00100000:3.0:1746143776.082707:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194700 with x1830963622453120 ext(2969600->2973695) 00002000:00010000:3.0:1746143776.082709:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094194700 00000100:00100000:1.0:1746143776.082709:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5466 00000100:00100000:3.0:1746143776.097461:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2008:x1830963622452608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15391us (16671us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143776.097470:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3320 00002000:00100000:3.0:1746143776.097479:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880094196680 x1830963622452608/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.097487:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196680 with x1830963622452608 ext(1048576->2097151) 00002000:00010000:3.0:1746143776.097492:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094196680 00000100:00100000:2.0:1746143776.097540:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622452480:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15690us (16781us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143776.097547:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3319 00002000:00100000:2.0:1746143776.097552:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880094194a80 x1830963622452480/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.097557:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194a80 with x1830963622452480 ext(1048576->2097151) 00002000:00010000:2.0:1746143776.097560:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094194a80 00000100:00100000:1.0:1746143776.105646:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622452224:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23813us (24914us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143776.105659:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3318 00002000:00100000:1.0:1746143776.105672:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880094197b80 x1830963622452224/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.105682:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197b80 with x1830963622452224 ext(0->1048575) 00002000:00010000:1.0:1746143776.105688:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197b80 00000100:00100000:2.0:1746143776.107449:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.107617:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622453248 00000100:00100000:1.0:1746143776.107629:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622453248 00000100:00100000:1.0:1746143776.107679:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11656 00000100:00100000:1.0:1746143776.107687:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+48:32065:x1830963622453248:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143776.107710:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.107727:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab77 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.107758:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a888c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aae4 expref: 49 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.107766:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a898f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab69 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.107773:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73a88b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab0e expref: 13 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.107781:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.107783:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.107787:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 49 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.107819:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73a88b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab0e expref: 13 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.107829:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73a88b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab0e expref: 13 pid: 12328 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.107838:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626719616:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.107955:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a898f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab69 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.107963:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a898f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab69 expref: 27 pid: 9839 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.107970:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626719744:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.107995:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a888c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aae4 expref: 49 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.108001:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a888c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aae4 expref: 49 pid: 3135 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.108010:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626719872:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.108020:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143776.108170:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2008:x1830963622452864:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25666us (27329us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143776.108180:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3321 00002000:00100000:3.0:1746143776.108190:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880094197480 x1830963622452864/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.108198:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197480 with x1830963622452864 ext(1048576->2097151) 00002000:00010000:3.0:1746143776.108204:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197480 00000100:00100000:1.0:1746143776.110955:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626719616:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.110969:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626719744:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.110976:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626719872:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.111004:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 49 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.111018:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32a00, rc 0) 00000100:00100000:1.0:1746143776.111974:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+49:32065:x1830963622453248:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4284us (4530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.111983:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11656 00000100:00100000:0.0:1746143776.112644:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.112676:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.112707:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.112748:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622453376 00000100:00100000:2.0:1746143776.112755:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622453376 00000100:00100000:1.0:1746143776.112771:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622453632 00000100:00100000:1.0:1746143776.112776:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622453632 00010000:00010000:2.0:1746143776.112779:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73a88b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab0e expref: 14 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.112790:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a888c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aae4 expref: 49 pid: 3135 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143776.112799:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622453504 00000100:00100000:2.0:1746143776.112802:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622453504 00000100:00100000:1.0:1746143776.112806:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5467 00010000:00010000:2.0:1746143776.112810:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a898f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab69 expref: 28 pid: 9839 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.112812:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622453376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143776.112823:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5468 00010000:00010000:1.0:1746143776.112823:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143776.112828:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+49:2009:x1830963622453632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143776.112835:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.112838:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73a88b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab0e expref: 14 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143776.112844:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a888c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aae4 expref: 49 pid: 3135 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.112852:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73a88b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab0e expref: 14 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143776.112881:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a888c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aae4 expref: 49 pid: 3135 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143776.112899:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73a888c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aae4 expref: 49 pid: 3135 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746143776.112908:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5469 00000100:00100000:3.0:1746143776.112947:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622453504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143776.112954:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143776.112963:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a898f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab69 expref: 28 pid: 9839 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.112972:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a898f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab69 expref: 28 pid: 9839 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143776.112979:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143776.112984:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a898f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab69 expref: 28 pid: 9839 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.112997:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143776.113005:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963622453632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 176us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.113010:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5468 00000100:00100000:3.0:1746143776.113015:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622453504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.113020:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5469 00010000:00010000:1.0:1746143776.113269:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73a88b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab0e expref: 14 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.113282:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.113283:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.113289:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 47 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.113296:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 47 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.113319:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 47 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.113329:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626720000:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143776.113386:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.118175:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626720000:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143776.118194:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.118228:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622453376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5414us (5583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.118237:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5467 00000100:00100000:0.0:1746143776.118788:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.118896:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622453888 00000100:00100000:3.0:1746143776.118903:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622453888 00002000:00100000:3.0:1746143776.118966:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2449408->2453503) req@ffff880090e5ad80 x1830963622453888/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.118975:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5ad80 with x1830963622453888 ext(2449408->2453503) 00002000:00010000:3.0:1746143776.118979:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5ad80 00000100:00100000:3.0:1746143776.119003:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3323 00000100:00100000:3.0:1746143776.119009:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+48:2011:x1830963622453888:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143776.119098:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+48:2011:x1830963622453888:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 89us (310us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143776.119108:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3323 00002000:00100000:3.0:1746143776.119113:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2449408->2453503) req@ffff880090e5ad80 x1830963622453888/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.119119:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5ad80 with x1830963622453888 ext(2449408->2453503) 00002000:00010000:3.0:1746143776.119122:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5ad80 00000100:00100000:0.0:1746143776.123108:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.123219:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622454144 00000100:00100000:2.0:1746143776.123227:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622454144 00000100:00100000:2.0:1746143776.123630:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4685 00000100:00100000:2.0:1746143776.123639:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+261:32065:x1830963622454144:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143776.124577:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:32065:x1830963622454144:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 937us (1474us total) trans 8589943566 rc 0/0 00000100:00100000:2.0:1746143776.124585:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4685 00000100:00100000:0.0:1746143776.136060:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.136144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.136218:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622454400 00000100:00100000:1.0:1746143776.136227:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622454400 00000100:00100000:1.0:1746143776.136262:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622454272 00000100:00100000:1.0:1746143776.136264:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622454272 00000100:00100000:1.0:1746143776.136281:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11657 00000100:00100000:1.0:1746143776.136287:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622454400:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143776.136303:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.136317:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a89c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab85 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143776.136319:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11658 00000100:00100000:2.0:1746143776.136328:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622454272:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143776.136337:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.136347:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a89ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab7e expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.136362:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626720128:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143776.136372:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626720256:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143776.136814:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.137624:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.139297:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626720128:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143776.139325:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a89c7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab85 expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143776.139492:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626720256:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143776.139509:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a89ce lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab7e expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.139521:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d429400/0x87925e4cb73a89ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab7e expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.139534:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429400, rc 0) 00000100:00100000:2.0:1746143776.139569:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622454272:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3242us (3424us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143776.139577:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11658 00010000:00010000:1.0:1746143776.139700:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a89c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab85 expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.139713:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32000, rc 0) 00000100:00100000:1.0:1746143776.139735:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622454400:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3448us (3684us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143776.139740:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11657 00000100:00100000:0.0:1746143776.142219:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.142310:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622454528 00000100:00100000:1.0:1746143776.142317:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622454528 00000100:00100000:1.0:1746143776.142849:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11659 00000100:00100000:1.0:1746143776.142857:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32070:x1830963622454528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143776.142873:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.142888:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab8c expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.144000:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 40 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.144012:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143776.144014:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143776.144018:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.144047:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 40 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.144058:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 40 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.144070:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626720384:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143776.145084:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143776.146791:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626720384:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143776.146816:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.146829:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33a00, rc 0) 00000100:00100000:2.0:1746143776.146862:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32070:x1830963622454528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4005us (4646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.146869:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11659 00000100:00100000:0.0:1746143776.147463:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.147517:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622454656 00000100:00100000:1.0:1746143776.147524:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622454656 00002000:00100000:1.0:1746143776.147554:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2969600->3145727) req@ffff880090e5aa00 x1830963622454656/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.147561:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5aa00 with x1830963622454656 ext(2969600->3145727) 00010000:00010000:1.0:1746143776.147567:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 41 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.147582:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 41 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143776.147588:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e5aa00 00000100:00100000:1.0:1746143776.148287:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1403 00000100:00100000:1.0:1746143776.148293:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622454656:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143776.155866:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622454656:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7564us (8401us total) trans 21474840292 rc 0/0 00000100:00100000:1.0:1746143776.155878:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1403 00002000:00100000:1.0:1746143776.155889:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2969600->3145727) req@ffff880090e5aa00 x1830963622454656/t21474840292(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/448 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.155897:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5aa00 with x1830963622454656 ext(2969600->3145727) 00010000:00010000:1.0:1746143776.155906:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 43 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.155945:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 43 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143776.155951:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e5aa00 00000100:00100000:0.0:1746143776.158597:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.159244:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622454784 00000100:00100000:1.0:1746143776.159252:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622454784 00010000:00010000:1.0:1746143776.159282:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 43 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.159678:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5470 00000100:00100000:1.0:1746143776.159686:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622454784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.159700:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.159718:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 43 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.159728:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 43 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.159749:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73a89b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab70 expref: 43 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.159781:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.159783:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.159788:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.159795:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.159823:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.159832:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626720512:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143776.160569:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.164724:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626720512:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143776.164744:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.164784:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622454784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5097us (6189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.164794:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5470 00000100:00100000:0.0:1746143776.166058:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.166533:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622455040 00000100:00100000:1.0:1746143776.166540:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622455040 00002000:00100000:1.0:1746143776.166573:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880090e5a300 x1830963622455040/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.166581:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5a300 with x1830963622455040 ext(2097152->3145727) 00002000:00010000:1.0:1746143776.166585:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e5a300 00000100:00100000:1.0:1746143776.166613:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3324 00000100:00100000:1.0:1746143776.166619:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622455040:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143776.173979:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622455040:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7350us (7913us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143776.173995:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3324 00002000:00100000:1.0:1746143776.174005:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880090e5a300 x1830963622455040/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.174013:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5a300 with x1830963622455040 ext(2097152->3145727) 00002000:00010000:1.0:1746143776.174018:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e5a300 00000100:00100000:0.0:1746143776.177312:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.177686:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622455168 00000100:00100000:2.0:1746143776.177696:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622455168 00000100:00100000:2.0:1746143776.177760:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11660 00000100:00100000:2.0:1746143776.177768:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:32070:x1830963622455168:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143776.177790:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.177811:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab93 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.177841:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 47 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.177849:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143776.177851:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143776.177855:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 28 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.177885:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 47 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.177897:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 47 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143776.177957:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626720640:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.178054:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143776.180140:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626720640:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143776.180168:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 28 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.180185:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429400, rc 0) 00000100:00100000:2.0:1746143776.180235:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:32070:x1830963622455168:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2466us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.180243:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11660 00000100:00100000:0.0:1746143776.181430:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.181798:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622455296 00000100:00100000:1.0:1746143776.181808:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622455296 00002000:00100000:1.0:1746143776.181851:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2453503) req@ffff880090e5b800 x1830963622455296/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.181859:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5b800 with x1830963622455296 ext(2097152->2453503) 00010000:00010000:1.0:1746143776.181868:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 48 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.181881:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 48 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143776.181887:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e5b800 00000100:00100000:1.0:1746143776.182088:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1404 00000100:00100000:1.0:1746143776.182097:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963622455296:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143776.187203:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+50:2009:x1830963622455296:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5096us (5764us total) trans 17179872970 rc 0/0 00000100:00100000:1.0:1746143776.187217:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1404 00002000:00100000:1.0:1746143776.187228:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2453503) req@ffff880090e5b800 x1830963622455296/t17179872970(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/448 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.187238:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5b800 with x1830963622455296 ext(2097152->2453503) 00010000:00010000:1.0:1746143776.187248:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 50 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.187262:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 50 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143776.187270:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e5b800 00000100:00100000:0.0:1746143776.188530:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.189522:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622455424 00000100:00100000:1.0:1746143776.189532:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622455424 00010000:00010000:1.0:1746143776.189568:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 50 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.189614:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5471 00000100:00100000:1.0:1746143776.189623:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+50:2009:x1830963622455424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.189638:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.189658:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 50 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.189668:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 50 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.189691:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73a89c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab77 expref: 50 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.190103:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.190105:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.190114:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 27 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.190223:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 27 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.190264:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 27 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.190276:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626720768:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143776.190376:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.192465:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626720768:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143776.192486:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.192709:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+49:2009:x1830963622455424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3085us (4181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.192721:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5471 00000100:00100000:0.0:1746143776.202528:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.203655:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622455680 00000100:00100000:1.0:1746143776.203667:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622455680 00002000:00100000:1.0:1746143776.203720:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880090e58000 x1830963622455680/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.203736:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58000 with x1830963622455680 ext(2097152->4194303) 00002000:00010000:1.0:1746143776.203743:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e58000 00000100:00100000:1.0:1746143776.203782:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3325 00000100:00100000:1.0:1746143776.203791:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622455680:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143776.204039:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.204100:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622455936 00000100:00100000:3.0:1746143776.204105:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622455936 00002000:00100000:3.0:1746143776.204127:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880090e59500 x1830963622455936/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.204135:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59500 with x1830963622455936 ext(3145728->4194303) 00002000:00010000:3.0:1746143776.204138:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59500 00000100:00100000:3.0:1746143776.204159:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3326 00000100:00100000:3.0:1746143776.204164:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622455936:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143776.213307:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622455936:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9129us (9255us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143776.213320:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3326 00002000:00100000:3.0:1746143776.213334:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880090e59500 x1830963622455936/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.213343:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59500 with x1830963622455936 ext(3145728->4194303) 00002000:00010000:3.0:1746143776.213350:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59500 00000100:00100000:1.0:1746143776.216261:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622455680:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12460us (13734us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143776.216273:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3325 00002000:00100000:1.0:1746143776.216285:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880090e58000 x1830963622455680/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.216295:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58000 with x1830963622455680 ext(2097152->4194303) 00002000:00010000:1.0:1746143776.216301:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e58000 00000100:00100000:0.0:1746143776.225552:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.225875:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622456064 00000100:00100000:2.0:1746143776.225885:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622456064 00000100:00100000:2.0:1746143776.226102:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11661 00000100:00100000:2.0:1746143776.226113:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:32072:x1830963622456064:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143776.226134:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.226161:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ab9a expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.226194:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.226202:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.226204:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.226208:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3862528->4194303] (req 3862528->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.226245:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.226258:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 29 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143776.226271:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626720896:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.226377:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.226737:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.226817:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622456320 00000100:00100000:1.0:1746143776.226822:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622456320 00002000:00100000:1.0:1746143776.226853:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880090e59880 x1830963622456320/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.226861:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59880 with x1830963622456320 ext(4194304->4780031) 00002000:00010000:1.0:1746143776.226866:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59880 00000100:00100000:1.0:1746143776.226894:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3327 00000100:00100000:1.0:1746143776.226900:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622456320:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143776.232524:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.232623:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622456448 00000100:00100000:1.0:1746143776.232632:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622456448 00010000:00010000:1.0:1746143776.232673:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.232716:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5472 00000100:00100000:1.0:1746143776.232723:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622456448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.232739:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.232760:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.232773:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.232801:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.232803:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.232809:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.232816:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.232850:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.232868:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626721024:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143776.233040:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d429400/0x87925e4cb73a89dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab93 expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143776.233059:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626720896:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143776.233083:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.233091:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085000, rc 0) 00000100:00100000:0.0:1746143776.233131:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32072:x1830963622456064:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7020us (7591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143776.233143:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11661 00000100:00100000:1.0:1746143776.233893:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.234218:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622456320:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7316us (7480us total) trans 0 rc 585728/585728 00000100:00100000:1.0:1746143776.234226:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3327 00002000:00100000:1.0:1746143776.234237:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880090e59880 x1830963622456320/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.234245:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59880 with x1830963622456320 ext(4194304->4780031) 00002000:00010000:1.0:1746143776.234250:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59880 00000100:00100000:1.0:1746143776.235430:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626721024:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143776.235446:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.235470:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622456448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2747us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.235483:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5472 00000100:00100000:0.0:1746143776.239850:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.239969:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622456576 00000100:00100000:2.0:1746143776.239979:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622456576 00000100:00100000:2.0:1746143776.240027:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11662 00000100:00100000:2.0:1746143776.240035:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32072:x1830963622456576:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143776.240057:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.240075:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aba1 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.240106:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 31 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.240114:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.240115:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.240119:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4194304->4747263] (req 4194304->4747263) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 31 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.240150:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 31 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.240162:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 31 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143776.240175:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626721152:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.240827:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.243435:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.243644:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626721152:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.243676:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622456832 00010000:00010000:3.0:1746143776.243679:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4194304->4747263] (req 4194304->4747263) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 31 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143776.243684:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622456832 00010000:00010000:3.0:1746143776.243701:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268a00, rc 0) 00000100:00100000:2.0:1746143776.243738:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4686 00000100:00100000:2.0:1746143776.243746:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32070:x1830963622456832:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143776.243813:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:32072:x1830963622456576:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3778us (3974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.243821:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11662 00000100:00100000:2.0:1746143776.243960:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32070:x1830963622456832:12345-192.168.202.3@tcp:35:cat.0 Request processed in 215us (534us total) trans 8589943567 rc 0/0 00000100:00100000:2.0:1746143776.243966:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4686 00000100:00100000:0.0:1746143776.248378:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.248569:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.248804:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622457216 00000100:00100000:3.0:1746143776.248813:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622457216 00000100:00100000:3.0:1746143776.248867:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12829 00000100:00100000:3.0:1746143776.248874:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+262:32076:x1830963622457216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.248901:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.248952:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73a89f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aba8 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.249031:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.249044:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.249054:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.249067:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a89ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.249072:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a89ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.249077:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a89ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.249183:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.249192:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.249198:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143776.249207:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:1.0:1746143776.249531:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622456960 00000100:00100000:1.0:1746143776.249536:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622456960 00010000:00010000:1.0:1746143776.249556:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 31 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.249577:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5473 00000100:00100000:1.0:1746143776.249582:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622456960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.249593:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.249610:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 31 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.249622:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 31 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.249640:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33a00/0x87925e4cb73a89d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab8c expref: 31 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.249665:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.249668:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.249674:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.249683:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.249714:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.249727:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626721280:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143776.249805:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4900 going to sleep for 11 seconds 00010000:00010000:3.0:1746143776.250158:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.250165:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.250170:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.250176:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.250182:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093717600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143776.250185:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.250192:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.250202:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143776.250204:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143776.250207:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.250215:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a89f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.251198:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a89ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.251206:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a89ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.251211:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a89ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.251215:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093716200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143776.251217:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a89ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.251221:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a89ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.251229:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14900) 00010000:00010000:3.0:1746143776.251231:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143776.251233:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a89ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.251237:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a89ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.251282:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73a89f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba8 expref: 265 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.251292:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba8 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.251302:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.251304:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143776.251307:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717800, rc 0) 00000100:00100000:3.0:1746143776.251352:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+264:32076:x1830963622457216:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2478us (2783us total) trans 8589943568 rc 0/0 00000100:00100000:3.0:1746143776.251358:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12829 00000100:00100000:1.0:1746143776.253457:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626721280:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143776.253476:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.253530:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622456960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3947us (5162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.253541:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5473 00000100:00100000:0.0:1746143776.256368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.256425:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.256485:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622457344 00000100:00100000:1.0:1746143776.256496:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622457344 00000100:00100000:3.0:1746143776.256505:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622457472 00000100:00100000:3.0:1746143776.256509:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622457472 00000100:00100000:1.0:1746143776.256542:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11663 00000100:00100000:3.0:1746143776.256549:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11664 00000100:00100000:1.0:1746143776.256550:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963622457344:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143776.256555:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+49:2011:x1830963622457472:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.256569:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.256569:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.256585:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a8a14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abb6 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.256585:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a8a1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abaf expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143776.256640:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626721536:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143776.256640:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626721408:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143776.257669:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.257719:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.258053:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622457728 00000100:00100000:1.0:1746143776.258057:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622457728 00002000:00100000:1.0:1746143776.258091:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4743168->4747263) req@ffff880129dc2680 x1830963622457728/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.258101:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2680 with x1830963622457728 ext(4743168->4747263) 00002000:00010000:1.0:1746143776.258106:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc2680 00000100:00100000:1.0:1746143776.258135:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3328 00000100:00100000:1.0:1746143776.258142:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2011:x1830963622457728:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143776.258218:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.258606:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2011:x1830963622457728:12345-192.168.202.3@tcp:3:cat.0 Request processed in 463us (885us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143776.258613:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3328 00002000:00100000:1.0:1746143776.258619:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4743168->4747263) req@ffff880129dc2680 x1830963622457728/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.258626:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2680 with x1830963622457728 ext(4743168->4747263) 00002000:00010000:1.0:1746143776.258629:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc2680 00000100:00100000:1.0:1746143776.259788:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626721408:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143776.259820:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a8a1b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abaf expref: 43 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.259833:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a8a1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abaf expref: 43 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.259848:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97200, rc 0) 00000100:00100000:1.0:1746143776.259879:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963622457344:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3325us (3518us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143776.259885:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11663 00000100:00100000:3.0:1746143776.260134:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626721536:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143776.260152:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a8a14 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abb6 expref: 50 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.260162:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73a8a14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abb6 expref: 50 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.260172:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716600, rc 0) 00000100:00100000:3.0:1746143776.260205:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+49:2011:x1830963622457472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3649us (3779us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143776.260210:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11664 00000100:00100000:2.0:1746143776.264646:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.264700:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622457984 00000100:00100000:0.0:1746143776.264710:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622457984 00000100:00100000:0.0:1746143776.264767:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4687 00000100:00100000:0.0:1746143776.264777:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32072:x1830963622457984:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143776.265068:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32072:x1830963622457984:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 291us (433us total) trans 8589943569 rc 0/0 00000100:00100000:0.0:1746143776.265075:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4687 00000100:00100000:0.0:1746143776.271891:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.272488:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.272909:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.272989:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.273066:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622458368 00000100:00100000:1.0:1746143776.273077:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622458368 00000100:00100000:3.0:1746143776.273099:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622458496 00000100:00100000:3.0:1746143776.273104:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622458496 00002000:00100000:3.0:1746143776.273127:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880129dc2a00 x1830963622458496/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.273127:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880129dc0380 x1830963622458368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.273137:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2a00 with x1830963622458496 ext(1048576->2097151) 00002000:00100000:1.0:1746143776.273137:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0380 with x1830963622458368 ext(0->1048575) 00002000:00010000:3.0:1746143776.273143:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc2a00 00002000:00010000:1.0:1746143776.273143:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc0380 00000100:00100000:3.0:1746143776.273571:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622458880 00000100:00100000:3.0:1746143776.273575:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622458880 00002000:00100000:3.0:1746143776.273590:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880129dc0000 x1830963622458880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.273597:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0000 with x1830963622458880 ext(1048576->2097151) 00002000:00010000:3.0:1746143776.273600:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc0000 00000100:00100000:1.0:1746143776.273622:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622458752 00000100:00100000:1.0:1746143776.273625:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622458752 00002000:00100000:1.0:1746143776.273638:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880129dc1880 x1830963622458752/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.273646:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1880 with x1830963622458752 ext(1048576->2097151) 00002000:00010000:1.0:1746143776.273649:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1880 00000100:00100000:1.0:1746143776.273672:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3329 00000100:00100000:1.0:1746143776.273680:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622458496:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143776.274003:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3330 00000100:00100000:2.0:1746143776.274014:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3331 00000100:00100000:2.0:1746143776.274021:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+50:2008:x1830963622458880:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143776.274461:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3332 00000100:00100000:1.0:1746143776.274468:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+51:2008:x1830963622458752:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143776.275491:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622458368:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143776.288435:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+51:2008:x1830963622458880:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14399us (15510us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143776.288449:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3331 00002000:00100000:3.0:1746143776.288464:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880129dc0000 x1830963622458880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.288475:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0000 with x1830963622458880 ext(1048576->2097151) 00002000:00010000:3.0:1746143776.288482:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc0000 00000100:00100000:1.0:1746143776.288483:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622458496:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14802us (15994us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143776.288491:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3329 00002000:00100000:1.0:1746143776.288498:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880129dc2a00 x1830963622458496/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.288505:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2a00 with x1830963622458496 ext(1048576->2097151) 00002000:00010000:1.0:1746143776.288509:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc2a00 00000100:00100000:3.0:1746143776.291692:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622458368:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17669us (19801us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143776.291709:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3330 00002000:00100000:3.0:1746143776.291724:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880129dc0380 x1830963622458368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.291735:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0380 with x1830963622458368 ext(0->1048575) 00002000:00010000:3.0:1746143776.291741:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc0380 00000100:00100000:1.0:1746143776.295036:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+49:2008:x1830963622458752:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20554us (22034us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143776.295048:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3332 00002000:00100000:1.0:1746143776.295060:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880129dc1880 x1830963622458752/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.295070:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1880 with x1830963622458752 ext(1048576->2097151) 00002000:00010000:1.0:1746143776.295077:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1880 00000100:00100000:0.0:1746143776.307363:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.307431:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.307523:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622459264 00000100:00100000:3.0:1746143776.307533:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622459264 00000100:00100000:1.0:1746143776.307563:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622459136 00000100:00100000:1.0:1746143776.307568:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622459136 00000100:00100000:3.0:1746143776.307579:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11665 00000100:00100000:3.0:1746143776.307585:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+49:2009:x1830963622459264:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143776.307594:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11666 00000100:00100000:1.0:1746143776.307600:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622459136:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.307604:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.307609:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.307622:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368da200/0x87925e4cb73a8a29 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abc4 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.307622:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a8a22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abbd expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143776.307668:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626721664:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143776.307669:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626721792:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143776.308868:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.308870:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143776.310871:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626721664:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143776.310871:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626721792:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143776.310898:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a8a22 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abbd expref: 43 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.310899:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368da200/0x87925e4cb73a8a29 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abc4 expref: 50 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.310939:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73a8a22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abbd expref: 43 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.310949:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368da200/0x87925e4cb73a8a29 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abc4 expref: 50 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.310957:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97000, rc 0) 00010000:00010000:3.0:1746143776.310961:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368da200, rc 0) 00000100:00100000:1.0:1746143776.310995:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622459136:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3394us (3563us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143776.311003:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11666 00000100:00100000:3.0:1746143776.311115:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+49:2009:x1830963622459264:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3529us (3764us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143776.311122:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11665 00000100:00100000:0.0:1746143776.312372:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.312435:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622459392 00000100:00100000:3.0:1746143776.312442:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622459392 00000100:00100000:3.0:1746143776.312522:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11667 00000100:00100000:3.0:1746143776.312529:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+42:32076:x1830963622459392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.312544:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.312558:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abcb expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.312581:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.312589:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143776.312590:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143776.312594:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 43 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.312621:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.312633:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 29 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143776.312645:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626721920:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143776.313177:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143776.315228:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626721920:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143776.315262:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 43 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.315279:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368dac00, rc 0) 00000100:00100000:3.0:1746143776.315314:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:32076:x1830963622459392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2785us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.315323:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11667 00000100:00100000:0.0:1746143776.315585:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.315657:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622459520 00000100:00100000:1.0:1746143776.315664:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622459520 00002000:00100000:1.0:1746143776.315704:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4747263) req@ffff880093727480 x1830963622459520/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.315713:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093727480 with x1830963622459520 ext(4194304->4747263) 00010000:00010000:1.0:1746143776.315721:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.315736:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143776.315743:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093727480 00000100:00100000:1.0:1746143776.315768:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1405 00000100:00100000:1.0:1746143776.315774:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622459520:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143776.323317:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2008:x1830963622459520:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7529us (7719us total) trans 21474840293 rc 0/0 00000100:00100000:2.0:1746143776.323333:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1405 00002000:00100000:2.0:1746143776.323348:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4747263) req@ffff880093727480 x1830963622459520/t21474840293(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/448 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.323358:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093727480 with x1830963622459520 ext(4194304->4747263) 00010000:00010000:2.0:1746143776.323371:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 32 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.323388:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 32 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746143776.323395:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093727480 00000100:00100000:0.0:1746143776.326424:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.326510:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622459648 00000100:00100000:1.0:1746143776.326524:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622459648 00010000:00010000:1.0:1746143776.326563:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 32 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143776.328509:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5474 00000100:00100000:0.0:1746143776.328530:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622459648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143776.328559:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143776.328589:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 32 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143776.328606:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 32 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143776.328632:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73a89ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4747263) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba1 expref: 32 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143776.328672:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.328675:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.328683:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 42 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.328692:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 42 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.328732:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 42 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143776.328747:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626722048:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143776.328858:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143776.331891:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626722048:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143776.331953:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143776.332001:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622459648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3479us (5586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.332012:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5474 00000100:00100000:0.0:1746143776.334009:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.334162:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622459904 00000100:00100000:2.0:1746143776.334173:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622459904 00002000:00100000:2.0:1746143776.334225:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880093726d80 x1830963622459904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.334235:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093726d80 with x1830963622459904 ext(2097152->3145727) 00002000:00010000:2.0:1746143776.334241:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093726d80 00000100:00100000:2.0:1746143776.334271:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3333 00000100:00100000:2.0:1746143776.334280:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622459904:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143776.343597:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622459904:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9306us (9585us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143776.343611:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3333 00002000:00100000:2.0:1746143776.343625:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880093726d80 x1830963622459904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.343641:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093726d80 with x1830963622459904 ext(2097152->3145727) 00002000:00010000:2.0:1746143776.343648:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093726d80 00000100:00100000:0.0:1746143776.348411:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.348558:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622460032 00000100:00100000:3.0:1746143776.348570:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622460032 00000100:00100000:3.0:1746143776.348635:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11668 00000100:00100000:3.0:1746143776.348644:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+49:32076:x1830963622460032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.348667:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.348686:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abd2 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.348718:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 27 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.348724:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143776.348726:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143776.348728:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 50 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.348756:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 27 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.348765:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 27 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143776.348776:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626722176:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143776.348872:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143776.350310:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626722176:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143776.350336:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 50 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.350351:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c200, rc 0) 00000100:00100000:3.0:1746143776.350385:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+50:32076:x1830963622460032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1742us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.350393:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11668 00000100:00100000:0.0:1746143776.350593:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.350705:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622460160 00000100:00100000:3.0:1746143776.350711:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622460160 00002000:00100000:3.0:1746143776.350745:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3862528->4194303) req@ffff880093724000 x1830963622460160/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.350754:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724000 with x1830963622460160 ext(3862528->4194303) 00010000:00010000:3.0:1746143776.350760:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 28 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.350772:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 28 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746143776.350778:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093724000 00000100:00100000:3.0:1746143776.350875:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1406 00000100:00100000:3.0:1746143776.350883:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963622460160:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143776.356317:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.356390:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622460416 00000100:00100000:2.0:1746143776.356409:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622460416 00000100:00100000:0.0:1746143776.356629:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12830 00000100:00100000:0.0:1746143776.356641:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:32080:x1830963622460416:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143776.356787:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143776.356807:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abd9 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.356901:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143776.356943:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab31 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.356951:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab3f expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.356958:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba8 expref: 265 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.356965:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143776.356998:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba8 expref: 265 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.357044:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba8 expref: 265 pid: 14991 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143776.357060:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626722304:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143776.357270:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab3f expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.357295:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab3f expref: 12 pid: 7244 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143776.357302:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626722432:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143776.357339:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab31 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.357346:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab31 expref: 12 pid: 7244 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143776.357353:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093726680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626722560:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143776.357371:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143776.357456:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622460160:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6572us (6862us total) trans 17179872971 rc 0/0 00000100:00100000:3.0:1746143776.357467:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1406 00002000:00100000:3.0:1746143776.357477:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3862528->4194303) req@ffff880093724000 x1830963622460160/t17179872971(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/448 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.357487:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724000 with x1830963622460160 ext(3862528->4194303) 00010000:00010000:3.0:1746143776.357495:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.357507:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746143776.357512:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093724000 00000100:00100000:2.0:1746143776.360178:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626722304:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.360191:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626722432:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.360198:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093726680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626722560:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143776.360226:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143776.361015:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.361042:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.361070:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.361112:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.361274:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622460544 00000100:00100000:1.0:1746143776.361275:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622460672 00000100:00100000:2.0:1746143776.361281:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622460544 00000100:00100000:1.0:1746143776.361281:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622460672 00010000:00010000:2.0:1746143776.361314:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba8 expref: 266 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.361314:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab3f expref: 13 pid: 7244 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.361497:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622460800 00000100:00100000:1.0:1746143776.361501:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622460800 00010000:00010000:1.0:1746143776.361520:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab31 expref: 14 pid: 7244 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.361530:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622460928 00000100:00100000:1.0:1746143776.361532:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622460928 00010000:00010000:1.0:1746143776.361543:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143776.361544:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5475 00000100:00100000:2.0:1746143776.361555:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:2009:x1830963622460544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143776.361555:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5476 00000100:00100000:1.0:1746143776.361560:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622460672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143776.361569:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.361569:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.361575:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab3f expref: 14 pid: 7244 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.361576:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba8 expref: 266 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.361585:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab3f expref: 14 pid: 7244 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.361663:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba8 expref: 266 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.361685:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a89ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab3f expref: 14 pid: 7244 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143776.361707:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5477 00000100:00100000:3.0:1746143776.361715:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622460800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143776.361723:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143776.361727:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab31 expref: 13 pid: 7244 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143776.361769:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5478 00000100:00100000:0.0:1746143776.361775:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622460928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143776.361783:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.361850:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.361851:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a8a06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aba8 expref: 266 pid: 14991 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.361855:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.361863:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.361868:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143776.361869:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.361872:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.361877:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.361881:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.361942:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622460672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 350us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.361949:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5476 00010000:00010000:0.0:1746143776.361953:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143776.361960:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143776.361978:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73a89e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab9a expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143776.361993:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.361994:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.362001:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 49 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.362008:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 49 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.362039:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 49 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143776.362050:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626722688:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143776.362114:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab31 expref: 12 pid: 7244 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.362125:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73a895e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab31 expref: 12 pid: 7244 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.362138:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.362141:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.362147:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.362153:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.362168:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143776.362226:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:2009:x1830963622460544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 673us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.362232:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5475 00010000:00010000:2.0:1746143776.362256:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.362262:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143776.362281:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143776.362397:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73a8a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd9 expref: 266 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.362407:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd9 expref: 265 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.362413:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.362416:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143776.362418:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8a00, rc 0) 00000100:00100000:2.0:1746143776.362438:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:32080:x1830963622460416:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5800us (6132us total) trans 8589943570 rc 0/0 00000100:00100000:2.0:1746143776.362446:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12830 00000100:00100000:0.0:1746143776.363111:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143776.363352:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622460800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1636us (2279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.363358:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5477 00000100:00100000:0.0:1746143776.364114:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.364163:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622461184 00000100:00100000:2.0:1746143776.364169:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622461184 00000100:00100000:2.0:1746143776.364208:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12831 00000100:00100000:2.0:1746143776.364216:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32083:x1830963622461184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143776.364237:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.364258:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8e00/0x87925e4cb73a8a53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abe0 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.364334:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364345:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364353:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364364:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8a61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364370:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8a61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364376:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8a61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364472:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364480:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364487:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143776.364495:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143776.364555:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364561:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364566:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364571:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364576:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b9400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.364580:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364587:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364596:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143776.364598:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.364602:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364607:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73a8a5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364618:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8a61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364626:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8a61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364630:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8a61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364634:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b9800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.364637:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8a61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364642:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8a61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364647:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d300) 00010000:00010000:2.0:1746143776.364649:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.364651:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8a61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364655:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73a8a61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.364686:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8e00/0x87925e4cb73a8a53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe0 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.364695:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe0 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.364701:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.364702:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143776.364704:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8200, rc 0) 00000100:00100000:2.0:1746143776.364785:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32083:x1830963622461184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 569us (670us total) trans 8589943571 rc 0/0 00000100:00100000:2.0:1746143776.364791:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12831 00000100:00100000:0.0:1746143776.373184:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.373273:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622461312 00000100:00100000:0.0:1746143776.373273:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.373284:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622461312 00000100:00100000:3.0:1746143776.373331:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622461440 00000100:00100000:3.0:1746143776.373334:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622461440 00000100:00100000:3.0:1746143776.373352:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11669 00000100:00100000:1.0:1746143776.373358:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11670 00000100:00100000:3.0:1746143776.373359:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622461312:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143776.373366:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622461440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143776.373379:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.373399:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8a76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abee expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.373423:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.373425:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.373434:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8a76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abee expref: 31 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.373449:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8a76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abee expref: 31 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.373465:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ae00, rc 0) 00010000:00010000:3.0:1746143776.373527:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.373539:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abe7 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.373551:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.373553:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.373557:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 32 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.373568:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 32 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.373579:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c000, rc 0) 00000100:00100000:2.0:1746143776.373586:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626722688:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143776.373606:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143776.373614:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622461312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 256us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.373619:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11669 00000100:00100000:2.0:1746143776.373627:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622460928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 11853us (12514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.373636:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5478 00000100:00100000:1.0:1746143776.375058:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622461440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1685us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.375065:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11670 00000100:00100000:0.0:1746143776.375939:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.375992:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.376054:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622461824 00000100:00100000:1.0:1746143776.376062:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622461824 00002000:00100000:1.0:1746143776.376118:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800939a7b80 x1830963622461824/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.376131:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7b80 with x1830963622461824 ext(3145728->4194303) 00002000:00010000:1.0:1746143776.376136:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a7b80 00000100:00100000:1.0:1746143776.376314:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622461952 00000100:00100000:1.0:1746143776.376317:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622461952 00002000:00100000:1.0:1746143776.376334:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800939a4380 x1830963622461952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.376340:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a4380 with x1830963622461952 ext(2097152->4194303) 00002000:00010000:1.0:1746143776.376343:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a4380 00000100:00100000:3.0:1746143776.376377:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3334 00000100:00100000:3.0:1746143776.376384:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963622461824:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143776.376480:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3335 00000100:00100000:2.0:1746143776.376493:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+50:2011:x1830963622461952:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143776.385541:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963622461824:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9144us (9617us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143776.385555:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3334 00002000:00100000:3.0:1746143776.385568:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800939a7b80 x1830963622461824/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.385578:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7b80 with x1830963622461824 ext(3145728->4194303) 00002000:00010000:3.0:1746143776.385585:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a7b80 00000100:00100000:1.0:1746143776.394177:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.394186:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+50:2011:x1830963622461952:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17697us (18190us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143776.394200:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3335 00002000:00100000:2.0:1746143776.394213:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800939a4380 x1830963622461952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.394223:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a4380 with x1830963622461952 ext(2097152->4194303) 00002000:00010000:2.0:1746143776.394231:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a4380 00000100:00100000:1.0:1746143776.394248:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.394264:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622462208 00000100:00100000:2.0:1746143776.394271:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622462208 00002000:00100000:2.0:1746143776.394313:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091d4c000 x1830963622462208/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.394320:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4c000 with x1830963622462208 ext(2097152->4194303) 00002000:00010000:2.0:1746143776.394323:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4c000 00000100:00100000:3.0:1746143776.394334:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622462464 00000100:00100000:3.0:1746143776.394338:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622462464 00000100:00100000:2.0:1746143776.394339:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3336 00000100:00100000:2.0:1746143776.394346:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622462208:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143776.394358:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091d4f800 x1830963622462464/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.394367:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4f800 with x1830963622462464 ext(2097152->4194303) 00002000:00010000:3.0:1746143776.394370:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4f800 00000100:00100000:3.0:1746143776.394390:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3337 00000100:00100000:3.0:1746143776.394395:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622462464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143776.394993:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.395037:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622462592 00000100:00100000:0.0:1746143776.395042:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622462592 00000100:00100000:0.0:1746143776.395071:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11671 00000100:00100000:0.0:1746143776.395078:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+43:32080:x1830963622462592:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143776.395088:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143776.395108:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abf5 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.395135:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 44 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.395143:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 33 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143776.395150:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.395151:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.395155:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 44 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.395189:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 33 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143776.395201:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 33 pid: 12328 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746143776.395214:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626722816:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143776.395282:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 44 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.395291:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 44 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143776.395299:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626722944:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143776.395319:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143776.402837:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626722816:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.402853:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626722944:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143776.402889:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 44 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.402908:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee76600, rc 0) 00000100:00100000:2.0:1746143776.402999:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:32080:x1830963622462592:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7920us (8006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.403009:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11671 00000100:00100000:0.0:1746143776.405768:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.408748:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622462720 00000100:00100000:2.0:1746143776.408770:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622462720 00000100:00100000:2.0:1746143776.408841:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11672 00000100:00100000:2.0:1746143776.408851:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:32076:x1830963622462720:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143776.408875:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143776.408875:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143776.408896:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840abfc expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.408960:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.408968:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.408974:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143776.408977:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.409017:0:3135:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.409031:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.409041:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b47bc00, rc 0) 00000100:00100000:3.0:1746143776.409046:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622462848 00000100:00100000:3.0:1746143776.409051:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622462848 00010000:00010000:3.0:1746143776.409072:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 46 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143776.409087:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:32076:x1830963622462720:12345-192.168.202.3@tcp:101:cat.0 Request processed in 238us (3328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.409094:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11672 00000100:00100000:3.0:1746143776.409098:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5479 00000100:00100000:3.0:1746143776.409104:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622462848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143776.409113:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143776.409218:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622462208:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14872us (15054us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143776.409225:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3336 00002000:00100000:2.0:1746143776.409234:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091d4c000 x1830963622462208/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.409243:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4c000 with x1830963622462208 ext(2097152->4194303) 00010000:00010000:2.0:1746143776.409248:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 32 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.409294:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 45 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.409304:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 45 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.409323:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368dac00/0x87925e4cb73a8a30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abcb expref: 45 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.409346:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143776.409369:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622462848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 264us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.409375:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5479 00010000:00010000:2.0:1746143776.410211:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 32 pid: 12328 timeout: 935 lvb_type: 1 00002000:00010000:2.0:1746143776.410218:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d4c000 00000100:00100000:3.0:1746143776.413350:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622462464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18937us (19084us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143776.413364:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3337 00002000:00100000:3.0:1746143776.413378:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091d4f800 x1830963622462464/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.413388:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4f800 with x1830963622462464 ext(2097152->4194303) 00002000:00010000:3.0:1746143776.413396:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4f800 00000100:00100000:0.0:1746143776.415557:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.415671:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622463104 00000100:00100000:3.0:1746143776.415681:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622463104 00002000:00100000:3.0:1746143776.415729:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88009c4d7480 x1830963622463104/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.415739:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7480 with x1830963622463104 ext(4194304->4780031) 00010000:00010000:3.0:1746143776.415747:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 32 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.415761:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 32 pid: 12328 timeout: 935 lvb_type: 1 00002000:00010000:3.0:1746143776.415768:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4d7480 00000100:00100000:3.0:1746143776.415802:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1407 00000100:00100000:3.0:1746143776.415809:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2010:x1830963622463104:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143776.419892:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.420005:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622463232 00000100:00100000:2.0:1746143776.420016:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622463232 00000100:00100000:2.0:1746143776.420074:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11673 00000100:00100000:2.0:1746143776.420083:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:32083:x1830963622463232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143776.420109:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.420128:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac03 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.420158:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.420165:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.420178:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.420194:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee76400, rc 0) 00000100:00100000:2.0:1746143776.420243:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:32083:x1830963622463232:12345-192.168.202.3@tcp:101:cat.0 Request processed in 161us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.420249:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11673 00000100:00100000:2.0:1746143776.420347:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2010:x1830963622463104:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4538us (4801us total) trans 0 rc 585728/585728 00000100:00100000:2.0:1746143776.420354:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1407 00002000:00100000:2.0:1746143776.420364:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88009c4d7480 x1830963622463104/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.420373:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7480 with x1830963622463104 ext(4194304->4780031) 00010000:00010000:2.0:1746143776.420379:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 33 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746143776.420391:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 33 pid: 12328 timeout: 935 lvb_type: 1 00002000:00010000:2.0:1746143776.420402:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4d7480 00000100:00100000:0.0:1746143776.423004:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.423248:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622463360 00000100:00100000:3.0:1746143776.423259:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622463360 00010000:00010000:3.0:1746143776.423296:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 33 pid: 12328 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746143776.423338:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5480 00000100:00100000:3.0:1746143776.423346:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2009:x1830963622463360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143776.423364:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143776.423387:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 33 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.423404:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 33 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.423428:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8a7d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe7 expref: 33 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.424127:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.424131:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.424140:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.424150:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.424190:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.424203:0:12362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 43 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143776.424221:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626723200:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143776.424354:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.426144:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.426184:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626723200:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143776.426204:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143776.426235:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622463616 00000100:00100000:2.0:1746143776.426245:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622463616 00000100:00100000:3.0:1746143776.426273:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622463360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2926us (3277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.426283:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5480 00002000:00100000:2.0:1746143776.426299:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3911680->3915775) req@ffff88009391ca80 x1830963622463616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.426309:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ca80 with x1830963622463616 ext(3911680->3915775) 00010000:00010000:2.0:1746143776.426317:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 44 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.426329:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 44 pid: 3135 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746143776.426336:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391ca80 00000100:00100000:2.0:1746143776.426356:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1408 00000100:00100000:2.0:1746143776.426363:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622463616:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143776.426505:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622463616:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 141us (369us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143776.426511:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1408 00002000:00100000:2.0:1746143776.426516:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3911680->3915775) req@ffff88009391ca80 x1830963622463616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.426523:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ca80 with x1830963622463616 ext(3911680->3915775) 00010000:00010000:2.0:1746143776.426528:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 44 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.426542:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 44 pid: 3135 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746143776.426547:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391ca80 00000100:00100000:0.0:1746143776.431065:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.431176:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622464000 00000100:00100000:0.0:1746143776.431179:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.431187:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622464000 00000100:00100000:3.0:1746143776.431239:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11674 00000100:00100000:3.0:1746143776.431246:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+50:32080:x1830963622464000:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143776.431261:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.431275:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac0a expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.431298:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 51 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.431306:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8a76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abee expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.431311:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.431312:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.431315:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->3219455] (req 3145728->3219455) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 51 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.431339:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8a76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abee expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.431348:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8a76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abee expref: 29 pid: 3135 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746143776.431358:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626723328:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.431373:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622463872 00000100:00100000:2.0:1746143776.431381:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622463872 00002000:00100000:2.0:1746143776.431423:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3911680->4194303) req@ffff88009391df80 x1830963622463872/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.431433:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391df80 with x1830963622463872 ext(3911680->4194303) 00010000:00010000:2.0:1746143776.431442:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 44 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.431455:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 44 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.431457:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 51 pid: 12328 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143776.431461:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391df80 00010000:00010000:3.0:1746143776.431465:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 51 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143776.431471:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626723456:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.431481:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1409 00000100:00100000:3.0:1746143776.431487:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143776.431488:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622463872:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143776.437320:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626723328:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143776.437331:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626723456:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143776.437459:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->3219455] (req 3145728->3219455) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 51 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.437476:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55cc00, rc 0) 00000100:00100000:3.0:1746143776.437528:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+51:32080:x1830963622464000:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6281us (6474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.437535:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11674 00000100:00100000:1.0:1746143776.439336:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.439401:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963622463872:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7905us (8214us total) trans 21474840294 rc 0/0 00000100:00100000:2.0:1746143776.439415:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1409 00002000:00100000:2.0:1746143776.439427:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3911680->4194303) req@ffff88009391df80 x1830963622463872/t21474840294(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/448 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.439437:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391df80 with x1830963622463872 ext(3911680->4194303) 00010000:00010000:2.0:1746143776.439449:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 46 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.439462:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 46 pid: 3135 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746143776.439470:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391df80 00000100:00100000:3.0:1746143776.439471:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622464128 00000100:00100000:3.0:1746143776.439477:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622464128 00010000:00010000:3.0:1746143776.439505:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8a76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abee expref: 30 pid: 3135 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746143776.439849:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5481 00000100:00100000:3.0:1746143776.439857:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622464128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143776.439871:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143776.439889:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8a76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abee expref: 30 pid: 3135 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.439897:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8a76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abee expref: 30 pid: 3135 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.439941:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73a8a76 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abee expref: 30 pid: 3135 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.439962:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.440034:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.440165:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622464256 00000100:00100000:2.0:1746143776.440172:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622464256 00010000:00010000:2.0:1746143776.440196:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 51 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143776.440230:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5482 00000100:00100000:2.0:1746143776.440235:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+51:2008:x1830963622464256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143776.440246:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143776.440259:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 51 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.440268:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 51 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.440285:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73a8a37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd2 expref: 51 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.440310:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.440312:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.440319:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 50 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.440332:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 50 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.440366:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 50 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143776.440378:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626723584:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143776.440422:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622464128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 564us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.440429:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5481 00000100:00100000:2.0:1746143776.440437:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.445448:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.445694:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626723584:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143776.445719:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143776.445771:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+50:2008:x1830963622464256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5533us (5735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.445783:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5482 00000100:00100000:2.0:1746143776.445817:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622464384 00000100:00100000:2.0:1746143776.445822:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622464384 00010000:00010000:2.0:1746143776.445845:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 46 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143776.445868:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5483 00000100:00100000:2.0:1746143776.445874:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622464384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143776.445888:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143776.445909:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 46 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.445962:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 46 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.445987:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76600/0x87925e4cb73a8a84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abf5 expref: 46 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.446014:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.446016:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.446024:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.446032:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.446040:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.446041:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.446044:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.446050:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.446078:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143776.446090:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626723712:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143776.446161:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143776.446168:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626723840:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143776.446184:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.446369:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.446412:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622464640 00000100:00100000:2.0:1746143776.446415:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622464640 00002000:00100000:2.0:1746143776.446447:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3215360->3219455) req@ffff88009391ea00 x1830963622464640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.446456:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ea00 with x1830963622464640 ext(3215360->3219455) 00002000:00010000:2.0:1746143776.446461:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391ea00 00000100:00100000:2.0:1746143776.446478:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3338 00000100:00100000:2.0:1746143776.446484:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+50:2008:x1830963622464640:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143776.446608:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+50:2008:x1830963622464640:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 124us (456us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143776.446614:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3338 00002000:00100000:2.0:1746143776.446619:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3215360->3219455) req@ffff88009391ea00 x1830963622464640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.446626:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ea00 with x1830963622464640 ext(3215360->3219455) 00002000:00010000:2.0:1746143776.446637:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391ea00 00000100:00100000:2.0:1746143776.450168:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626723712:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143776.450183:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626723840:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143776.450214:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143776.450272:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963622464384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4396us (4837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.450282:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5483 00000100:00100000:0.0:1746143776.451724:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.451807:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622464896 00000100:00100000:2.0:1746143776.451814:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622464896 00002000:00100000:2.0:1746143776.451861:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff88009391c700 x1830963622464896/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.451871:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c700 with x1830963622464896 ext(3145728->4194303) 00002000:00010000:2.0:1746143776.451875:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391c700 00000100:00100000:2.0:1746143776.451894:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3339 00000100:00100000:2.0:1746143776.451902:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2010:x1830963622464896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143776.458342:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.458394:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.458499:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622465152 00000100:00100000:3.0:1746143776.458513:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622465152 00002000:00100000:3.0:1746143776.458568:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff88009391c380 x1830963622465152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.458579:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c380 with x1830963622465152 ext(3145728->4194303) 00002000:00010000:3.0:1746143776.458585:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391c380 00000100:00100000:3.0:1746143776.458609:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622465408 00000100:00100000:3.0:1746143776.458611:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622465408 00002000:00100000:3.0:1746143776.458624:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3219456->4194303) req@ffff88009391c000 x1830963622465408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.458631:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c000 with x1830963622465408 ext(3219456->4194303) 00002000:00010000:3.0:1746143776.458635:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391c000 00000100:00100000:2.0:1746143776.458636:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3340 00000100:00100000:2.0:1746143776.458649:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622465152:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143776.458672:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3341 00000100:00100000:3.0:1746143776.458679:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+50:2008:x1830963622465408:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143776.460321:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2010:x1830963622464896:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8415us (8596us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143776.460332:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3339 00002000:00100000:2.0:1746143776.460340:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff88009391c700 x1830963622464896/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.460348:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c700 with x1830963622464896 ext(3145728->4194303) 00002000:00010000:2.0:1746143776.460353:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391c700 00000100:00100000:2.0:1746143776.467392:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622465152:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8736us (9046us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143776.467406:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3340 00002000:00100000:2.0:1746143776.467417:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff88009391c380 x1830963622465152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.467428:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c380 with x1830963622465152 ext(3145728->4194303) 00002000:00010000:2.0:1746143776.467433:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391c380 00000100:00100000:0.0:1746143776.469857:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.470032:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622465536 00000100:00100000:3.0:1746143776.470040:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622465536 00000100:00100000:3.0:1746143776.470082:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11675 00000100:00100000:3.0:1746143776.470089:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32083:x1830963622465536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.470103:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.470117:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac11 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.470139:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 51 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.470145:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143776.470147:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143776.470150:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.470174:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 51 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.470182:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 51 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143776.470192:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626723968:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143776.470248:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143776.470316:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+50:2008:x1830963622465408:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 11636us (11920us total) trans 0 rc 974848/974848 00000100:00100000:2.0:1746143776.470324:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3341 00002000:00100000:2.0:1746143776.470332:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3219456->4194303) req@ffff88009391c000 x1830963622465408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 974848/974848 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.470340:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c000 with x1830963622465408 ext(3219456->4194303) 00010000:00010000:2.0:1746143776.470345:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 50 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.470355:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 50 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746143776.470361:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009391c000 00000100:00100000:3.0:1746143776.473454:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626723968:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143776.473481:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.473498:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:3.0:1746143776.473542:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32083:x1830963622465536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3452us (3689us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.473549:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11675 00000100:00100000:0.0:1746143776.475384:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.475476:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622465664 00000100:00100000:2.0:1746143776.475483:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622465664 00002000:00100000:2.0:1746143776.475522:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3219455) req@ffff88009391dc00 x1830963622465664/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.475531:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391dc00 with x1830963622465664 ext(3145728->3219455) 00010000:00010000:2.0:1746143776.475537:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 50 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.475548:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 50 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746143776.475554:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009391dc00 00000100:00100000:2.0:1746143776.475580:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1410 00000100:00100000:2.0:1746143776.475587:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+50:2011:x1830963622465664:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143776.477980:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.478475:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622465792 00000100:00100000:3.0:1746143776.478484:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622465792 00000100:00100000:3.0:1746143776.478573:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11676 00000100:00100000:3.0:1746143776.478582:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+52:2009:x1830963622465792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.478596:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.478610:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73a8aa7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac18 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143776.478656:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626724096:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143776.478733:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143776.480229:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626724096:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143776.480248:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73a8aa7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac18 expref: 55 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.480258:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73a8aa7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac18 expref: 55 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.480268:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c000, rc 0) 00000100:00100000:3.0:1746143776.480302:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+54:2009:x1830963622465792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1721us (2327us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143776.480310:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11676 00000100:00100000:2.0:1746143776.481261:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+52:2011:x1830963622465664:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5672us (5877us total) trans 17179872972 rc 0/0 00000100:00100000:2.0:1746143776.481269:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1410 00002000:00100000:2.0:1746143776.481278:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3219455) req@ffff88009391dc00 x1830963622465664/t17179872972(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/448 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.481287:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391dc00 with x1830963622465664 ext(3145728->3219455) 00010000:00010000:2.0:1746143776.481294:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 52 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.481304:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 52 pid: 12328 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746143776.481310:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009391dc00 00000100:00100000:0.0:1746143776.484134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.485792:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622466048 00000100:00100000:2.0:1746143776.485805:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622466048 00002000:00100000:2.0:1746143776.485858:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88009391d500 x1830963622466048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.485868:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d500 with x1830963622466048 ext(4194304->4780031) 00002000:00010000:2.0:1746143776.485874:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391d500 00000100:00100000:2.0:1746143776.485904:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3342 00000100:00100000:2.0:1746143776.485927:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963622466048:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143776.486694:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.487823:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622466176 00000100:00100000:3.0:1746143776.487832:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622466176 00010000:00010000:3.0:1746143776.487867:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 52 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746143776.487908:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5484 00000100:00100000:3.0:1746143776.487941:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+52:2008:x1830963622466176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143776.487958:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143776.487979:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 52 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.487991:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 52 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.488979:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73a8a99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3219455) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac0a expref: 52 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.489011:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.489014:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.489023:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.489031:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.489071:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143776.489085:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626724224:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143776.489513:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143776.495405:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963622466048:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9476us (11265us total) trans 0 rc 585728/585728 00000100:00100000:2.0:1746143776.495419:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3342 00002000:00100000:2.0:1746143776.495433:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88009391d500 x1830963622466048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.495443:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d500 with x1830963622466048 ext(4194304->4780031) 00002000:00010000:2.0:1746143776.495450:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391d500 00000100:00100000:3.0:1746143776.495455:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626724224:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143776.495476:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143776.495994:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+51:2008:x1830963622466176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8062us (9300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.496007:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5484 00000100:00100000:0.0:1746143776.496212:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.496303:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622466432 00000100:00100000:3.0:1746143776.496310:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622466432 00002000:00100000:3.0:1746143776.496342:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff88009391f100 x1830963622466432/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.496351:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f100 with x1830963622466432 ext(3145728->4194303) 00002000:00010000:3.0:1746143776.496354:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391f100 00000100:00100000:0.0:1746143776.496663:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3343 00000100:00100000:0.0:1746143776.496672:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622466432:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143776.501884:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.501977:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.502034:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622466816 00000100:00100000:3.0:1746143776.502044:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622466816 00000100:00100000:3.0:1746143776.502107:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11677 00000100:00100000:3.0:1746143776.502116:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+51:2009:x1830963622466816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.502141:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.502160:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a8aae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac26 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.502184:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.502186:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.502196:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a8aae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac26 expref: 52 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.502222:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a8aae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac26 expref: 52 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.502234:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d400, rc 0) 00000100:00100000:3.0:1746143776.502287:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+52:2009:x1830963622466816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 171us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.502293:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11677 00000100:00100000:2.0:1746143776.502717:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622466688 00000100:00100000:2.0:1746143776.502721:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622466688 00000100:00100000:2.0:1746143776.502763:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12832 00000100:00100000:2.0:1746143776.502770:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32086:x1830963622466688:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143776.502785:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.502798:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8ab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac1f expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.502876:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.502888:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.502898:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.502944:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ac3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.502952:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.502958:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.504953:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73a8aca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.504973:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73a8aca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.504983:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73a8aca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143776.504994:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143776.505086:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505092:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505098:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505104:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505109:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408cc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.505112:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505118:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505134:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143776.505137:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.505141:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505147:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8abc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505181:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505186:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505190:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505193:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ce00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.505195:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505199:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505205:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9de00) 00010000:00010000:2.0:1746143776.505207:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.505209:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ac3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505213:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ac3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.505264:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8ab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac1f expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.505276:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73a8aca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac1f expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.505282:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.505285:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143776.505287:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c800, rc 0) 00000100:00100000:2.0:1746143776.505360:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32086:x1830963622466688:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2589us (3381us total) trans 8589943572 rc 0/0 00000100:00100000:2.0:1746143776.505368:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12832 00000100:00100000:2.0:1746143776.506037:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622466432:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9366us (9824us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143776.506045:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3343 00002000:00100000:2.0:1746143776.506054:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff88009391f100 x1830963622466432/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.506063:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f100 with x1830963622466432 ext(3145728->4194303) 00002000:00010000:2.0:1746143776.506067:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391f100 00000100:00100000:0.0:1746143776.507563:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.509407:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622467072 00000100:00100000:1.0:1746143776.509423:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622467072 00000100:00100000:1.0:1746143776.509478:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4688 00000100:00100000:1.0:1746143776.509487:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:32076:x1830963622467072:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143776.509736:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:32076:x1830963622467072:12345-192.168.202.3@tcp:35:cat.0 Request processed in 249us (2177us total) trans 8589943573 rc 0/0 00000100:00100000:1.0:1746143776.509742:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4688 00000100:00100000:0.0:1746143776.513842:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.514859:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.514957:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622467456 00000100:00100000:3.0:1746143776.514969:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622467456 00000100:00100000:2.0:1746143776.514977:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622467328 00000100:00100000:2.0:1746143776.514981:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622467328 00002000:00100000:2.0:1746143776.515018:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88009719e300 x1830963622467328/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143776.515022:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 748 00002000:00100000:2.0:1746143776.515027:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719e300 with x1830963622467328 ext(4194304->4780031) 00000100:00100000:3.0:1746143776.515029:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622467456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00002000:00010000:2.0:1746143776.515031:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719e300 00010000:00010000:3.0:1746143776.515045:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143776.515045:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3344 00000100:00100000:2.0:1746143776.515049:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622467328:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143776.515073:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73a8aca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac1f expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.515091:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.515095:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143776.515135:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622467456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.515140:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 748 00000100:00100000:2.0:1746143776.526300:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622467328:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11235us (12456us total) trans 0 rc 585728/585728 00000100:00100000:2.0:1746143776.526315:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3344 00002000:00100000:2.0:1746143776.526329:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88009719e300 x1830963622467328/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.526339:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719e300 with x1830963622467328 ext(4194304->4780031) 00002000:00010000:2.0:1746143776.526346:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719e300 00000100:00100000:2.0:1746143776.533405:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.533450:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622467712 00000100:00100000:1.0:1746143776.533461:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622467712 00000100:00100000:1.0:1746143776.533518:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4689 00000100:00100000:1.0:1746143776.533528:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e24a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32083:x1830963622467712:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143776.533765:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e24a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32083:x1830963622467712:12345-192.168.202.3@tcp:35:cat.0 Request processed in 238us (371us total) trans 8589943574 rc 0/0 00000100:00100000:1.0:1746143776.533773:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4689 00000100:00100000:0.0:1746143776.559743:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.560022:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622467840 00000100:00100000:1.0:1746143776.560032:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622467840 00000100:00100000:1.0:1746143776.560107:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11678 00000100:00100000:1.0:1746143776.560115:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:32086:x1830963622467840:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143776.560138:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.560160:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac2d expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.560198:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 44 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.560207:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.560214:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.560216:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.560220:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2609152->3141631] (req 2609152->3141631) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.562085:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.562105:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 33 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.562121:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626724352:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.562823:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 44 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.562833:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 44 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.562842:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626724480:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.562864:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.566628:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626724352:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.566645:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626724480:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.566679:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2609152->3141631] (req 2609152->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.566700:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b25a00, rc 0) 00000100:00100000:1.0:1746143776.566765:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:32086:x1830963622467840:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6649us (7033us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.566778:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11678 00000100:00100000:0.0:1746143776.569467:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.571350:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.572146:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622467968 00000100:00100000:1.0:1746143776.572147:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622468096 00000100:00100000:3.0:1746143776.572157:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622467968 00000100:00100000:1.0:1746143776.572157:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622468096 00010000:00010000:3.0:1746143776.572202:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 45 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.573062:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 33 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143776.573413:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5485 00000100:00100000:2.0:1746143776.573425:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622467968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143776.573440:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143776.573464:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 45 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.573474:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 45 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.573500:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8a8b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abfc expref: 45 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.573521:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5486 00000100:00100000:1.0:1746143776.573528:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2011:x1830963622468096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.573536:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.573544:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 33 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.573552:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 33 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.573564:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76400/0x87925e4cb73a8a92 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac03 expref: 33 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.573584:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.573586:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.573593:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.573601:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.573635:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.573648:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626724608:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143776.573703:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143776.573725:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622467968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 304us (4266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.573732:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5485 00000100:00100000:1.0:1746143776.573738:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.579304:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.579578:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622468352 00000100:00100000:2.0:1746143776.579589:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622468352 00000100:00100000:2.0:1746143776.579727:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12833 00000100:00100000:2.0:1746143776.579737:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:32090:x1830963622468352:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143776.579769:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.579791:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac34 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.579878:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.579891:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.579901:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.579951:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8aed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.579958:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.579964:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580065:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580075:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580080:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143776.580092:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143776.580178:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580184:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580188:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580193:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580198:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ce00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.580202:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580208:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580218:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143776.580221:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.580224:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580229:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8ae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580239:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580244:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8aed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580253:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8aed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580256:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408cc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.580259:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8aed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580263:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8aed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580268:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d100) 00010000:00010000:2.0:1746143776.580270:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.580271:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8aed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580275:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8aed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.580309:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac34 expref: 269 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.580320:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac34 expref: 268 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.580325:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.580327:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143776.580329:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c600, rc 0) 00000100:00100000:2.0:1746143776.580377:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:32090:x1830963622468352:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 642us (1087us total) trans 8589943575 rc 0/0 00000100:00100000:2.0:1746143776.580383:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12833 00000100:00100000:0.0:1746143776.580955:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.581473:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622468608 00000100:00100000:3.0:1746143776.581480:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622468608 00000100:00100000:0.0:1746143776.581502:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626724608:192.168.202.3@tcp:105: 00002000:00100000:3.0:1746143776.581514:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2609152->2613247) req@ffff88009719ea00 x1830963622468608/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746143776.581521:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143776.581523:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ea00 with x1830963622468608 ext(2609152->2613247) 00002000:00010000:3.0:1746143776.581527:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719ea00 00000100:00100000:3.0:1746143776.581543:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3345 00000100:00100000:0.0:1746143776.581544:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2011:x1830963622468096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8017us (10202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.581549:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2008:x1830963622468608:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143776.581551:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5486 00000100:00100000:3.0:1746143776.581667:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2008:x1830963622468608:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 117us (712us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143776.581687:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3345 00002000:00100000:3.0:1746143776.581693:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2609152->2613247) req@ffff88009719ea00 x1830963622468608/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.581700:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ea00 with x1830963622468608 ext(2609152->2613247) 00002000:00010000:3.0:1746143776.581703:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719ea00 00000100:00100000:0.0:1746143776.584137:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.584246:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622468864 00000100:00100000:1.0:1746143776.584255:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622468864 00000100:00100000:1.0:1746143776.584306:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4690 00000100:00100000:1.0:1746143776.584313:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:32090:x1830963622468864:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143776.584536:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:32090:x1830963622468864:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 223us (408us total) trans 8589943576 rc 0/0 00000100:00100000:1.0:1746143776.584542:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4690 00000100:00100000:0.0:1746143776.588355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.588421:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622469120 00000100:00100000:3.0:1746143776.588432:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622469120 00002000:00100000:3.0:1746143776.588495:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3137536->3141631) req@ffff88009719fb80 x1830963622469120/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.588507:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719fb80 with x1830963622469120 ext(3137536->3141631) 00002000:00010000:3.0:1746143776.588513:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719fb80 00000100:00100000:3.0:1746143776.588546:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3346 00000100:00100000:3.0:1746143776.588554:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622469120:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143776.588720:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622469120:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 166us (378us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143776.588725:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3346 00002000:00100000:3.0:1746143776.588731:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3137536->3141631) req@ffff88009719fb80 x1830963622469120/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.588737:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719fb80 with x1830963622469120 ext(3137536->3141631) 00002000:00010000:3.0:1746143776.588740:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719fb80 00000100:00100000:0.0:1746143776.595244:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.596020:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622469376 00000100:00100000:1.0:1746143776.596033:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622469376 00000100:00100000:1.0:1746143776.596098:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4691 00000100:00100000:1.0:1746143776.596107:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32086:x1830963622469376:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143776.596388:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32086:x1830963622469376:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 282us (1155us total) trans 8589943577 rc 0/0 00000100:00100000:1.0:1746143776.596395:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4691 00000100:00100000:0.0:1746143776.602812:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.603970:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622469504 00000100:00100000:1.0:1746143776.603982:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622469504 00000100:00100000:1.0:1746143776.604031:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11679 00000100:00100000:1.0:1746143776.604040:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+52:32090:x1830963622469504:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143776.604061:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.604081:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac3b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.604128:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.604135:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a8aae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac26 expref: 53 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.604141:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.604142:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.604146:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3260416->3575807] (req 3260416->3575807) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 53 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.604181:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a8aae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac26 expref: 53 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.604194:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a8aae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac26 expref: 53 pid: 12328 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.604207:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626724736:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.604313:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 29 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.604321:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 29 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.604329:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626724864:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.604350:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f2fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.606703:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626724736:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.606717:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626724864:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.606745:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3260416->3575807] (req 3260416->3575807) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 53 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.606762:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136600, rc 0) 00000100:00100000:1.0:1746143776.606897:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+53:32090:x1830963622469504:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2856us (4097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.606907:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11679 00000100:00100000:0.0:1746143776.607154:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.607218:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622469760 00000100:00100000:1.0:1746143776.607224:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622469760 00010000:00010000:1.0:1746143776.607248:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143776.607281:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5487 00000100:00100000:1.0:1746143776.607290:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622469760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.607303:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.607343:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.607353:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.607376:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8aa0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac11 expref: 30 pid: 12328 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143776.607407:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.607434:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622469760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 146us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.607441:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5487 00000100:00100000:0.0:1746143776.607567:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.608152:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622469632 00000100:00100000:1.0:1746143776.608156:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622469632 00010000:00010000:1.0:1746143776.608174:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a8aae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac26 expref: 53 pid: 12328 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.608188:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5488 00000100:00100000:1.0:1746143776.608193:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+53:2009:x1830963622469632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.608201:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.608210:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a8aae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac26 expref: 53 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.608219:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a8aae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac26 expref: 53 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.608231:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73a8aae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac26 expref: 53 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.608767:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.608769:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.608776:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 52 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.608788:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 52 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.608819:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 52 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.608832:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626724992:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143776.608942:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f2fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.610752:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626724992:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143776.610759:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143776.610771:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.610806:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+52:2009:x1830963622469632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2612us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.610816:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5488 00000100:00100000:2.0:1746143776.610819:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622470016 00000100:00100000:2.0:1746143776.610826:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622470016 00002000:00100000:2.0:1746143776.610868:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3260416->3264511) req@ffff880095e33480 x1830963622470016/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.610878:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33480 with x1830963622470016 ext(3260416->3264511) 00002000:00010000:2.0:1746143776.610882:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e33480 00000100:00100000:2.0:1746143776.610958:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3347 00000100:00100000:2.0:1746143776.610966:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+52:2008:x1830963622470016:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143776.611092:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+52:2008:x1830963622470016:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 128us (333us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143776.611098:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3347 00002000:00100000:2.0:1746143776.611103:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (3260416->3264511) req@ffff880095e33480 x1830963622470016/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.611111:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33480 with x1830963622470016 ext(3260416->3264511) 00002000:00010000:2.0:1746143776.611114:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e33480 00000100:00100000:2.0:1746143776.615564:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.615648:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622470272 00000100:00100000:3.0:1746143776.615660:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622470272 00002000:00100000:3.0:1746143776.615708:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3571712->3575807) req@ffff88007f648700 x1830963622470272/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.615720:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648700 with x1830963622470272 ext(3571712->3575807) 00002000:00010000:3.0:1746143776.615726:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648700 00000100:00100000:3.0:1746143776.615746:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3348 00000100:00100000:3.0:1746143776.615753:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+52:2008:x1830963622470272:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143776.616037:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+52:2008:x1830963622470272:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 277us (478us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143776.616048:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3348 00002000:00100000:3.0:1746143776.616056:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3571712->3575807) req@ffff88007f648700 x1830963622470272/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.616064:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648700 with x1830963622470272 ext(3571712->3575807) 00002000:00010000:3.0:1746143776.616070:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648700 00000100:00100000:0.0:1746143776.727609:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.727716:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622470528 00000100:00100000:3.0:1746143776.727728:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622470528 00000100:00100000:3.0:1746143776.727797:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12834 00000100:00100000:3.0:1746143776.727804:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32094:x1830963622470528:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143776.727827:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.727843:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac42 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.727907:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.727980:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.727990:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728002:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a8b17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728007:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a8b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728011:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a8b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728088:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8b1e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728096:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8b1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728101:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8b1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143776.728111:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143776.728161:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728166:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728171:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728175:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728179:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143776.728182:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728186:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728194:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143776.728196:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143776.728198:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728202:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8b10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728231:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a8b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728235:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a8b17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728243:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a8b17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728246:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55cc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143776.728248:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a8b17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728251:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a8b17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728256:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fee7800) 00010000:00010000:3.0:1746143776.728257:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143776.728259:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a8b17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728262:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a8b17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.728287:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac42 expref: 19 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.728297:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8b1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac42 expref: 18 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.728301:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.728302:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143776.728304:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55dc00, rc 0) 00000100:00100000:3.0:1746143776.728350:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32094:x1830963622470528:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 547us (752us total) trans 8589943578 rc 0/0 00000100:00100000:3.0:1746143776.728355:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12834 00000100:00100000:0.0:1746143776.732578:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.733215:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622470656 00000100:00100000:1.0:1746143776.733227:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622470656 00000100:00100000:1.0:1746143776.733288:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 749 00000100:00100000:1.0:1746143776.733296:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622470656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.733311:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.733338:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8b1e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac42 expref: 18 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.733360:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143776.733364:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.733566:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622470656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 269us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.733574:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 749 00000100:00100000:0.0:1746143776.740842:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.742654:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622470912 00000100:00100000:2.0:1746143776.742741:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622470912 00000100:00100000:2.0:1746143776.744092:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12835 00000100:00100000:2.0:1746143776.744105:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:32098:x1830963622470912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143776.744133:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.744155:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac49 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.744241:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744257:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744268:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744282:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73a8b3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744287:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73a8b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744291:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73a8b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744393:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b41 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744403:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744409:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143776.744417:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143776.744495:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744501:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744506:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744511:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744517:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ce00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.744521:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744527:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744535:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143776.744538:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.744541:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744545:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73a8b33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744568:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73a8b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744572:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73a8b3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744576:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73a8b3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744579:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408c200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.744581:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73a8b3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744585:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73a8b3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744589:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d800) 00010000:00010000:2.0:1746143776.744590:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.744593:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73a8b3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744597:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73a8b3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.744629:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac49 expref: 272 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.744638:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b41 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac49 expref: 271 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.744644:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.744645:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143776.744647:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408de00, rc 0) 00000100:00100000:2.0:1746143776.744716:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+271:32098:x1830963622470912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 614us (3884us total) trans 8589943579 rc 0/0 00000100:00100000:2.0:1746143776.744722:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12835 00000100:00100000:0.0:1746143776.752987:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.753028:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.753080:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.753265:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622471168 00000100:00100000:1.0:1746143776.753275:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622471168 00000100:00100000:1.0:1746143776.753324:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 750 00000100:00100000:1.0:1746143776.753332:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+271:2010:x1830963622471168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.753347:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.753373:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b41 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac49 expref: 271 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.753393:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143776.753398:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.753440:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+270:2010:x1830963622471168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 108us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.753446:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 750 00000100:00100000:3.0:1746143776.753448:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622471040 00000100:00100000:3.0:1746143776.753452:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622471040 00000100:00100000:3.0:1746143776.753611:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622471296 00000100:00100000:3.0:1746143776.753614:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622471296 00000100:00100000:2.0:1746143776.753699:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11680 00000100:00100000:2.0:1746143776.753707:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:32094:x1830963622471040:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143776.753721:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.753736:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac50 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143776.753767:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11681 00000100:00100000:0.0:1746143776.753774:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622471296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143776.753781:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143776.753788:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8b56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac57 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143776.753835:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626725120:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143776.753900:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00010000:00010000:2.0:1746143776.754054:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a887e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aad6 expref: 45 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.754062:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a8988 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab5b expref: 33 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.754074:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a88a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab00 expref: 11 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.754080:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.754081:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.754085:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1138688->1482751] (req 1138688->1482751) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.754106:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a88a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab00 expref: 11 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.754117:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a88a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab00 expref: 11 pid: 12328 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143776.754126:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626725248:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143776.754163:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a8988 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab5b expref: 33 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.754171:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a8988 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab5b expref: 33 pid: 12327 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143776.754179:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626725376:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143776.754201:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a887e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aad6 expref: 45 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.754212:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a887e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aad6 expref: 45 pid: 9587 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746143776.754219:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626725504:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.754232:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561000 going to sleep for 11 seconds 00002000:00010000:1.0:1746143776.756945:0:12327:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143776 -> 1746143777 00002000:00010000:1.0:1746143776.756953:0:12327:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143776 -> 1746143777 00000100:00100000:1.0:1746143776.756976:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626725120:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143776.757009:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8b56 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac57 expref: 45 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.757023:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8b56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac57 expref: 45 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.757033:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3000, rc 0) 00000100:00100000:1.0:1746143776.757077:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622471296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3302us (3995us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143776.757088:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11681 00000100:00100000:0.0:1746143776.757467:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.757557:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622471424 00000100:00100000:3.0:1746143776.757564:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622471424 00010000:00010000:3.0:1746143776.757679:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a88a8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab00 expref: 12 pid: 12328 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746143776.757702:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5489 00000100:00100000:3.0:1746143776.757709:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622471424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143776.757711:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626725248:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.757721:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626725376:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143776.757723:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143776.757729:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626725504:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143776.757734:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a88a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab00 expref: 12 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.757748:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a88a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab00 expref: 12 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.757766:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8be00/0x87925e4cb73a88a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab00 expref: 12 pid: 12328 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746143776.757783:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143776.757807:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622471424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 99us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.757813:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5489 00010000:00010000:2.0:1746143776.757822:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1138688->1482751] (req 1138688->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.757832:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408cc00, rc 0) 00000100:00100000:2.0:1746143776.757853:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:32094:x1830963622471040:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4147us (4823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.757860:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11680 00000100:00100000:3.0:1746143776.759235:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.759369:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622471552 00000100:00100000:1.0:1746143776.759375:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622471552 00010000:00010000:1.0:1746143776.759397:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a8988 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab5b expref: 33 pid: 12327 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.759416:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5490 00000100:00100000:1.0:1746143776.759422:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2010:x1830963622471552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.759432:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.759446:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a8988 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab5b expref: 33 pid: 12327 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.760245:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a8988 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab5b expref: 33 pid: 12327 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.760266:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a8988 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab5b expref: 33 pid: 12327 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.760280:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.760321:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2010:x1830963622471552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 899us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.760328:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5490 00000100:00100000:0.0:1746143776.760557:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.760757:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622471680 00000100:00100000:1.0:1746143776.760763:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622471680 00010000:00010000:1.0:1746143776.760779:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a887e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aad6 expref: 44 pid: 9587 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143776.760807:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5491 00000100:00100000:1.0:1746143776.760813:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622471680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.760822:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.760833:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a887e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aad6 expref: 44 pid: 9587 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.760841:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a887e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aad6 expref: 44 pid: 9587 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.760853:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73a887e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aad6 expref: 44 pid: 9587 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143776.760863:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.760865:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.760871:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.760878:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.760908:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.760943:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626725632:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143776.761893:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f2fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.763018:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.763128:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622471936 00000100:00100000:2.0:1746143776.763137:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622471936 00000100:00100000:2.0:1746143776.763187:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12836 00000100:00100000:2.0:1746143776.763246:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:32101:x1830963622471936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143776.763271:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.763291:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8b5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac5e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.763427:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763440:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763450:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763461:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763466:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763470:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763569:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73a8b72 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763577:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73a8b72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763583:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73a8b72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143776.763591:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143776.763682:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763689:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763697:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763703:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763708:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b47bc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.763712:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763720:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763730:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143776.763733:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.763736:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763741:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8b64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763773:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763778:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763782:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763786:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408de00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.763788:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763796:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763802:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9dd00) 00010000:00010000:2.0:1746143776.763803:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.763805:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763810:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.763847:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8b5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac5e expref: 20 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.763858:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73a8b72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac5e expref: 19 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.763864:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.763866:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143776.763868:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c800, rc 0) 00000100:00100000:2.0:1746143776.763951:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32101:x1830963622471936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 757us (940us total) trans 8589943580 rc 0/0 00000100:00100000:2.0:1746143776.763958:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12836 00000100:00100000:2.0:1746143776.767246:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.767321:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622472192 00000100:00100000:3.0:1746143776.767330:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622472192 00000100:00100000:1.0:1746143776.767357:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626725632:192.168.202.3@tcp:105: 00002000:00100000:3.0:1746143776.767379:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1138688->1142783) req@ffff880093727800 x1830963622472192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143776.767379:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143776.767389:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093727800 with x1830963622472192 ext(1138688->1142783) 00002000:00010000:3.0:1746143776.767394:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093727800 00000100:00100000:3.0:1746143776.767421:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3349 00000100:00100000:3.0:1746143776.767428:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2010:x1830963622472192:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143776.767464:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622471680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6649us (6907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.767473:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5491 00000100:00100000:3.0:1746143776.767602:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2010:x1830963622472192:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 175us (368us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143776.767608:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3349 00002000:00100000:3.0:1746143776.767612:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1138688->1142783) req@ffff880093727800 x1830963622472192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.767619:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093727800 with x1830963622472192 ext(1138688->1142783) 00002000:00010000:3.0:1746143776.767622:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093727800 00000100:00100000:0.0:1746143776.770639:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.770688:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622472320 00000100:00100000:1.0:1746143776.770697:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622472320 00000100:00100000:1.0:1746143776.770827:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 751 00000100:00100000:1.0:1746143776.770837:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622472320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.770853:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.770880:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73a8b72 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac5e expref: 19 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.770896:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143776.770901:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.770977:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622472320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 141us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.770984:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 751 00000100:00100000:0.0:1746143776.774482:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.774849:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622472448 00000100:00100000:2.0:1746143776.774860:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622472448 00000100:00100000:2.0:1746143776.774947:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11682 00000100:00100000:2.0:1746143776.774955:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+43:32098:x1830963622472448:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143776.774976:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.774995:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac65 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.775025:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.775032:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143776.775034:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143776.775037:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 44 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.775066:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.775077:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 31 pid: 3135 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746143776.775090:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626725760:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.775172:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.775215:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.775305:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622472704 00000100:00100000:2.0:1746143776.775309:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622472704 00002000:00100000:2.0:1746143776.775336:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1478656->1482751) req@ffff880095e31f80 x1830963622472704/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.775345:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31f80 with x1830963622472704 ext(1478656->1482751) 00010000:00010000:2.0:1746143776.775361:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 32 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.775376:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 32 pid: 3135 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746143776.775381:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e31f80 00000100:00100000:2.0:1746143776.775398:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1411 00000100:00100000:2.0:1746143776.775403:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2011:x1830963622472704:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143776.775529:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2011:x1830963622472704:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 125us (315us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143776.775535:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1411 00002000:00100000:2.0:1746143776.775540:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1478656->1482751) req@ffff880095e31f80 x1830963622472704/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.775546:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31f80 with x1830963622472704 ext(1478656->1482751) 00010000:00010000:2.0:1746143776.775551:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 32 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746143776.775559:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 32 pid: 3135 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746143776.775564:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e31f80 00000100:00100000:2.0:1746143776.779959:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626725760:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143776.779997:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 44 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.780021:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408de00, rc 0) 00000100:00100000:2.0:1746143776.780067:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:32098:x1830963622472448:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5112us (5596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.780075:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11682 00000100:00100000:0.0:1746143776.781231:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.781285:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.781308:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622472832 00000100:00100000:3.0:1746143776.781315:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622472832 00000100:00100000:1.0:1746143776.781327:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622473216 00000100:00100000:1.0:1746143776.781331:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622473216 00000100:00100000:3.0:1746143776.781352:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11683 00000100:00100000:3.0:1746143776.781360:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2011:x1830963622472832:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143776.781362:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4692 00000100:00100000:1.0:1746143776.781367:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32094:x1830963622473216:12345-192.168.202.3@tcp:35:multiop.0 00010000:00010000:3.0:1746143776.781377:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.781392:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8b87 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac6c expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143776.781437:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626725888:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143776.781495:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.781601:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32094:x1830963622473216:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 232us (315us total) trans 8589943581 rc 0/0 00000100:00100000:1.0:1746143776.781608:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4692 00000100:00100000:1.0:1746143776.781693:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.781888:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622473344 00000100:00100000:3.0:1746143776.781892:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622473344 00002000:00100000:3.0:1746143776.782034:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1138688->1482751) req@ffff880091d4ce00 x1830963622473344/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.782043:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4ce00 with x1830963622473344 ext(1138688->1482751) 00010000:00010000:3.0:1746143776.782049:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 32 pid: 3135 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746143776.782061:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 32 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143776.782066:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d4ce00 00000100:00100000:3.0:1746143776.782087:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1412 00000100:00100000:3.0:1746143776.782092:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2008:x1830963622473344:12345-192.168.202.3@tcp:4:multiop.0 00002000:00010000:3.0:1746143776.782846:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143776 -> 1746143777 00002000:00010000:3.0:1746143776.782850:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143776 -> 1746143777 00002000:00010000:3.0:1746143776.782852:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143776 -> 1746143777 00000100:00100000:3.0:1746143776.782865:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626725888:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143776.782886:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8b87 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac6c expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.782897:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73a8b87 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac6c expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.782908:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:3.0:1746143776.782965:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2011:x1830963622472832:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1605us (1738us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143776.782974:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11683 00000100:00100000:3.0:1746143776.788346:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2008:x1830963622473344:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 6240us (6639us total) trans 21474840295 rc 0/0 00000100:00100000:3.0:1746143776.788360:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1412 00002000:00100000:3.0:1746143776.788371:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1138688->1482751) req@ffff880091d4ce00 x1830963622473344/t21474840295(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/448 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.788381:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4ce00 with x1830963622473344 ext(1138688->1482751) 00010000:00010000:3.0:1746143776.788391:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143776.788404:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143776.788410:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d4ce00 00000100:00100000:0.0:1746143776.793519:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.793615:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622473472 00000100:00100000:2.0:1746143776.793626:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622473472 00010000:00010000:2.0:1746143776.793669:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143776.793752:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5492 00000100:00100000:2.0:1746143776.793760:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2009:x1830963622473472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143776.793774:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143776.793793:0:16784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143776 -> 1746143777 00002000:00010000:2.0:1746143776.793795:0:16784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143776 -> 1746143777 00010000:00010000:2.0:1746143776.793800:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.793812:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.793837:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73a8b4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1482751) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac50 expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.794042:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.794044:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.794053:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.794061:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.794094:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143776.794105:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626726016:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143776.794533:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143776.794700:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.794893:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622473600 00000100:00100000:0.0:1746143776.794897:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622473600 00000100:00100000:0.0:1746143776.794962:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11684 00000100:00100000:0.0:1746143776.794968:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:32101:x1830963622473600:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143776.794982:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143776.794994:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8b8e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac73 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.795008:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.795010:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.795014:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8b8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac73 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.795024:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8b8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac73 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.795037:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2200, rc 0) 00000100:00100000:0.0:1746143776.795068:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:32101:x1830963622473600:12345-192.168.202.3@tcp:101:cat.0 Request processed in 100us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143776.795074:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11684 00000100:00100000:2.0:1746143776.795900:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626726016:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143776.795949:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143776.795981:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2009:x1830963622473472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2222us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.795989:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5492 00000100:00100000:0.0:1746143776.798899:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.798994:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622473856 00000100:00100000:3.0:1746143776.799003:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622473856 00002000:00100000:3.0:1746143776.799048:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880090e25c00 x1830963622473856/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.799058:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25c00 with x1830963622473856 ext(1048576->2097151) 00002000:00010000:3.0:1746143776.799065:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e25c00 00000100:00100000:3.0:1746143776.799097:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3350 00000100:00100000:3.0:1746143776.799104:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2011:x1830963622473856:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143776.803839:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.804643:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622474112 00000100:00100000:2.0:1746143776.804665:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622474112 00002000:00100000:2.0:1746143776.804713:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880090e26d80 x1830963622474112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.804723:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e26d80 with x1830963622474112 ext(1048576->2097151) 00002000:00010000:2.0:1746143776.804729:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e26d80 00000100:00100000:2.0:1746143776.804752:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3351 00000100:00100000:2.0:1746143776.804759:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622474112:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143776.808210:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2011:x1830963622473856:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9091us (9307us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143776.808224:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3350 00002000:00100000:3.0:1746143776.808237:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880090e25c00 x1830963622473856/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.808246:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e25c00 with x1830963622473856 ext(1048576->2097151) 00002000:00010000:3.0:1746143776.808252:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e25c00 00000100:00100000:0.0:1746143776.816439:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.816705:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622474112:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11943us (12873us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143776.816722:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3351 00002000:00100000:2.0:1746143776.816736:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880090e26d80 x1830963622474112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.816747:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e26d80 with x1830963622474112 ext(1048576->2097151) 00002000:00010000:2.0:1746143776.816754:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e26d80 00000100:00100000:2.0:1746143776.816782:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622474368 00000100:00100000:2.0:1746143776.816790:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622474368 00002000:00100000:2.0:1746143776.816822:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880090e24700 x1830963622474368/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 504/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.816829:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e24700 with x1830963622474368 ext(2097152->3145727) 00002000:00010000:2.0:1746143776.816833:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e24700 00000100:00100000:2.0:1746143776.816848:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3352 00000100:00100000:2.0:1746143776.816856:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2008:x1830963622474368:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143776.823113:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143776.826034:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2008:x1830963622474368:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9161us (9590us total) trans 0 rc 516096/516096 00000100:00100000:2.0:1746143776.826051:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3352 00002000:00100000:2.0:1746143776.826067:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880090e24700 x1830963622474368/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 504/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 516096/516096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.826077:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e24700 with x1830963622474368 ext(2097152->3145727) 00002000:00010000:2.0:1746143776.826084:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e24700 00000100:00100000:0.0:1746143776.828287:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.829814:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622474496 00000100:00100000:2.0:1746143776.829826:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622474496 00000100:00100000:3.0:1746143776.829984:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11685 00000100:00100000:3.0:1746143776.829999:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:32098:x1830963622474496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.830022:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.830040:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac7a expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.830072:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.830079:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143776.830081:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143776.830084:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 45 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.830118:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.830130:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 33 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143776.830149:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626726144:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143776.830251:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.832742:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.832857:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.833285:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622474624 00000100:00100000:2.0:1746143776.833294:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622474624 00000100:00100000:2.0:1746143776.833341:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11686 00000100:00100000:2.0:1746143776.833349:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32101:x1830963622474624:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143776.833368:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.833385:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac81 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143776.833399:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626726144:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143776.833413:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 51 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.833421:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143776.833423:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 45 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.833423:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143776.833426:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.833436:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00010000:00010000:2.0:1746143776.833455:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 51 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.833466:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 51 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143776.833478:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626726272:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143776.833493:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+45:32098:x1830963622474496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3495us (5215us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.833500:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11685 00000100:00100000:2.0:1746143776.833533:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143776.834250:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622474752 00000100:00100000:2.0:1746143776.834255:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622474752 00002000:00100000:2.0:1746143776.834287:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2609152->3141631) req@ffff880094195880 x1830963622474752/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.834296:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195880 with x1830963622474752 ext(2609152->3141631) 00010000:00010000:2.0:1746143776.834302:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.834311:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746143776.834318:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094195880 00000100:00100000:2.0:1746143776.834731:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1413 00000100:00100000:2.0:1746143776.834740:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2009:x1830963622474752:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143776.840904:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.840974:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622475136 00000100:00100000:2.0:1746143776.840984:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622475136 00000100:00100000:2.0:1746143776.841037:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12837 00000100:00100000:2.0:1746143776.841046:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:32106:x1830963622475136:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143776.841079:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.841102:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096011c00/0x87925e4cb73a8ba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac8f expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.841166:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.841179:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.841190:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.841204:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a8bb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.841213:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a8bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.841217:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a8bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.841280:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.841289:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd9 expref: 269 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.841300:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.841329:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd9 expref: 269 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.841338:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd9 expref: 269 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143776.841350:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626726400:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.841429:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143776.841477:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.841595:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622475264 00000100:00100000:0.0:1746143776.841600:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622475264 00002000:00100000:0.0:1746143776.841627:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3260416->3575807) req@ffff880093725f80 x1830963622475264/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143776.841636:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725f80 with x1830963622475264 ext(3260416->3575807) 00010000:00010000:0.0:1746143776.841645:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 52 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143776.841655:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 52 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:0.0:1746143776.841660:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093725f80 00000100:00100000:0.0:1746143776.841674:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1414 00000100:00100000:0.0:1746143776.841679:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+52:2009:x1830963622475264:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143776.842421:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.842431:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626726272:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143776.842455:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.842470:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d67200, rc 0) 00000100:00100000:3.0:1746143776.842498:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32101:x1830963622474624:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9150us (9764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.842505:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11686 00000100:00100000:3.0:1746143776.842532:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622475008 00000100:00100000:3.0:1746143776.842536:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622475008 00000100:00100000:3.0:1746143776.842559:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12838 00000100:00100000:3.0:1746143776.842563:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+270:32105:x1830963622475008:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143776.842575:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.842587:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac88 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.842641:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842650:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842659:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842667:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842673:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842678:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842744:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a8bd4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842754:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a8bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842759:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a8bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143776.842768:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143776.842826:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842832:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842838:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842843:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842848:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55d400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143776.842851:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842857:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842865:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143776.842868:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143776.842871:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842875:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73a8bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842888:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842891:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842895:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842899:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55dc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143776.842901:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842908:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.842944:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d100) 00010000:00010000:3.0:1746143776.842946:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143776.843130:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.843136:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143776.843164:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a8bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac88 expref: 273 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.843171:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a8bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac88 expref: 272 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.843177:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.843179:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143776.843181:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.843186:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.843189:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d66400, rc 0) 00000100:00100000:3.0:1746143776.843220:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+272:32105:x1830963622475008:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 656us (800us total) trans 8589943582 rc 0/0 00000100:00100000:3.0:1746143776.843224:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12838 00000100:00100000:2.0:1746143776.845605:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2009:x1830963622474752:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10856us (12735us total) trans 21474840296 rc 0/0 00000100:00100000:2.0:1746143776.845619:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1413 00002000:00100000:2.0:1746143776.845631:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2609152->3141631) req@ffff880094195880 x1830963622474752/t21474840296(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/448 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.845648:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195880 with x1830963622474752 ext(2609152->3141631) 00010000:00010000:2.0:1746143776.845659:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 36 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.845672:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 36 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746143776.845678:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094195880 00000100:00100000:1.0:1746143776.845696:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.845715:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622475520 00000100:00100000:1.0:1746143776.845721:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622475520 00000100:00100000:2.0:1746143776.845729:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626726400:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143776.845756:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143776.845761:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4693 00000100:00100000:1.0:1746143776.845768:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:30659:x1830963622475520:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143776.845905:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:30659:x1830963622475520:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 137us (210us total) trans 8589943583 rc 0/0 00000100:00100000:1.0:1746143776.845941:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4693 00000100:00100000:0.0:1746143776.847759:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+54:2009:x1830963622475264:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6070us (6272us total) trans 17179872973 rc 0/0 00000100:00100000:0.0:1746143776.847771:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1414 00002000:00100000:0.0:1746143776.847781:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3260416->3575807) req@ffff880093725f80 x1830963622475264/t17179872973(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/448 e 0 to 0 dl 1746143787 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143776.847790:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725f80 with x1830963622475264 ext(3260416->3575807) 00010000:00010000:0.0:1746143776.847800:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 54 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143776.847811:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 54 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:0.0:1746143776.847817:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093725f80 00000100:00100000:0.0:1746143776.848473:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.848738:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.848800:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622475648 00000100:00100000:1.0:1746143776.848808:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622475648 00010000:00010000:1.0:1746143776.848840:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd9 expref: 273 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143776.849074:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622475776 00000100:00100000:1.0:1746143776.849077:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622475776 00000100:00100000:1.0:1746143776.849198:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5493 00000100:00100000:1.0:1746143776.849205:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+274:2010:x1830963622475648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.849218:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.849224:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd9 expref: 274 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143776.849234:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd9 expref: 274 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143776.849256:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73a8a45 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abd9 expref: 274 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143776.849269:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143776.849274:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.849283:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143776.849292:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143776.849409:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 752 00000100:00100000:3.0:1746143776.849418:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+273:2010:x1830963622475776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143776.849426:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143776.849441:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66400/0x87925e4cb73a8bd4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac88 expref: 273 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.849452:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.849454:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143776.849489:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+272:2010:x1830963622475776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 74us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.849499:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 752 00010000:00010000:1.0:1746143776.851081:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.851151:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+271:2010:x1830963622475648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1941us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.851160:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5493 00010000:00010000:2.0:1746143776.851177:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851186:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143776.851396:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:2.0:1746143776.851401:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143776.851421:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851434:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851445:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851451:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851456:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851462:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851467:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096011000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.851470:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851476:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851488:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143776.851491:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.851495:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851499:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73a8baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851811:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a8bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851817:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a8bb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851823:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a8bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851827:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b27000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143776.851830:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a8bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851838:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a8bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851846:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d100) 00010000:00010000:2.0:1746143776.851848:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143776.851850:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a8bb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851855:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73a8bb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.851891:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096011c00/0x87925e4cb73a8ba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac8f expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.851902:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac8f expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.851908:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.851938:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143776.851941:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27a00, rc 0) 00000100:00100000:2.0:1746143776.852640:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32106:x1830963622475136:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 11590us (11743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.852649:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12837 00000100:00100000:0.0:1746143776.857868:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.857905:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.857958:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.857986:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.858017:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.858018:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622476160 00000100:00100000:3.0:1746143776.858029:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622476160 00000100:00100000:3.0:1746143776.858078:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622476288 00000100:00100000:3.0:1746143776.858080:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622476288 00000100:00100000:3.0:1746143776.858093:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622476416 00000100:00100000:3.0:1746143776.858095:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622476416 00000100:00100000:2.0:1746143776.858097:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622475904 00000100:00100000:2.0:1746143776.858102:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622475904 00000100:00100000:3.0:1746143776.858118:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11687 00000100:00100000:3.0:1746143776.858126:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622476160:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143776.858144:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.858162:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55da00/0x87925e4cb73a8be2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac96 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.858185:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.858187:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.858197:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55da00/0x87925e4cb73a8be2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac96 expref: 13 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.858214:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55da00/0x87925e4cb73a8be2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac96 expref: 13 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143776.858215:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622476032 00000100:00100000:2.0:1746143776.858216:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11688 00000100:00100000:1.0:1746143776.858219:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622476032 00000100:00100000:2.0:1746143776.858225:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622476288:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143776.858227:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55da00, rc 0) 00010000:00010000:2.0:1746143776.858233:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.858239:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 54 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.858241:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a8be9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ac9d expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.858260:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5494 00000100:00100000:1.0:1746143776.858265:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+54:2009:x1830963622476032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143776.858273:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622476160:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 148us (314us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143776.858274:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143776.858279:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11687 00000100:00100000:2.0:1746143776.858284:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626726528:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143776.858292:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 54 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143776.858295:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11689 00000100:00100000:3.0:1746143776.858299:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622476416:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143776.858301:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 54 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143776.858307:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.858314:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bf0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aca4 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.858318:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136600/0x87925e4cb73a8b02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3260416->3575807) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac3b expref: 54 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143776.858323:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.858325:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.858329:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aca4 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143776.858332:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00010000:00010000:2.0:1746143776.858360:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 36 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143776.858378:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5495 00000100:00100000:2.0:1746143776.858383:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2009:x1830963622475904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.858383:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.858384:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.858389:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.858390:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.858396:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143776.858399:0:16784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143776 -> 1746143777 00010000:00010000:2.0:1746143776.858403:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 36 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.858411:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 36 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143776.858417:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.858421:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.858422:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.858426:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 44 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.858426:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626726656:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143776.858433:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 44 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.858449:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 44 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.858453:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143776.858457:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626726784:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143776.858473:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5610c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143776.858700:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aca4 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143776.858709:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55dc00, rc 0) 00000100:00100000:3.0:1746143776.858726:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622476416:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 426us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.858731:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11689 00000100:00100000:1.0:1746143776.863746:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.864055:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622476672 00000100:00100000:0.0:1746143776.864066:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622476672 00000100:00100000:3.0:1746143776.864115:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626726784:192.168.202.3@tcp:105: 00002000:00100000:0.0:1746143776.864115:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880091d4f480 x1830963622476672/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143776.864126:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4f480 with x1830963622476672 ext(2097152->3145727) 00002000:00010000:0.0:1746143776.864132:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4f480 00000100:00100000:0.0:1746143776.864155:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3353 00000100:00100000:0.0:1746143776.864162:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622476672:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143776.864205:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143776.864250:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2009:x1830963622475904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5865us (6392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.864261:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5495 00000100:00100000:0.0:1746143776.865048:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626726656:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143776.865061:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143776.865078:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+53:2009:x1830963622476032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6812us (7172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143776.865085:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5494 00010000:00010000:2.0:1746143776.865282:0:9587:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff880093725c00 x1830963626726528) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 35 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.865312:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73a8ad8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->3141631) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac2d expref: 35 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143776.865329:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626726528:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143776.865354:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a8be9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac9d expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.865365:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a8be9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac9d expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143776.865371:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24c00, rc 0) 00000100:00100000:3.0:1746143776.865373:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.865393:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622476288:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7171us (7406us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143776.865399:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11688 00000100:00100000:2.0:1746143776.865427:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622476928 00000100:00100000:2.0:1746143776.865431:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622476928 00002000:00100000:2.0:1746143776.865453:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88009719d180 x1830963622476928/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.865466:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719d180 with x1830963622476928 ext(2097152->3145727) 00002000:00010000:2.0:1746143776.865470:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719d180 00000100:00100000:2.0:1746143776.865492:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3354 00000100:00100000:2.0:1746143776.865498:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963622476928:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143776.881796:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963622476928:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16285us (16410us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143776.881809:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3354 00002000:00100000:3.0:1746143776.881821:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88009719d180 x1830963622476928/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143776.881830:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719d180 with x1830963622476928 ext(2097152->3145727) 00002000:00010000:3.0:1746143776.881837:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719d180 00000100:00100000:2.0:1746143776.881864:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622476672:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17700us (18126us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143776.881872:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3353 00002000:00100000:2.0:1746143776.881878:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880091d4f480 x1830963622476672/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.881884:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4f480 with x1830963622476672 ext(2097152->3145727) 00002000:00010000:2.0:1746143776.881888:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4f480 00000100:00100000:0.0:1746143776.887379:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.887426:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.887644:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.887696:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622477312 00000100:00100000:2.0:1746143776.887706:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622477312 00000100:00100000:2.0:1746143776.887751:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622477440 00000100:00100000:2.0:1746143776.887753:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622477440 00000100:00100000:2.0:1746143776.887775:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11690 00000100:00100000:2.0:1746143776.887783:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+53:32098:x1830963622477312:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143776.887790:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11691 00000100:00100000:3.0:1746143776.887799:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:32101:x1830963622477440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143776.887817:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.887837:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73a8bf7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acb9 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.887843:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143776.887856:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a8bfe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acb2 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.887865:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.887867:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.887870:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143776.887872:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143776.887876:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73a8bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb9 expref: 36 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.887877:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a8bfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb2 expref: 54 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.887891:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73a8bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb9 expref: 36 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.887893:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a8bfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb2 expref: 54 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.887902:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e000, rc 0) 00010000:00010000:2.0:1746143776.887902:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24800, rc 0) 00000100:00100000:3.0:1746143776.887999:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:32101:x1830963622477440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 200us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.888005:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11691 00000100:00100000:3.0:1746143776.888035:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622477184 00000100:00100000:3.0:1746143776.888039:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622477184 00000100:00100000:3.0:1746143776.888065:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12839 00000100:00100000:3.0:1746143776.888070:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32106:x1830963622477184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143776.888080:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.888092:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acab expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.888220:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.888233:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac8f expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.888240:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.888269:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac8f expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.888282:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac8f expref: 8 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143776.888293:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626726912:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143776.888560:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+54:32098:x1830963622477312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 776us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.888566:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11690 00000100:00100000:3.0:1746143776.890634:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.909750:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.909866:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.909897:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.909956:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.909996:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622477696 00000100:00100000:1.0:1746143776.910008:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622477696 00002000:00100000:1.0:1746143776.910058:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095cb5f80 x1830963622477696/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.910067:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5f80 with x1830963622477696 ext(3145728->4194303) 00002000:00010000:1.0:1746143776.910073:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb5f80 00000100:00100000:1.0:1746143776.910094:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622477952 00000100:00100000:1.0:1746143776.910096:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622477952 00002000:00100000:1.0:1746143776.910107:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880095cb5500 x1830963622477952/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.910113:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5500 with x1830963622477952 ext(3145728->4194303) 00002000:00010000:1.0:1746143776.910117:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5500 00000100:00100000:2.0:1746143776.910836:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622478208 00000100:00100000:1.0:1746143776.910836:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622478464 00000100:00100000:1.0:1746143776.910841:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622478464 00000100:00100000:2.0:1746143776.910842:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622478208 00002000:00100000:1.0:1746143776.910860:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095cb6d80 x1830963622478464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.910866:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095cb4000 x1830963622478208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.910867:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6d80 with x1830963622478464 ext(3145728->4194303) 00002000:00010000:1.0:1746143776.910871:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb6d80 00002000:00100000:2.0:1746143776.910872:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4000 with x1830963622478208 ext(2097152->4194303) 00002000:00010000:2.0:1746143776.910875:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb4000 00000100:00100000:1.0:1746143776.910886:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3355 00000100:00100000:2.0:1746143776.910891:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3356 00000100:00100000:1.0:1746143776.910894:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2008:x1830963622477696:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143776.910897:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622477952:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143776.910981:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.910997:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622478592 00000100:00100000:0.0:1746143776.910999:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622478592 00010000:00010000:0.0:1746143776.911019:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac8f expref: 9 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143776.911037:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5496 00000100:00100000:0.0:1746143776.911041:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622478592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143776.911049:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143776.911055:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac8f expref: 9 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143776.911070:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac8f expref: 9 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143776.911091:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143776.911096:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143776.911106:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143776.911112:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143776.911129:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143776.911172:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622478592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143776.911178:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5496 00000100:00100000:0.0:1746143776.911278:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3357 00000100:00100000:0.0:1746143776.911284:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963622478464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143776.911655:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3358 00000100:00100000:1.0:1746143776.911663:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+54:2010:x1830963622478208:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143776.912081:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a8bb8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac8f expref: 8 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143776.912100:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626726912:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143776.912122:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.912143:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.912148:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143776.912166:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143776.912506:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acab expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.912520:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acab expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.912527:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.912530:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143776.912533:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fc00, rc 0) 00000100:00100000:3.0:1746143776.912553:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32106:x1830963622477184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 24482us (25187us total) trans 8589943584 rc 0/0 00000100:00100000:3.0:1746143776.912560:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12839 00000100:00100000:2.0:1746143776.926252:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622477952:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15343us (16373us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143776.926264:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3356 00002000:00100000:2.0:1746143776.926277:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880095cb5500 x1830963622477952/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.926287:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5500 with x1830963622477952 ext(3145728->4194303) 00002000:00010000:2.0:1746143776.926293:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5500 00000100:00100000:0.0:1746143776.926898:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.926993:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622478720 00000100:00100000:3.0:1746143776.927002:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622478720 00000100:00100000:3.0:1746143776.927040:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12840 00000100:00100000:3.0:1746143776.927047:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32106:x1830963622478720:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143776.927072:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.927091:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73a8c1a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acc0 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.927180:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.927195:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acab expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.927202:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.927231:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acab expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.927241:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acab expref: 9 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143776.927252:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626727040:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143776.927325:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143776.927844:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2008:x1830963622477696:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16949us (18104us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143776.927854:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3355 00002000:00100000:1.0:1746143776.927861:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095cb5f80 x1830963622477696/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.927868:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5f80 with x1830963622477696 ext(3145728->4194303) 00002000:00010000:1.0:1746143776.927871:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb5f80 00000100:00100000:0.0:1746143776.937738:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.937771:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622478976 00000100:00100000:0.0:1746143776.937780:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622478976 00000100:00100000:0.0:1746143776.937834:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12841 00000100:00100000:0.0:1746143776.937842:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32108:x1830963622478976:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143776.937982:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143776.938002:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73a8c28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acc7 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.938077:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.938090:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.938101:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.938112:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a8c36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.938118:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a8c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.938123:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a8c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:1.0:1746143776.939440:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963622478464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 28149us (29476us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143776.939451:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3357 00002000:00100000:1.0:1746143776.939462:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095cb6d80 x1830963622478464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.939480:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6d80 with x1830963622478464 ext(3145728->4194303) 00002000:00010000:1.0:1746143776.939485:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb6d80 00010000:00010000:0.0:1746143776.940187:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73a8c3d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.940202:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73a8c3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.940211:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73a8c3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143776.940220:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:0.0:1746143776.940299:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.940305:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.940314:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.940319:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.940324:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143776.940327:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.940332:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.940342:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143776.940344:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143776.940347:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.940351:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73a8c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.941714:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a8c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.941725:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a8c36 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.941730:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a8c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.941734:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143776.941737:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a8c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.941745:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a8c36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.941755:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d200) 00010000:00010000:0.0:1746143776.941758:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143776.941760:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a8c36 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143776.941765:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a8c36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143776.941954:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73a8c28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc7 expref: 22 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.941973:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73a8c3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc7 expref: 21 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.941979:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.941981:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143776.941985:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.941992:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.941997:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3800, rc 0) 00000100:00100000:3.0:1746143776.942060:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32108:x1830963622478976:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4216us (4334us total) trans 8589943585 rc 0/0 00000100:00100000:3.0:1746143776.942070:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12841 00000100:00100000:3.0:1746143776.942376:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626727040:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143776.942399:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143776.943387:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.943448:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622479104 00000100:00100000:2.0:1746143776.943456:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622479104 00010000:00010000:2.0:1746143776.943487:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acab expref: 10 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143776.943518:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5497 00000100:00100000:2.0:1746143776.943526:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622479104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143776.943541:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143776.943545:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acab expref: 10 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.943556:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acab expref: 10 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.943577:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73a8c0c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acab expref: 10 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.943605:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.943611:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.943620:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.943629:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143776.943675:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143776.943797:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.943804:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143776.943864:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:3.0:1746143776.943870:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143776.943890:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.943963:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73a8c1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc0 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.943978:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc0 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.943984:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.943987:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143776.943989:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f400, rc 0) 00000100:00100000:2.0:1746143776.944071:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622479104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 545us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.944077:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5497 00000100:00100000:3.0:1746143776.944505:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32106:x1830963622478720:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 17455us (17605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143776.944512:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12840 00000100:00100000:1.0:1746143776.946102:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+54:2010:x1830963622478208:12345-192.168.202.3@tcp:3:cat.0 Request processed in 34432us (36196us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143776.946113:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3358 00002000:00100000:1.0:1746143776.946126:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095cb4000 x1830963622478208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.946135:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4000 with x1830963622478208 ext(2097152->4194303) 00002000:00010000:1.0:1746143776.946141:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb4000 00000100:00100000:0.0:1746143776.946982:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.947052:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622479232 00000100:00100000:2.0:1746143776.947061:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622479232 00000100:00100000:2.0:1746143776.947109:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 753 00000100:00100000:2.0:1746143776.947119:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622479232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143776.947137:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143776.947165:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73a8c3d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc7 expref: 21 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.947183:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143776.947187:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143776.947220:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622479232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 102us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.947227:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 753 00000100:00100000:2.0:1746143776.950776:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.950954:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622479360 00000100:00100000:0.0:1746143776.950966:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622479360 00000100:00100000:0.0:1746143776.951043:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11692 00000100:00100000:0.0:1746143776.951055:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622479360:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143776.951077:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143776.951098:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a8c4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acce expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143776.951125:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.951127:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143776.951139:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a8c4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acce expref: 13 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143776.951452:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a8c4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acce expref: 13 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143776.951473:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3a00, rc 0) 00000100:00100000:0.0:1746143776.951561:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622479360:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 506us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143776.951568:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11692 00000100:00100000:2.0:1746143776.957124:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.957206:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.957299:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622479616 00000100:00100000:3.0:1746143776.957309:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622479616 00000100:00100000:1.0:1746143776.957364:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622479872 00000100:00100000:3.0:1746143776.957366:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12842 00000100:00100000:1.0:1746143776.957371:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622479872 00002000:00100000:1.0:1746143776.957417:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880093727100 x1830963622479872/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143776.957426:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093727100 with x1830963622479872 ext(4194304->4780031) 00002000:00010000:1.0:1746143776.957432:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093727100 00000100:00100000:1.0:1746143776.957455:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3359 00000100:00100000:1.0:1746143776.957464:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2011:x1830963622479872:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143776.957600:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32106:x1830963622479616:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143776.957614:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143776.957693:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a8c52 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acd5 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.957807:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c59 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.957823:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c59 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.957834:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c59 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.957845:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c59 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.957852:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c59 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.957857:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c59 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.957862:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ea00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143776.957866:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c59 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.957873:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c59 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.957888:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143776.957891:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143776.957895:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c59 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.957900:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73a8c59 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143776.958539:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a8c52 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acd5 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.958547:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73a8c52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acd5 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143776.958555:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ee00, rc 0) 00000100:00100000:3.0:1746143776.959159:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32106:x1830963622479616:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1783us (1950us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143776.959171:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12842 00000100:00100000:0.0:1746143776.964585:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.964637:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.964787:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622480384 00000100:00100000:1.0:1746143776.964798:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622480384 00000100:00100000:2.0:1746143776.964843:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622480128 00000100:00100000:2.0:1746143776.964847:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622480128 00000100:00100000:1.0:1746143776.964859:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4694 00000100:00100000:1.0:1746143776.964867:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32106:x1830963622480384:12345-192.168.202.3@tcp:35:lfs.0 00002000:00100000:2.0:1746143776.964880:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88012b7a8700 x1830963622480128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.964890:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8700 with x1830963622480128 ext(4194304->4780031) 00002000:00010000:2.0:1746143776.964895:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a8700 00000100:00100000:2.0:1746143776.964942:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3360 00000100:00100000:2.0:1746143776.964948:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963622480128:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143776.965104:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32106:x1830963622480384:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 237us (465us total) trans 8589943586 rc 0/0 00000100:00100000:1.0:1746143776.965115:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4694 00000100:00100000:0.0:1746143776.965733:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2011:x1830963622479872:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8271us (8619us total) trans 0 rc 585728/585728 00000100:00100000:0.0:1746143776.965741:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3359 00002000:00100000:0.0:1746143776.965747:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff880093727100 x1830963622479872/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143776.965754:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093727100 with x1830963622479872 ext(4194304->4780031) 00002000:00010000:0.0:1746143776.965758:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093727100 00000100:00100000:2.0:1746143776.975402:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963622480128:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10440us (10814us total) trans 0 rc 585728/585728 00000100:00100000:2.0:1746143776.975414:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3360 00002000:00100000:2.0:1746143776.975433:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4780031) req@ffff88012b7a8700 x1830963622480128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/440 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.975442:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8700 with x1830963622480128 ext(4194304->4780031) 00002000:00010000:2.0:1746143776.975449:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a8700 00000100:00100000:1.0:1746143776.975875:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143776.975953:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622480640 00000100:00100000:3.0:1746143776.975962:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622480640 00000100:00100000:3.0:1746143776.975999:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4695 00000100:00100000:3.0:1746143776.976007:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e24a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:32101:x1830963622480640:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143776.976333:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e24a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32101:x1830963622480640:12345-192.168.202.3@tcp:35:cat.0 Request processed in 326us (586us total) trans 8589943587 rc 0/0 00000100:00100000:3.0:1746143776.976343:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4695 00000100:00100000:0.0:1746143776.984589:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143776.984647:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.985377:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622481024 00000100:00100000:1.0:1746143776.985389:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622481024 00000100:00100000:1.0:1746143776.985452:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11693 00000100:00100000:1.0:1746143776.985461:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+54:32105:x1830963622481024:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143776.985481:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143776.985500:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acdc expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.985533:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bf0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aca4 expref: 13 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.985541:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a8bfe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb2 expref: 55 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.985549:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.985556:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.985558:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.985561:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 55 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.985594:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.985611:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 29 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143776.985623:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626727168:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.985721:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a8bfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb2 expref: 55 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.985728:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a8bfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb2 expref: 55 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143776.985736:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626727296:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.985762:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aca4 expref: 13 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143776.985769:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aca4 expref: 13 pid: 1945 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143776.985776:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626727424:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.985793:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143776.985840:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622480896 00000100:00100000:3.0:1746143776.985845:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622480896 00000100:00100000:3.0:1746143776.985874:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4696 00000100:00100000:3.0:1746143776.985880:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+271:32098:x1830963622480896:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143776.986120:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+272:32098:x1830963622480896:12345-192.168.202.3@tcp:35:cat.0 Request processed in 238us (1541us total) trans 8589943588 rc 0/0 00000100:00100000:3.0:1746143776.986127:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4696 00000100:00100000:1.0:1746143776.988485:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626727168:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.988498:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626727296:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143776.988505:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626727424:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143776.988539:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 55 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.988556:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137200, rc 0) 00000100:00100000:1.0:1746143776.988605:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+55:32105:x1830963622481024:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3144us (3956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.988614:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11693 00000100:00100000:0.0:1746143776.989011:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.989107:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622481152 00000100:00100000:1.0:1746143776.989113:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622481152 00010000:00010000:1.0:1746143776.989140:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aca4 expref: 14 pid: 1945 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143776.989177:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5498 00000100:00100000:1.0:1746143776.989188:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622481152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.989202:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143776.989222:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aca4 expref: 14 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746143776.989232:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aca4 expref: 14 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746143776.989256:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a8bf0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aca4 expref: 14 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746143776.989282:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.989301:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622481152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 117us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.989311:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5498 00000100:00100000:0.0:1746143776.992368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143776.992444:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622481280 00000100:00100000:2.0:1746143776.992456:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622481280 00000100:00100000:0.0:1746143776.992457:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143776.992503:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a8bfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb2 expref: 55 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143776.992518:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622481408 00000100:00100000:1.0:1746143776.992522:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622481408 00010000:00010000:1.0:1746143776.992537:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 30 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143776.992541:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5499 00000100:00100000:2.0:1746143776.992549:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+55:2011:x1830963622481280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143776.992564:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143776.992564:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5500 00000100:00100000:1.0:1746143776.992569:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622481408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143776.992574:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143776.992584:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a8bfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb2 expref: 55 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143776.992584:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 30 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143776.992593:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 30 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.992852:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a8bfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb2 expref: 55 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143776.992872:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73a8b9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac81 expref: 30 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143776.992876:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73a8bfe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb2 expref: 55 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143776.992885:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.992887:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143776.992894:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 54 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143776.992902:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 54 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143776.992936:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143776.992964:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 54 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143776.992977:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626727552:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143776.992981:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+54:2011:x1830963622481280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 433us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143776.992986:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5499 00000100:00100000:1.0:1746143776.993026:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143776.997118:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143776.997554:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626727552:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143776.997577:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143776.997621:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622481408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5051us (5163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143776.997700:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5500 00000100:00100000:2.0:1746143776.997713:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622481664 00000100:00100000:2.0:1746143776.997721:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622481664 00002000:00100000:2.0:1746143776.997769:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2580480->2584575) req@ffff880136ac8700 x1830963622481664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/0 e 0 to 0 dl 1746143787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.997779:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8700 with x1830963622481664 ext(2580480->2584575) 00002000:00010000:2.0:1746143776.997785:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac8700 00000100:00100000:2.0:1746143776.997816:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3361 00000100:00100000:2.0:1746143776.997824:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+54:2008:x1830963622481664:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143776.997996:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+54:2008:x1830963622481664:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 173us (889us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143776.998002:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3361 00002000:00100000:2.0:1746143776.998007:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2580480->2584575) req@ffff880136ac8700 x1830963622481664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:172/0 lens 488/4536 e 0 to 0 dl 1746143787 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143776.998014:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8700 with x1830963622481664 ext(2580480->2584575) 00002000:00010000:2.0:1746143776.998017:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac8700 00000100:00100000:0.0:1746143777.003403:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.003634:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622481792 00000100:00100000:1.0:1746143777.003645:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622481792 00000100:00100000:1.0:1746143777.003722:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11694 00000100:00100000:1.0:1746143777.003732:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+45:32105:x1830963622481792:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143777.003752:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.003771:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ace3 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.003801:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 46 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.003811:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a8c4b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acce expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.003818:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73a8bf7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb9 expref: 35 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.003829:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.003831:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.003834:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->3313663] (req 3145728->3313663) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.003866:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73a8bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb9 expref: 35 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.003878:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73a8bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb9 expref: 35 pid: 12327 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143777.003891:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626727680:192.168.202.3@tcp:104: 00000100:00080000:3.0:1746143777.003994:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746143777.005362:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a8c4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acce expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.005375:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a8c4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acce expref: 12 pid: 3135 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143777.005386:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626727808:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143777.005422:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 46 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.005430:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 46 pid: 12327 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143777.005444:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626727936:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143777.005457:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.008891:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.009055:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626727680:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143777.009066:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626727808:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143777.009074:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626727936:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143777.009108:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->3313663] (req 3145728->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.009125:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa16000, rc 0) 00000100:00100000:1.0:1746143777.009166:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:32105:x1830963622481792:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5436us (5775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.009175:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11694 00000100:00100000:2.0:1746143777.009263:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622481920 00000100:00100000:2.0:1746143777.009270:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622481920 00010000:00010000:2.0:1746143777.009319:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a8c4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acce expref: 13 pid: 3135 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746143777.009340:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5501 00000100:00100000:2.0:1746143777.009346:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622481920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.009360:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.009379:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a8c4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acce expref: 13 pid: 3135 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.009394:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a8c4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acce expref: 13 pid: 3135 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.009415:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a8c4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acce expref: 13 pid: 3135 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.009430:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.009446:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622481920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 100us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.009450:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5501 00000100:00080000:3.0:1746143777.010538:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143777.011611:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.011693:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622482048 00000100:00100000:2.0:1746143777.011704:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622482048 00010000:00010000:2.0:1746143777.012804:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73a8bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb9 expref: 36 pid: 12327 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.012843:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5502 00000100:00100000:2.0:1746143777.012851:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2011:x1830963622482048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.012869:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.012889:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73a8bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb9 expref: 36 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.012900:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73a8bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb9 expref: 36 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.012950:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73a8bf7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acb9 expref: 36 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.012968:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1746143777.013498:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143777.013898:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:2011:x1830963622482048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1043us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.013908:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5502 00000100:00100000:1.0:1746143777.014330:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.015135:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622482176 00000100:00100000:3.0:1746143777.015144:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622482176 00010000:00010000:3.0:1746143777.015174:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 46 pid: 12327 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.015334:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5503 00000100:00100000:3.0:1746143777.015342:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622482176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.015355:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.015373:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 46 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.015383:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 46 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.015402:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a8b95 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac7a expref: 46 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.015579:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.015582:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.015591:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.015600:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.015646:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.015661:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626728064:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143777.016374:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.020456:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626728064:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143777.020479:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.020541:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963622482176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5198us (6212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.020552:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5503 00000100:00100000:0.0:1746143777.020602:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.020864:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622482432 00000100:00100000:2.0:1746143777.020871:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622482432 00002000:00100000:2.0:1746143777.020957:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3309568->3313663) req@ffff880136ac8000 x1830963622482432/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.020968:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8000 with x1830963622482432 ext(3309568->3313663) 00002000:00010000:2.0:1746143777.020973:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac8000 00000100:00100000:1.0:1746143777.021030:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3362 00000100:00100000:1.0:1746143777.021040:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963622482432:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143777.021181:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963622482432:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 143us (579us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143777.021187:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3362 00002000:00100000:1.0:1746143777.021192:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3309568->3313663) req@ffff880136ac8000 x1830963622482432/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.021198:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8000 with x1830963622482432 ext(3309568->3313663) 00002000:00010000:1.0:1746143777.021203:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac8000 00000100:00100000:1.0:1746143777.023088:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.023145:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622482688 00000100:00100000:2.0:1746143777.023152:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622482688 00000100:00100000:2.0:1746143777.023214:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4697 00000100:00100000:2.0:1746143777.023223:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:32105:x1830963622482688:12345-192.168.202.3@tcp:35:multiop.0 00000100:00080000:3.0:1746143777.023235:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143777.023460:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:32105:x1830963622482688:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 237us (379us total) trans 8589943589 rc 0/0 00000100:00100000:2.0:1746143777.023466:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4697 00000100:00100000:0.0:1746143777.066830:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.067046:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622482816 00000100:00100000:1.0:1746143777.067056:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622482816 00000100:00100000:1.0:1746143777.067129:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11695 00000100:00100000:1.0:1746143777.067139:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32108:x1830963622482816:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143777.067160:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.067179:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acea expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.067210:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 53 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.067218:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143777.067219:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143777.067223:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [4124672->4194303] (req 4124672->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.067255:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 53 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.067266:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 53 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143777.067278:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626728192:192.168.202.3@tcp:104: 00000100:00080000:3.0:1746143777.067701:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143777.068590:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.072164:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.072237:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622482944 00000100:00100000:2.0:1746143777.072248:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622482944 00000100:00100000:1.0:1746143777.072342:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626728192:192.168.202.3@tcp:104: 00002000:00100000:2.0:1746143777.072361:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2580480->3145727) req@ffff880096fd8000 x1830963622482944/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.072372:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd8000 with x1830963622482944 ext(2580480->3145727) 00010000:00010000:1.0:1746143777.072372:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [4124672->4194303] (req 4124672->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.072379:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 54 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143777.072389:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136800, rc 0) 00010000:00010000:2.0:1746143777.072396:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 54 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746143777.072403:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096fd8000 00000100:00100000:1.0:1746143777.072432:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32108:x1830963622482816:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5295us (5612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.072440:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11695 00000100:00080000:3.0:1746143777.072448:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143777.073014:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1415 00000100:00100000:2.0:1746143777.073023:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+54:2009:x1830963622482944:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143777.081802:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+56:2009:x1830963622482944:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8767us (9633us total) trans 17179872974 rc 0/0 00000100:00100000:2.0:1746143777.081817:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1415 00002000:00100000:2.0:1746143777.081829:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2580480->3145727) req@ffff880096fd8000 x1830963622482944/t17179872974(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/448 e 0 to 0 dl 1746143788 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.081840:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd8000 with x1830963622482944 ext(2580480->3145727) 00010000:00010000:2.0:1746143777.081851:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 56 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.081869:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 56 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746143777.081876:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096fd8000 00000100:00100000:0.0:1746143777.085779:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.086315:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622483072 00000100:00100000:3.0:1746143777.086325:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622483072 00010000:00010000:3.0:1746143777.086365:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 56 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.086411:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5504 00000100:00100000:3.0:1746143777.086420:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+56:2010:x1830963622483072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.086437:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.086458:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 56 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.086470:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 56 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.086492:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73a8c60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acdc expref: 56 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.086520:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.086522:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.086529:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.086537:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.086570:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.086581:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626728320:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143777.086666:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.088823:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.088972:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626728320:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143777.088990:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.089429:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+55:2010:x1830963622483072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3009us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.089440:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5504 00000100:00100000:2.0:1746143777.089617:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622483328 00000100:00100000:2.0:1746143777.089624:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622483328 00002000:00100000:2.0:1746143777.089665:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (4124672->4128767) req@ffff880096fdb480 x1830963622483328/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.089675:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fdb480 with x1830963622483328 ext(4124672->4128767) 00002000:00010000:2.0:1746143777.089681:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fdb480 00000100:00100000:2.0:1746143777.089830:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3363 00000100:00100000:2.0:1746143777.089839:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622483328:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143777.090005:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622483328:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 167us (1191us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143777.090010:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3363 00002000:00100000:2.0:1746143777.090015:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (4124672->4128767) req@ffff880096fdb480 x1830963622483328/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.090021:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fdb480 with x1830963622483328 ext(4124672->4128767) 00002000:00010000:2.0:1746143777.090024:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fdb480 00000100:00100000:0.0:1746143777.095300:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.095447:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622483456 00000100:00100000:1.0:1746143777.095457:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622483456 00000100:00100000:1.0:1746143777.095514:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11696 00000100:00100000:1.0:1746143777.095522:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:32108:x1830963622483456:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143777.095543:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.095563:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acf1 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.095593:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 44 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.095602:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143777.095603:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143777.095607:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4194304->4968447] (req 4194304->4968447) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.095636:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 44 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.095648:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 44 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143777.095661:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626728448:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143777.095743:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.102825:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.102980:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626728448:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143777.103010:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4194304->4968447] (req 4194304->4968447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.103028:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137200, rc 0) 00000100:00100000:1.0:1746143777.103072:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:32108:x1830963622483456:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7550us (7780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.103081:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11696 00000100:00100000:3.0:1746143777.103266:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622483584 00000100:00100000:3.0:1746143777.103273:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622483584 00002000:00100000:3.0:1746143777.103311:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3313663) req@ffff880093072300 x1830963622483584/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.103321:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093072300 with x1830963622483584 ext(3145728->3313663) 00010000:00010000:3.0:1746143777.103327:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 45 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.103340:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 45 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143777.103346:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093072300 00000100:00100000:3.0:1746143777.103373:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1416 00000100:00100000:3.0:1746143777.103380:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963622483584:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143777.105483:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.105840:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622483840 00000100:00100000:3.0:1746143777.105849:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622483840 00000100:00080000:3.0:1746143777.105877:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143777.106602:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12843 00000100:00100000:3.0:1746143777.106611:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32116:x1830963622483840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.106635:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.106656:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acf8 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.106731:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.106743:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.106753:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.106769:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73a8c8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.106774:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73a8c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.106779:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73a8c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.106875:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.106884:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.106888:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143777.106896:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:2.0:1746143777.108735:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963622483584:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5344us (5909us total) trans 21474840297 rc 0/0 00000100:00100000:2.0:1746143777.108746:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1416 00002000:00100000:2.0:1746143777.108759:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3313663) req@ffff880093072300 x1830963622483584/t21474840297(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/448 e 0 to 0 dl 1746143788 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.108767:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093072300 with x1830963622483584 ext(3145728->3313663) 00010000:00010000:2.0:1746143777.108776:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 47 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.108793:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 47 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746143777.108798:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093072300 00010000:00010000:3.0:1746143777.109160:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109168:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109178:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109184:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109189:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d429400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.109193:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109200:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109214:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143777.109217:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.109221:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109226:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109241:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73a8c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109258:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73a8c8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109263:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73a8c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109268:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097384e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.109270:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73a8c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109278:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73a8c8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109285:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fee7d00) 00010000:00010000:3.0:1746143777.109287:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.109289:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73a8c8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109294:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73a8c8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.109344:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73a8c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf8 expref: 24 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.109356:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf8 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.109361:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.109363:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143777.109366:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512400, rc 0) 00000100:00100000:3.0:1746143777.109403:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32116:x1830963622483840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2792us (3928us total) trans 8589943590 rc 0/0 00000100:00100000:3.0:1746143777.109410:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12843 00000100:00100000:0.0:1746143777.111175:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.111288:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622483968 00000100:00100000:3.0:1746143777.111297:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622483968 00010000:00010000:3.0:1746143777.111331:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 47 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.111355:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5505 00000100:00100000:3.0:1746143777.111362:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963622483968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.111376:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.111394:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 47 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.111406:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 47 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.111426:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73a8c67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ace3 expref: 47 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.111441:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.111443:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.111450:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.111457:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.111493:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.111505:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626728576:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143777.114702:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143777.114994:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.115013:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.115064:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622484352 00000100:00100000:1.0:1746143777.115071:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622484352 00000100:00100000:1.0:1746143777.115113:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11697 00000100:00100000:1.0:1746143777.115120:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2008:x1830963622484352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143777.115139:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.115157:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a8c9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad06 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143777.115214:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626728704:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143777.115273:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.115302:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622484224 00000100:00100000:3.0:1746143777.115310:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622484224 00000100:00100000:3.0:1746143777.115344:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12844 00000100:00100000:3.0:1746143777.115349:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:32118:x1830963622484224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.115363:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.115375:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ace00/0x87925e4cb73a8ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840acff expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.115442:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115454:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115463:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115475:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115480:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115485:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115580:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115590:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115595:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143777.115603:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143777.115678:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115684:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115690:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115696:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115701:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096f6d600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.115705:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115711:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115723:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143777.115726:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.115730:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115735:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a8cad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115747:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115751:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115755:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115759:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c4abe00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.115762:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115766:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115771:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fee7f00) 00010000:00010000:3.0:1746143777.115773:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.115775:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115779:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.115811:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ace00/0x87925e4cb73a8ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acff expref: 276 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.115822:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acff expref: 275 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.115829:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.115831:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143777.115832:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4abc00, rc 0) 00000100:00100000:3.0:1746143777.115868:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:32118:x1830963622484224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 518us (854us total) trans 8589943591 rc 0/0 00000100:00100000:3.0:1746143777.115873:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12844 00000100:00100000:3.0:1746143777.118249:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626728576:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143777.118273:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.118393:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963622483968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7029us (7224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.118405:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5505 00000100:00100000:0.0:1746143777.120307:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.120343:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.120463:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622484480 00000100:00100000:2.0:1746143777.120472:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622484480 00000100:00100000:2.0:1746143777.120510:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622484608 00000100:00100000:2.0:1746143777.120512:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622484608 00000100:00100000:1.0:1746143777.120513:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626728704:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143777.120529:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11698 00000100:00100000:2.0:1746143777.120537:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622484480:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143777.120543:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a8c9f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad06 expref: 37 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.120555:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.120556:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a8c9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad06 expref: 37 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.120570:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73a8cc9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad0d expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.120577:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136000, rc 0) 00000100:00100000:2.0:1746143777.120620:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626728832:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143777.120633:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2008:x1830963622484352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5512us (5642us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143777.120641:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11697 00000100:00100000:1.0:1746143777.120665:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11699 00000100:00100000:1.0:1746143777.120674:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+55:2008:x1830963622484608:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143777.120686:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.120697:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73a8cd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad14 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143777.120734:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626728960:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143777.120776:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143777.121453:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143777.123587:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626728960:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143777.123614:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73a8cd0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad14 expref: 56 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.123625:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73a8cd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad14 expref: 56 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.123635:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa16e00, rc 0) 00000100:00100000:2.0:1746143777.123638:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626728832:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143777.123669:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73a8cc9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad0d expref: 47 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.123681:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73a8cc9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad0d expref: 47 pid: 9587 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143777.123683:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+55:2008:x1830963622484608:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3009us (3338us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143777.123691:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11699 00010000:00010000:2.0:1746143777.123697:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33600, rc 0) 00000100:00100000:2.0:1746143777.123726:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622484480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3189us (3427us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143777.123733:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11698 00000100:00100000:0.0:1746143777.124892:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.125258:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622484864 00000100:00100000:2.0:1746143777.125266:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622484864 00000100:00100000:2.0:1746143777.125319:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4698 00000100:00100000:2.0:1746143777.125326:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32108:x1830963622484864:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143777.125545:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32108:x1830963622484864:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 219us (657us total) trans 8589943592 rc 0/0 00000100:00100000:2.0:1746143777.125552:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4698 00000100:00100000:1.0:1746143777.127277:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746143777.127297:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626729088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746143777.127362:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143777.127705:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626729088 00000100:00100000:3.0:1746143777.127717:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626729088 00000100:00100000:3.0:1746143777.127774:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1746143777.127781:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3774:x1830963626729088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1746143777.127805:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1021845568 pending 9752576 free 3914395648 avail 3682873344 00000100:00080000:2.0:1746143777.127819:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143777.127875:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3774:x1830963626729088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.127881:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1746143777.127974:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626729088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746143777.135753:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.135806:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.135895:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622485248 00000100:00100000:2.0:1746143777.135906:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622485248 00002000:00100000:2.0:1746143777.135991:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880093070e00 x1830963622485248/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.136001:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070e00 with x1830963622485248 ext(2097152->4194303) 00002000:00010000:2.0:1746143777.136007:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093070e00 00000100:00100000:2.0:1746143777.136025:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622485376 00000100:00100000:2.0:1746143777.136028:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622485376 00002000:00100000:2.0:1746143777.136040:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4124671) req@ffff880095c38000 x1830963622485376/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.136047:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38000 with x1830963622485376 ext(2097152->4124671) 00002000:00010000:2.0:1746143777.136049:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c38000 00000100:00100000:2.0:1746143777.136069:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3364 00000100:00100000:2.0:1746143777.136076:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2009:x1830963622485248:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143777.136555:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3365 00000100:00100000:3.0:1746143777.136573:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622485376:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143777.146013:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.146044:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.146087:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622485504 00000100:00100000:2.0:1746143777.146100:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622485504 00000100:00100000:2.0:1746143777.146144:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622485632 00000100:00100000:2.0:1746143777.146147:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622485632 00000100:00100000:2.0:1746143777.146162:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11700 00000100:00100000:2.0:1746143777.146169:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963622485504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.146190:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.146211:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cd7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad1b expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.146269:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626729216:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143777.146361:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.146522:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11701 00000100:00100000:3.0:1746143777.146531:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+55:2010:x1830963622485632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.146539:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.146549:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a8cde lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad22 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.146576:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626729344:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143777.146613:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143777.152864:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2009:x1830963622485248:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16777us (17110us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143777.152877:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3364 00002000:00100000:2.0:1746143777.152890:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880093070e00 x1830963622485248/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.152899:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070e00 with x1830963622485248 ext(2097152->4194303) 00002000:00010000:2.0:1746143777.152905:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093070e00 00002000:00010000:2.0:1746143777.164287:0:9587:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size: 4778304 -> 4964768 00000100:00100000:2.0:1746143777.164318:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626729216:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143777.164359:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cd7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad1b expref: 47 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.164374:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c4abe00/0x87925e4cb73a8cd7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad1b expref: 47 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.164390:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4abe00, rc 0) 00000100:00100000:3.0:1746143777.164944:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626729344:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143777.164965:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a8cde lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad22 expref: 56 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.164975:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a8cde lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad22 expref: 56 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.164987:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369800, rc 0) 00000100:00100000:2.0:1746143777.166188:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963622485504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 20010us (20178us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143777.166199:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11700 00000100:00100000:3.0:1746143777.168290:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+55:2010:x1830963622485632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 21746us (22230us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143777.168301:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11701 00000100:00100000:0.0:1746143777.173296:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.173382:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622485760 00000100:00100000:3.0:1746143777.173391:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622485760 00000100:00100000:3.0:1746143777.173489:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11702 00000100:00100000:3.0:1746143777.173496:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+46:32118:x1830963622485760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.173516:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.173533:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad29 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.173565:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.173573:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143777.173574:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143777.173577:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 47 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.173605:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.173615:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 35 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.173630:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626729472:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.175389:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622485376:12345-192.168.202.3@tcp:3:cat.0 Request processed in 38817us (39575us total) trans 0 rc 2027520/2027520 00000100:00100000:2.0:1746143777.175401:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3365 00002000:00100000:2.0:1746143777.175411:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4124671) req@ffff880095c38000 x1830963622485376/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 2027520/2027520 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.175420:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38000 with x1830963622485376 ext(2097152->4124671) 00002000:00010000:2.0:1746143777.175425:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c38000 00000100:00100000:3.0:1746143777.175544:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.177133:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626729472:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.177163:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 47 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.177179:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097368a00, rc 0) 00000100:00100000:3.0:1746143777.177228:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+47:32118:x1830963622485760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3731us (3942us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.177236:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11702 00000100:00100000:0.0:1746143777.180777:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.180891:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622485888 00000100:00100000:2.0:1746143777.180901:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622485888 00002000:00100000:2.0:1746143777.180991:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4964767) req@ffff880095c39180 x1830963622485888/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.181000:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39180 with x1830963622485888 ext(4194304->4964767) 00010000:00010000:2.0:1746143777.181009:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 36 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.181022:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 36 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746143777.181029:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c39180 00000100:00100000:2.0:1746143777.181050:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1417 00000100:00100000:2.0:1746143777.181058:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2008:x1830963622485888:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143777.184475:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.185022:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622486016 00000100:00100000:3.0:1746143777.185034:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622486016 00000100:00100000:3.0:1746143777.185096:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11703 00000100:00100000:3.0:1746143777.185104:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:32116:x1830963622486016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.185125:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.185146:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad30 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.185177:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143777.185180:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143777.185184:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 39 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.185197:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 39 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.185212:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369800, rc 0) 00000100:00100000:3.0:1746143777.185264:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+39:32116:x1830963622486016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 160us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.185270:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11703 00000100:00100000:2.0:1746143777.191645:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+39:2008:x1830963622485888:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10574us (10866us total) trans 21474840298 rc 0/0 00000100:00100000:2.0:1746143777.191658:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1417 00002000:00100000:2.0:1746143777.191672:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4964767) req@ffff880095c39180 x1830963622485888/t21474840298(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/448 e 0 to 0 dl 1746143788 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.191686:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39180 with x1830963622485888 ext(4194304->4964767) 00010000:00010000:2.0:1746143777.191697:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 39 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.191713:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 39 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746143777.191720:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c39180 00000100:00100000:0.0:1746143777.196557:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.196665:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622486144 00000100:00100000:3.0:1746143777.196677:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622486144 00010000:00010000:3.0:1746143777.196717:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 39 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.196764:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5506 00000100:00100000:3.0:1746143777.196772:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+39:2008:x1830963622486144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.196790:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143777.196810:0:16784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5248 -> 5616 00010000:00010000:3.0:1746143777.196815:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 39 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.196828:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 39 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.196853:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092137200/0x87925e4cb73a8c75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf1 expref: 39 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.196891:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.196893:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.196901:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 46 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.196942:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 46 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.196952:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.196953:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.196956:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 38 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.196963:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 38 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.197241:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 38 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.197255:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626729600:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143777.197471:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 46 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.197481:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626729728:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143777.197613:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.199643:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626729600:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143777.200704:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626729728:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143777.200727:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.200799:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:2008:x1830963622486144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4026us (4252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.200811:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5506 00000100:00100000:0.0:1746143777.201527:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.201567:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.201645:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622486400 00000100:00100000:2.0:1746143777.201652:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622486400 00002000:00100000:2.0:1746143777.201694:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095c3b100 x1830963622486400/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.201703:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b100 with x1830963622486400 ext(3145728->4194303) 00002000:00010000:2.0:1746143777.201708:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3b100 00000100:00100000:2.0:1746143777.201736:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622486656 00000100:00100000:2.0:1746143777.201739:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622486656 00002000:00100000:2.0:1746143777.201752:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880095c3b800 x1830963622486656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.201759:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b800 with x1830963622486656 ext(2097152->3145727) 00002000:00010000:2.0:1746143777.201761:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3b800 00000100:00100000:2.0:1746143777.201786:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3366 00000100:00100000:2.0:1746143777.201793:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:2009:x1830963622486400:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143777.201986:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3367 00000100:00100000:3.0:1746143777.201993:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963622486656:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143777.214631:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:2009:x1830963622486400:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12827us (13094us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143777.214647:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3366 00002000:00100000:2.0:1746143777.214659:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095c3b100 x1830963622486400/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.214670:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b100 with x1830963622486400 ext(3145728->4194303) 00002000:00010000:2.0:1746143777.214676:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3b100 00000100:00100000:3.0:1746143777.216628:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963622486656:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14626us (15050us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143777.216641:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3367 00002000:00100000:3.0:1746143777.216652:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880095c3b800 x1830963622486656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.216660:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b800 with x1830963622486656 ext(2097152->3145727) 00002000:00010000:3.0:1746143777.216665:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3b800 00000100:00100000:0.0:1746143777.226394:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.226560:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622486912 00000100:00100000:3.0:1746143777.226571:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622486912 00002000:00100000:3.0:1746143777.226621:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095c38a80 x1830963622486912/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.226633:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38a80 with x1830963622486912 ext(4194304->4968447) 00002000:00010000:3.0:1746143777.226638:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c38a80 00000100:00100000:3.0:1746143777.226671:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3368 00000100:00100000:3.0:1746143777.226679:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:2008:x1830963622486912:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143777.231774:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.231997:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622487040 00000100:00100000:2.0:1746143777.232008:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622487040 00000100:00100000:2.0:1746143777.232073:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11704 00000100:00100000:2.0:1746143777.232082:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+55:32118:x1830963622487040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.232104:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.232124:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad37 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.232154:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.232162:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143777.232164:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143777.232167:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 56 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.232204:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.232216:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 29 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.232232:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626729856:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.233420:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.235888:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+38:2008:x1830963622486912:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9199us (9494us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143777.235900:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3368 00002000:00100000:3.0:1746143777.235958:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095c38a80 x1830963622486912/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.235974:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38a80 with x1830963622486912 ext(4194304->4968447) 00002000:00010000:3.0:1746143777.235979:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c38a80 00000100:00100000:2.0:1746143777.238634:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626729856:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143777.238634:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143777.238674:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 56 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.238693:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33e00, rc 0) 00000100:00100000:3.0:1746143777.239573:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622487168 00000100:00100000:3.0:1746143777.239582:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622487168 00002000:00100000:3.0:1746143777.239629:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (4124672->4194303) req@ffff880095c39f80 x1830963622487168/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.239637:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39f80 with x1830963622487168 ext(4124672->4194303) 00010000:00010000:3.0:1746143777.239644:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 30 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.239658:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 30 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143777.239665:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c39f80 00000100:00100000:3.0:1746143777.239691:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1418 00000100:00100000:3.0:1746143777.239698:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622487168:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143777.239989:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+56:32118:x1830963622487040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7906us (8227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.239996:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11704 00000100:00100000:1.0:1746143777.241086:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.241156:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622487296 00000100:00100000:3.0:1746143777.241160:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622487296 00000100:00100000:3.0:1746143777.241199:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11705 00000100:00100000:3.0:1746143777.241206:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2011:x1830963622487296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.241218:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.241239:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a8cfa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad3e expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.241385:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626729984:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143777.242459:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.249337:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2009:x1830963622487168:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9626us (10692us total) trans 17179872975 rc 0/0 00000100:00100000:3.0:1746143777.249354:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1418 00002000:00100000:3.0:1746143777.249366:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (4124672->4194303) req@ffff880095c39f80 x1830963622487168/t17179872975(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/448 e 0 to 0 dl 1746143788 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.249376:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39f80 with x1830963622487168 ext(4124672->4194303) 00010000:00010000:3.0:1746143777.249387:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.249401:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143777.249408:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c39f80 00000100:00100000:0.0:1746143777.249799:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626729984:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143777.249831:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a8cfa lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad3e expref: 33 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.249849:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a8cfa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad3e expref: 33 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.249872:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512a00, rc 0) 00000100:00100000:0.0:1746143777.249897:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2011:x1830963622487296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8692us (8813us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143777.249909:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11705 00000100:00100000:0.0:1746143777.252681:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.252759:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622487424 00000100:00100000:2.0:1746143777.252767:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622487424 00000100:00100000:2.0:1746143777.252812:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11706 00000100:00100000:2.0:1746143777.252819:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2010:x1830963622487424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.252839:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.252856:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33600/0x87925e4cb73a8d01 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad45 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.252949:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626730112:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143777.255563:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.256003:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.256849:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622487552 00000100:00100000:2.0:1746143777.256859:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622487552 00010000:00010000:2.0:1746143777.256899:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.256968:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5507 00000100:00100000:2.0:1746143777.256976:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2008:x1830963622487552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.256990:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.257011:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.257023:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 34 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.257047:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.257050:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.257057:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 55 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.257066:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 55 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.257100:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 55 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.257114:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626730240:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143777.257196:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561d80 going to sleep for 11 seconds 00000001:00080000:2.0:1746143777.257228:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872975 is committed 00000001:00080000:2.0:1746143777.257238:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872974 is committed 00000001:00080000:2.0:1746143777.257263:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872969 is committed 00000001:00080000:2.0:1746143777.257280:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872961 is committed 00000100:00100000:1.0:1746143777.257941:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.258185:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622487808 00000100:00100000:2.0:1746143777.258190:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622487808 00000100:00100000:2.0:1746143777.258867:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12845 00000100:00100000:2.0:1746143777.258877:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+275:32121:x1830963622487808:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143777.258900:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.258944:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad4c expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.259054:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143777.259071:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc0 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.259078:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf8 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.259084:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acff expref: 276 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.259091:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143777.259119:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acff expref: 276 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.259130:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acff expref: 276 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.259145:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626730368:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.260245:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf8 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.260255:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf8 expref: 23 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.260263:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626730496:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.260301:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc0 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.260307:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc0 expref: 8 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.260314:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626730624:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.260330:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.261227:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626730240:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143777.261247:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.261273:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622487552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4297us (5275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.261283:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5507 00010000:00010000:2.0:1746143777.261522:0:9587:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff88007f649500 x1830963626730112) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 9 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.261552:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73a8c6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acea expref: 9 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.261578:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626730112:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143777.261601:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33600/0x87925e4cb73a8d01 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad45 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.261612:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e33600/0x87925e4cb73a8d01 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad45 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.261620:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33600, rc 0) 00000100:00100000:2.0:1746143777.261641:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2010:x1830963622487424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8823us (8969us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143777.261647:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11706 00000100:00100000:0.0:1746143777.267046:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.267088:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.267167:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622487936 00000100:00100000:1.0:1746143777.267176:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622487936 00010000:00010000:1.0:1746143777.267211:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acff expref: 277 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143777.267236:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622488192 00000100:00100000:1.0:1746143777.267238:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622488192 00010000:00010000:1.0:1746143777.267248:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc0 expref: 9 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143777.267263:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5508 00000100:00100000:1.0:1746143777.267270:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+277:2011:x1830963622487936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143777.267289:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143777.267295:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acff expref: 277 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143777.267305:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acff expref: 277 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143777.267328:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143777.267333:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00000100:00100000:3.0:1746143777.267633:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5509 00000100:00100000:3.0:1746143777.267641:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622488192:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.267648:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.267653:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc0 expref: 9 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.267729:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73a8cbb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acff expref: 277 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.267748:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626730368:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143777.267814:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.267820:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143777.267862:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+276:2011:x1830963622487936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 592us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.267868:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5508 00010000:00010000:3.0:1746143777.268062:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc0 expref: 9 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.268074:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.268077:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.268082:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.268086:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.268106:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622488192:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 467us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.268111:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5509 00000100:00100000:2.0:1746143777.268186:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626730496:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.268195:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73a8c21 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acc0 expref: 8 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.268204:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626730624:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.268229:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143777.268738:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.269635:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.269673:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.269721:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622488064 00000100:00100000:3.0:1746143777.269729:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622488064 00010000:00010000:3.0:1746143777.269755:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf8 expref: 24 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.269777:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5510 00000100:00100000:3.0:1746143777.269783:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622488064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.269795:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.269800:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf8 expref: 24 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.269809:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf8 expref: 24 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.269828:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73a8c91 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840acf8 expref: 24 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.269853:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.269856:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.269863:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.269869:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.269890:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.269953:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622488064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 169us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.269960:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5510 00010000:00010000:3.0:1746143777.269980:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.269986:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143777.270006:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:2.0:1746143777.270074:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622488576 00000100:00100000:2.0:1746143777.270077:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622488576 00002000:00100000:2.0:1746143777.270109:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880092a50a80 x1830963622488576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.270118:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a50a80 with x1830963622488576 ext(2097152->4194303) 00002000:00010000:2.0:1746143777.270124:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a50a80 00000100:00100000:2.0:1746143777.270135:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622488704 00000100:00100000:2.0:1746143777.270137:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622488704 00002000:00100000:2.0:1746143777.270149:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092a51f80 x1830963622488704/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.270155:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a51f80 with x1830963622488704 ext(3145728->4194303) 00002000:00010000:2.0:1746143777.270158:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a51f80 00000100:00100000:2.0:1746143777.270167:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3369 00000100:00100000:2.0:1746143777.270172:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622488576:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143777.273370:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3370 00000100:00100000:2.0:1746143777.273387:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963622488704:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143777.274105:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad4c expref: 277 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.274132:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad4c expref: 276 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.274146:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.274148:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143777.274151:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096c81000, rc 0) 00000100:00100000:3.0:1746143777.274211:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+276:32121:x1830963622487808:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 15335us (16301us total) trans 8589943593 rc 0/0 00000100:00100000:3.0:1746143777.274219:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12845 00000100:00100000:0.0:1746143777.277009:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.277093:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622488960 00000100:00100000:1.0:1746143777.277102:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622488960 00000100:00100000:1.0:1746143777.277148:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4699 00000100:00100000:1.0:1746143777.277155:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32116:x1830963622488960:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143777.277396:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32116:x1830963622488960:12345-192.168.202.3@tcp:35:cat.0 Request processed in 240us (396us total) trans 8589943594 rc 0/0 00000100:00100000:1.0:1746143777.277402:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4699 00000100:00100000:2.0:1746143777.293050:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622488576:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22865us (23403us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143777.293063:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3369 00002000:00100000:2.0:1746143777.293076:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880092a50a80 x1830963622488576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.293084:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a50a80 with x1830963622488576 ext(2097152->4194303) 00002000:00010000:2.0:1746143777.293091:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092a50a80 00000100:00100000:3.0:1746143777.293541:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963622488704:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20160us (23866us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143777.293549:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3370 00002000:00100000:3.0:1746143777.293554:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092a51f80 x1830963622488704/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.293561:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092a51f80 with x1830963622488704 ext(3145728->4194303) 00002000:00010000:3.0:1746143777.293565:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092a51f80 00000100:00100000:2.0:1746143777.304390:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.304495:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.304761:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622489344 00000100:00100000:0.0:1746143777.304772:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622489344 00000100:00100000:0.0:1746143777.304816:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11707 00000100:00100000:0.0:1746143777.304824:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:32121:x1830963622489344:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143777.304844:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143777.304862:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad53 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.304898:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.304934:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.304936:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.304940:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2625536->2891775] (req 2625536->2891775) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.304974:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.304985:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 25 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143777.304998:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094195500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626730752:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143777.305092:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.305293:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622489216 00000100:00100000:3.0:1746143777.305297:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622489216 00002000:00100000:3.0:1746143777.305331:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8800972eb800 x1830963622489216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.305340:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eb800 with x1830963622489216 ext(4194304->4968447) 00002000:00010000:3.0:1746143777.305345:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972eb800 00000100:00100000:3.0:1746143777.305545:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3371 00000100:00100000:3.0:1746143777.305552:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963622489216:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143777.307388:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094195500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626730752:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143777.307414:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2625536->2891775] (req 2625536->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.307429:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849600, rc 0) 00000100:00100000:1.0:1746143777.307469:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:32121:x1830963622489344:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2646us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.307477:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11707 00000100:00100000:2.0:1746143777.308967:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.309078:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622489472 00000100:00100000:1.0:1746143777.309087:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622489472 00010000:00010000:1.0:1746143777.309117:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 25 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143777.309594:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5511 00000100:00100000:1.0:1746143777.309603:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622489472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143777.309620:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143777.309642:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 25 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143777.309655:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 25 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143777.309679:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73a8cf3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad37 expref: 25 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143777.310365:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.310367:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.310375:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 24 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.310384:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 24 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.310422:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 24 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143777.310434:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626730880:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143777.310700:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.313447:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963622489216:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7886us (9059us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143777.313461:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3371 00002000:00100000:3.0:1746143777.313474:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8800972eb800 x1830963622489216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 774144/774144 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.313484:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eb800 with x1830963622489216 ext(4194304->4968447) 00002000:00010000:3.0:1746143777.313490:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972eb800 00000100:00100000:1.0:1746143777.314068:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626730880:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143777.314085:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143777.314113:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622489472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4511us (5149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.314123:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5511 00000100:00100000:0.0:1746143777.314644:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.314716:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622489728 00000100:00100000:3.0:1746143777.314721:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622489728 00002000:00100000:3.0:1746143777.314752:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2625536->2629631) req@ffff880094195500 x1830963622489728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.314760:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195500 with x1830963622489728 ext(2625536->2629631) 00002000:00010000:3.0:1746143777.314763:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094195500 00000100:00100000:3.0:1746143777.315204:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3372 00000100:00100000:3.0:1746143777.315213:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622489728:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143777.315339:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622489728:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 127us (695us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143777.315345:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3372 00002000:00100000:3.0:1746143777.315350:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2625536->2629631) req@ffff880094195500 x1830963622489728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.315356:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195500 with x1830963622489728 ext(2625536->2629631) 00002000:00010000:3.0:1746143777.315360:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094195500 00000100:00100000:0.0:1746143777.318542:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.318599:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622490112 00000100:00100000:3.0:1746143777.318609:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622490112 00000100:00100000:0.0:1746143777.318624:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.318692:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4700 00000100:00100000:1.0:1746143777.318702:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+276:32118:x1830963622490112:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143777.318772:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622490240 00000100:00100000:2.0:1746143777.318777:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622490240 00002000:00100000:2.0:1746143777.318802:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2887680->2891775) req@ffff8800939a7480 x1830963622490240/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.318815:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7480 with x1830963622490240 ext(2887680->2891775) 00002000:00010000:2.0:1746143777.318820:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a7480 00000100:00100000:2.0:1746143777.318847:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3373 00000100:00100000:2.0:1746143777.318852:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2011:x1830963622490240:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143777.318940:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+277:32118:x1830963622490112:12345-192.168.202.3@tcp:35:cat.0 Request processed in 210us (374us total) trans 8589943595 rc 0/0 00000100:00100000:1.0:1746143777.318947:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4700 00000100:00100000:2.0:1746143777.318987:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2011:x1830963622490240:12345-192.168.202.3@tcp:3:cat.0 Request processed in 133us (362us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143777.318992:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3373 00002000:00100000:2.0:1746143777.318997:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2887680->2891775) req@ffff8800939a7480 x1830963622490240/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.319004:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7480 with x1830963622490240 ext(2887680->2891775) 00002000:00010000:2.0:1746143777.319006:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a7480 00000100:00100000:0.0:1746143777.344676:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.345767:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622490496 00000100:00100000:3.0:1746143777.345902:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622490496 00000100:00100000:3.0:1746143777.346412:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12846 00000100:00100000:3.0:1746143777.346429:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32126:x1830963622490496:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143777.346551:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.346574:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73a8d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad5a expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.346661:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346674:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346685:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346698:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a8d32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346703:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a8d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346708:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a8d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346808:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d39 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346816:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346821:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143777.346829:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143777.346907:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346942:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346948:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346954:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346959:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880123268a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.346962:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346968:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346977:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143777.346980:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.346983:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.346987:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268a00/0x87925e4cb73a8d2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.347014:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a8d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.347019:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a8d32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.347023:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a8d32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.347030:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880123268600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.347033:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a8d32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.347037:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a8d32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.347041:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fee7600) 00010000:00010000:3.0:1746143777.347043:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.347044:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a8d32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.347048:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268600/0x87925e4cb73a8d32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.347079:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73a8d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad5a expref: 27 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.347088:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad5a expref: 26 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.347093:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.347094:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143777.347096:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad35800, rc 0) 00000100:00100000:3.0:1746143777.347157:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:32126:x1830963622490496:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 737us (2492us total) trans 8589943596 rc 0/0 00000100:00100000:3.0:1746143777.347163:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12846 00000100:00100000:0.0:1746143777.355518:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.355608:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622490624 00000100:00100000:1.0:1746143777.355619:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622490624 00000100:00100000:1.0:1746143777.355723:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 754 00000100:00100000:1.0:1746143777.355732:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2010:x1830963622490624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143777.355750:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143777.355776:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d39 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad5a expref: 26 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.355954:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143777.355959:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143777.356014:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622490624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 282us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.356021:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 754 00000100:00100000:0.0:1746143777.370663:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.370813:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622490752 00000100:00100000:1.0:1746143777.370823:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622490752 00000100:00100000:1.0:1746143777.370881:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11708 00000100:00100000:1.0:1746143777.370890:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:32126:x1830963622490752:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143777.370970:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.370989:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad61 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.371020:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a8870 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac8 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.371028:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a8981 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab4d expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.371035:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73a8893 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf2 expref: 8 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.371040:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.371042:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.371044:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1630208->1925119] (req 1630208->1925119) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 8 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.371074:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73a8893 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf2 expref: 8 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.371086:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73a8893 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf2 expref: 8 pid: 3134 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143777.371098:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626731008:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143777.372331:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a8981 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab4d expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.372481:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a8981 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab4d expref: 8 pid: 13436 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143777.372492:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626731136:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143777.372839:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a8870 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac8 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.372849:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a8870 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac8 expref: 23 pid: 9587 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143777.372857:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626731264:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143777.372881:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.373949:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.374034:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626731008:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.374087:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622490880 00000100:00100000:2.0:1746143777.374095:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622490880 00010000:00010000:2.0:1746143777.374135:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73a8893 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf2 expref: 9 pid: 3134 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746143777.374171:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5512 00000100:00100000:2.0:1746143777.374178:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622490880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.374190:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.374209:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73a8893 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf2 expref: 9 pid: 3134 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.374219:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73a8893 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf2 expref: 9 pid: 3134 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.374245:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73a8893 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf2 expref: 9 pid: 3134 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.374265:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.374292:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622490880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 115us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.374298:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5512 00000100:00080000:0.0:1746143777.374524:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143777.377873:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626731136:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143777.377887:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626731264:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143777.377966:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1630208->1925119] (req 1630208->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 8 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.377984:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9800, rc 0) 00000100:00100000:1.0:1746143777.378039:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32126:x1830963622490752:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7148us (7386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.378051:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11708 00000100:00100000:0.0:1746143777.380189:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.381018:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622491008 00000100:00100000:3.0:1746143777.381028:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622491008 00010000:00010000:3.0:1746143777.381067:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a8981 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab4d expref: 8 pid: 13436 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143777.381109:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5513 00000100:00100000:3.0:1746143777.381116:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622491008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.381130:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.381150:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a8981 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab4d expref: 8 pid: 13436 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.381161:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a8981 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab4d expref: 8 pid: 13436 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.381185:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73a8981 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab4d expref: 8 pid: 13436 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.381216:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.381272:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622491008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 157us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.381279:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5513 00000100:00100000:1.0:1746143777.382196:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.382965:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622491136 00000100:00100000:3.0:1746143777.382974:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622491136 00010000:00010000:3.0:1746143777.383002:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a8870 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac8 expref: 24 pid: 9587 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143777.383029:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5514 00000100:00100000:3.0:1746143777.383036:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622491136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.383047:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.383062:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a8870 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac8 expref: 24 pid: 9587 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.383071:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a8870 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac8 expref: 24 pid: 9587 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.383091:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73a8870 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac8 expref: 24 pid: 9587 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.383103:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.383105:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.383112:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 6 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.383121:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 6 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.383155:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 6 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.383169:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626731392:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143777.383253:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.385505:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626731392:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143777.385523:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.385563:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622491136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2526us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.385572:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5514 00000100:00100000:0.0:1746143777.387854:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.388221:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622491392 00000100:00100000:3.0:1746143777.388231:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622491392 00002000:00100000:3.0:1746143777.388281:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1630208->1634303) req@ffff880082ed5180 x1830963622491392/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.388291:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed5180 with x1830963622491392 ext(1630208->1634303) 00002000:00010000:3.0:1746143777.388297:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed5180 00000100:00100000:3.0:1746143777.388331:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3374 00000100:00100000:3.0:1746143777.388339:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622491392:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143777.389668:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880082ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622491392:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 1322us (1814us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143777.389678:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3374 00002000:00100000:3.0:1746143777.389687:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1630208->1634303) req@ffff880082ed5180 x1830963622491392/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.389695:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880082ed5180 with x1830963622491392 ext(1630208->1634303) 00002000:00010000:3.0:1746143777.389700:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880082ed5180 00000100:00100000:0.0:1746143777.393735:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.394160:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622491648 00000100:00100000:3.0:1746143777.394170:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622491648 00002000:00100000:3.0:1746143777.394215:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1921024->1925119) req@ffff880095c6aa00 x1830963622491648/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.394224:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6aa00 with x1830963622491648 ext(1921024->1925119) 00002000:00010000:3.0:1746143777.394230:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c6aa00 00000100:00100000:3.0:1746143777.394263:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3375 00000100:00100000:3.0:1746143777.394271:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622491648:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143777.394426:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622491648:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 155us (700us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143777.394434:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3375 00002000:00100000:3.0:1746143777.394439:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1921024->1925119) req@ffff880095c6aa00 x1830963622491648/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.394445:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6aa00 with x1830963622491648 ext(1921024->1925119) 00002000:00010000:3.0:1746143777.394448:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c6aa00 00000100:00100000:0.0:1746143777.402427:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.402639:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622491904 00000100:00100000:3.0:1746143777.402650:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622491904 00000100:00100000:3.0:1746143777.402714:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4701 00000100:00100000:3.0:1746143777.402724:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e249c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32126:x1830963622491904:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143777.403008:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e249c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:32126:x1830963622491904:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 284us (591us total) trans 8589943597 rc 0/0 00000100:00100000:3.0:1746143777.403015:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4701 00000100:00100000:0.0:1746143777.458574:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.458693:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622492160 00000100:00100000:2.0:1746143777.458704:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622492160 00000100:00100000:2.0:1746143777.459057:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12847 00000100:00100000:2.0:1746143777.459067:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+277:32130:x1830963622492160:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.459095:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.459115:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a8d4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad68 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.459193:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459205:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459216:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459229:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459235:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459243:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459340:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24c600/0x87925e4cb73a8d63 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459350:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24c600/0x87925e4cb73a8d63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459355:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24c600/0x87925e4cb73a8d63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143777.459364:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143777.459442:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459447:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459453:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459459:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459464:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad35800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143777.459468:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459475:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459484:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143777.459487:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143777.459491:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.459495:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.460791:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.460800:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.460805:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.460810:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d9c400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143777.460814:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.460819:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.460828:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093754000) 00010000:00010000:2.0:1746143777.460831:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143777.460833:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.460837:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.460888:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a8d4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad68 expref: 280 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.460900:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24c600/0x87925e4cb73a8d63 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad68 expref: 279 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.460907:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143777.460909:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143777.460989:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e24c600, rc 0) 00000100:00100000:2.0:1746143777.461214:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:32130:x1830963622492160:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2147us (2648us total) trans 8589943598 rc 0/0 00000100:00100000:2.0:1746143777.461221:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12847 00000100:00100000:0.0:1746143777.463796:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.463852:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.464890:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622492288 00000100:00100000:1.0:1746143777.464901:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622492288 00000100:00100000:1.0:1746143777.464991:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11709 00000100:00100000:1.0:1746143777.465000:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622492288:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143777.465019:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.465036:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a8d71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad6f expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143777.465094:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626731520:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143777.465181:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.465519:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622492416 00000100:00100000:3.0:1746143777.465524:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622492416 00000100:00100000:3.0:1746143777.466284:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 755 00000100:00100000:3.0:1746143777.466291:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:2009:x1830963622492416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.466302:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.466322:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24c600/0x87925e4cb73a8d63 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad68 expref: 279 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.466349:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.466353:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.466717:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:2009:x1830963622492416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 425us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.466724:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 755 00002000:00010000:1.0:1746143777.468002:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime: 1746143776 -> 1746143777 00002000:00010000:1.0:1746143777.468006:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143776 -> 1746143777 00002000:00010000:1.0:1746143777.468008:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime: 1746143776 -> 1746143777 00000100:00100000:1.0:1746143777.468028:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626731520:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143777.468058:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a8d71 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad6f expref: 24 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.468070:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73a8d71 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad6f expref: 24 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.468373:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8a200, rc 0) 00000100:00100000:1.0:1746143777.469137:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622492288:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4135us (5344us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143777.469150:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11709 00000100:00100000:1.0:1746143777.473456:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.473518:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622492544 00000100:00100000:0.0:1746143777.473528:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622492544 00000100:00100000:0.0:1746143777.473586:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11710 00000100:00100000:0.0:1746143777.473594:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:32130:x1830963622492544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143777.473614:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143777.473632:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad76 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.473662:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 6 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.473671:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143777.473673:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143777.473676:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 24 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.473708:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 6 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.473720:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 6 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143777.473732:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626731648:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143777.474484:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.480514:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.480533:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626731648:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143777.480566:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 24 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.480584:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76400, rc 0) 00000100:00100000:1.0:1746143777.480640:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:32130:x1830963622492544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7046us (7193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.480650:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11710 00000100:00100000:3.0:1746143777.480901:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622492672 00000100:00100000:3.0:1746143777.480909:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622492672 00002000:00100000:3.0:1746143777.480989:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1630208->1925119) req@ffff880093725c00 x1830963622492672/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.480998:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725c00 with x1830963622492672 ext(1630208->1925119) 00010000:00010000:3.0:1746143777.481005:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 7 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.481017:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 7 pid: 9587 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143777.481024:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093725c00 00000100:00100000:3.0:1746143777.481049:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1419 00000100:00100000:3.0:1746143777.481056:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622492672:12345-192.168.202.3@tcp:4:multiop.0 00000001:00080000:0.0:1746143777.481964:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840298 is committed 00000001:00080000:0.0:1746143777.482777:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840297 is committed 00000001:00080000:0.0:1746143777.482806:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840291 is committed 00000001:00080000:0.0:1746143777.482822:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840282 is committed 00000100:00100000:0.0:1746143777.487495:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.487566:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622492800 00000100:00100000:2.0:1746143777.487577:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622492800 00000100:00100000:2.0:1746143777.487628:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12848 00000100:00100000:2.0:1746143777.487637:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32131:x1830963622492800:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143777.487667:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.487686:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24c600/0x87925e4cb73a8d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad7d expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.487747:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.487757:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.487768:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.487782:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a8d8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.487787:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a8d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.487796:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a8d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.487857:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.487867:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad4c expref: 277 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.487873:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.487905:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad4c expref: 277 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.487960:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad4c expref: 277 pid: 10936 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.487972:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626731776:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.488056:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.488126:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622492672:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7069us (7623us total) trans 17179872976 rc 0/0 00000100:00100000:3.0:1746143777.488136:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1419 00002000:00100000:3.0:1746143777.488145:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1630208->1925119) req@ffff880093725c00 x1830963622492672/t17179872976(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/448 e 0 to 0 dl 1746143788 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.488155:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725c00 with x1830963622492672 ext(1630208->1925119) 00010000:00010000:3.0:1746143777.488163:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 9 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.488174:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 9 pid: 9587 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143777.488185:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093725c00 00000100:00100000:2.0:1746143777.489123:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626731776:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.489141:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143777.489606:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.489637:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.489654:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622493056 00000100:00100000:1.0:1746143777.489661:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622493056 00000100:00100000:1.0:1746143777.489703:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4702 00000100:00100000:1.0:1746143777.489711:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:16365:x1830963622493056:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143777.489715:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622493184 00000100:00100000:3.0:1746143777.489718:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622493184 00010000:00010000:3.0:1746143777.489735:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 9 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.490008:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5515 00000100:00100000:3.0:1746143777.490014:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622493184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.490023:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.490039:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 9 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.490047:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 9 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.490065:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73a8d47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad61 expref: 9 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143777.490078:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:16365:x1830963622493056:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 368us (472us total) trans 8589943599 rc 0/0 00010000:00010000:3.0:1746143777.490080:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.490082:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143777.490084:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4702 00010000:00010000:3.0:1746143777.490089:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.490096:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.490245:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.490256:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626731904:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143777.490678:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.492454:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.492533:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622493312 00000100:00100000:2.0:1746143777.492541:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622493312 00010000:00010000:2.0:1746143777.492572:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad4c expref: 279 pid: 10936 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.492595:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5516 00000100:00100000:2.0:1746143777.492602:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+279:2009:x1830963622493312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.492620:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.492624:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad4c expref: 279 pid: 10936 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.492634:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad4c expref: 279 pid: 10936 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.492652:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096c81000/0x87925e4cb73a8d0f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad4c expref: 279 pid: 10936 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.492681:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143777.492686:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492696:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492702:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492723:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.492756:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+278:2009:x1830963622493312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 154us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.492763:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5516 00010000:00010000:2.0:1746143777.492785:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492792:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143777.492840:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:2.0:1746143777.492844:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143777.492861:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492871:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492882:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492888:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492893:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492899:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492905:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d9c400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143777.492908:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492945:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492953:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143777.492955:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143777.492958:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492962:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73a8d86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492975:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a8d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492980:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a8d8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492984:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a8d8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492988:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad34000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143777.492991:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a8d8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.492995:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a8d8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.493001:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093754000) 00010000:00010000:2.0:1746143777.493003:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143777.493005:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a8d8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.493009:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a8d8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.493041:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24c600/0x87925e4cb73a8d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad7d expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.493053:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad7d expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.493059:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143777.493061:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143777.493064:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad35800, rc 0) 00000100:00100000:2.0:1746143777.493108:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32131:x1830963622492800:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 5473us (5625us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.493114:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12848 00000100:00100000:3.0:1746143777.494881:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626731904:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143777.494900:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.495222:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622493184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5205us (5581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.495230:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5515 00000100:00100000:0.0:1746143777.496627:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.497067:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622493568 00000100:00100000:3.0:1746143777.497079:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622493568 00002000:00100000:3.0:1746143777.497120:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880136aca300 x1830963622493568/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.497130:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136aca300 with x1830963622493568 ext(1048576->2097151) 00002000:00010000:3.0:1746143777.497134:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136aca300 00000100:00100000:1.0:1746143777.497447:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.497464:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.497496:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.497513:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622493696 00000100:00100000:2.0:1746143777.497517:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622493696 00000100:00100000:0.0:1746143777.497641:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622493824 00000100:00100000:0.0:1746143777.497645:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622493824 00000100:00100000:0.0:1746143777.497664:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622493952 00000100:00100000:0.0:1746143777.497666:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622493952 00000100:00100000:0.0:1746143777.497681:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11711 00000100:00100000:0.0:1746143777.497688:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622493696:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143777.497694:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11712 00000100:00100000:2.0:1746143777.497700:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622493824:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143777.497701:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.497705:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.497718:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1000/0x87925e4cb73a8da2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad8b expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.497718:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a8d9b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad84 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.497738:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.497738:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.497740:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.497740:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.497747:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1000/0x87925e4cb73a8da2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad8b expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.497747:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a8d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad84 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.497761:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1000/0x87925e4cb73a8da2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad8b expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.497762:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a8d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad84 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.497772:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1000, rc 0) 00010000:00010000:0.0:1746143777.497772:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77c00, rc 0) 00000100:00100000:3.0:1746143777.497825:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11713 00000100:00100000:3.0:1746143777.497831:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622493952:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143777.497837:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.497844:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73a8da9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad92 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.497881:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626732032:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143777.498015:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622493824:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 313us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.498021:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11712 00000100:00100000:2.0:1746143777.498044:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3376 00000100:00100000:2.0:1746143777.498050:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622493568:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143777.498128:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622493696:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 440us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143777.498134:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11711 00000100:00100000:3.0:1746143777.498932:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.508995:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626732032:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143777.509034:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73a8da9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad92 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.509050:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73a8da9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad92 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.509078:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268600, rc 0) 00000100:00100000:3.0:1746143777.509131:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622493952:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 11300us (11633us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143777.509140:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11713 00000100:00100000:2.0:1746143777.509448:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622493568:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11398us (12825us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143777.509457:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3376 00002000:00100000:2.0:1746143777.509464:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880136aca300 x1830963622493568/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.509472:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136aca300 with x1830963622493568 ext(1048576->2097151) 00002000:00010000:2.0:1746143777.509477:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136aca300 00000100:00100000:0.0:1746143777.515132:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.515219:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622494208 00000100:00100000:2.0:1746143777.515230:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622494208 00000100:00100000:2.0:1746143777.515281:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12849 00000100:00100000:2.0:1746143777.515289:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32131:x1830963622494208:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143777.515311:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.515331:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a8db0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ad99 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.515437:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73a8db7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.515451:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad7d expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.515459:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73a8db7 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143777.515488:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad7d expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.515499:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad7d expref: 10 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.515512:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626732160:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.516676:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.527292:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.527372:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.527410:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626732160:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.527437:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73a8db7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143777.527464:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622494592 00000100:00100000:3.0:1746143777.527470:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622494592 00010000:00010000:3.0:1746143777.527501:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad7d expref: 11 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.527523:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5517 00000100:00100000:3.0:1746143777.527529:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622494592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.527543:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.527549:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad7d expref: 11 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.527567:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad7d expref: 11 pid: 7244 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.527589:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8d94 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad7d expref: 11 pid: 7244 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143777.527601:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622494464 00010000:00010000:3.0:1746143777.527604:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00000100:00100000:1.0:1746143777.527606:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622494464 00010000:00010000:3.0:1746143777.527608:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73a8db7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.527618:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73a8db7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.527624:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73a8db7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143777.527635:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12850 00010000:00010000:3.0:1746143777.527638:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143777.527641:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:32135:x1830963622494464:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143777.527664:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143777.527674:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622494592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 145us (301us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143777.527678:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73a8dbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ada0 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.527680:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5517 00010000:00010000:3.0:1746143777.527700:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73a8db7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143777.527709:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73a8db7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143777.527724:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143777.527746:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527754:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527761:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527772:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a8dd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527777:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a8dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527782:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a8dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143777.527824:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a8db0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad99 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.527838:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73a8db7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad99 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.527844:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.527847:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143777.527848:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1800, rc 0) 00010000:00010000:1.0:1746143777.527853:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73a8dda lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527860:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73a8dda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527865:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73a8dda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:3.0:1746143777.527868:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32131:x1830963622494208:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 12580us (12752us total) trans 8589943600 rc 0/0 00000004:00200000:1.0:1746143777.527870:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000100:00100000:3.0:1746143777.527872:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12849 00010000:00010000:1.0:1746143777.527900:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527944:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527951:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527957:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527962:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097107a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143777.527965:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527972:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527979:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143777.527982:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143777.527985:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.527990:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x87925e4cb73a8dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.528002:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a8dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.528007:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a8dd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.528012:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a8dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.528017:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097106800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143777.528019:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a8dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.528024:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a8dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.528030:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e030700) 00010000:00010000:1.0:1746143777.528032:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143777.528034:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a8dd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.528038:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73a8dd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.528063:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73a8dbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada0 expref: 29 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.528072:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73a8dda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada0 expref: 28 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.528592:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143777.528594:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143777.528596:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107c00, rc 0) 00000100:00100000:1.0:1746143777.528630:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:32135:x1830963622494464:12345-192.168.202.3@tcp:101:cat.0 Request processed in 989us (1349us total) trans 8589943601 rc 0/0 00000100:00100000:1.0:1746143777.528639:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12850 00000100:00100000:0.0:1746143777.530444:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.530655:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622494848 00000100:00100000:1.0:1746143777.530664:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622494848 00000100:00100000:1.0:1746143777.530716:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12851 00000100:00100000:1.0:1746143777.530724:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32131:x1830963622494848:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143777.530749:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.530753:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143777.530776:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73a8db7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad99 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.530790:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143777.530794:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143777.530805:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x87925e4cb73a8de8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ada7 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.530895:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.530907:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143777.530965:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143777.530976:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143777.531079:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x87925e4cb73a8de8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada7 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.531095:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada7 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.531100:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143777.531102:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143777.531104:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c529c00, rc 0) 00000100:00100000:1.0:1746143777.531161:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32131:x1830963622494848:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 437us (724us total) trans 8589943602 rc 0/0 00000100:00100000:1.0:1746143777.531168:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12851 00000100:00100000:0.0:1746143777.534520:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.534584:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622495104 00000100:00100000:3.0:1746143777.534594:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622495104 00002000:00100000:3.0:1746143777.534639:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880093070380 x1830963622495104/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 504/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.534649:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070380 with x1830963622495104 ext(2097152->4194303) 00002000:00010000:3.0:1746143777.534654:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093070380 00000100:00100000:3.0:1746143777.534686:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3377 00000100:00100000:3.0:1746143777.534694:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622495104:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143777.538421:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.538466:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.538747:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622495232 00000100:00100000:2.0:1746143777.538754:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622495232 00000100:00100000:2.0:1746143777.538787:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622495360 00000100:00100000:2.0:1746143777.538789:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622495360 00000100:00100000:2.0:1746143777.538808:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11714 00000100:00100000:2.0:1746143777.538814:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622495232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.538828:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.538843:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73a8dfd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840adae expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.538862:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.538864:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.538871:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73a8dfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adae expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.538883:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73a8dfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adae expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.538892:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800972eda00, rc 0) 00000100:00100000:2.0:1746143777.538956:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622495232:12345-192.168.202.3@tcp:101:cat.0 Request processed in 142us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.538962:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11714 00000100:00100000:2.0:1746143777.538978:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11715 00000100:00100000:2.0:1746143777.538982:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622495360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.538989:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.538997:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73a8e04 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840adb5 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.539030:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626732288:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143777.539076:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5610c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.542698:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.542740:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.542762:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622495744 00000100:00100000:3.0:1746143777.542770:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622495744 00000100:00100000:3.0:1746143777.542909:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622495488 00000100:00100000:3.0:1746143777.542944:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622495488 00000100:00100000:3.0:1746143777.542967:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12852 00000100:00100000:3.0:1746143777.542975:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:32136:x1830963622495744:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143777.543002:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.543023:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a8e0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840adc3 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.543100:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.543115:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.543125:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.543136:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73a8e19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.543141:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73a8e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.543145:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73a8e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.543245:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.543256:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada7 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.543263:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.543294:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada7 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.543306:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada7 expref: 11 pid: 10936 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.543319:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626732416:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.543394:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143777.543399:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12853 00000100:00100000:2.0:1746143777.543417:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32131:x1830963622495488:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143777.543439:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.543457:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7dc00/0x87925e4cb73a8e27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840adbc expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.543505:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7dc00/0x87925e4cb73a8e27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adbc expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.543516:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7dc00/0x87925e4cb73a8e27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adbc expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.543529:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143777.543532:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143777.543534:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7dc00, rc 0) 00000100:00100000:2.0:1746143777.543581:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32131:x1830963622495488:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 171us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.543587:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12853 00000100:00100000:0.0:1746143777.546337:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.546391:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.546611:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622495872 00000100:00100000:2.0:1746143777.546620:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622495872 00000100:00100000:2.0:1746143777.546672:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 756 00000100:00100000:2.0:1746143777.546681:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622495872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.546697:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.546724:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73a8dda lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada0 expref: 30 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.546745:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143777.546750:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143777.546757:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.546796:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622495872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 115us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.546803:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 756 00000100:00100000:3.0:1746143777.546892:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622496128 00000100:00100000:3.0:1746143777.546896:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622496128 00000100:00100000:3.0:1746143777.546957:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12854 00000100:00100000:3.0:1746143777.546962:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+278:32138:x1830963622496128:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143777.546985:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.546998:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8e2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840adca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.547072:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.547084:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.547092:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.547101:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8e3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.547106:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.547111:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.547208:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.547215:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.547221:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143777.548067:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.548113:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622496256 00000100:00100000:1.0:1746143777.548118:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622496256 00010000:00010000:1.0:1746143777.548135:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada7 expref: 12 pid: 10936 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143777.548154:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5518 00000100:00100000:1.0:1746143777.548160:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622496256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143777.548167:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143777.548171:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada7 expref: 12 pid: 10936 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143777.548181:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada7 expref: 12 pid: 10936 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143777.548195:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143777.548198:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143777.548204:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143777.548209:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143777.548214:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143777.548218:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143777.548223:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143777.548240:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143777.548276:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622496256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 116us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.548282:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5518 00010000:00010000:3.0:1746143777.548569:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548581:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143777.548583:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626732288:192.168.202.3@tcp:106: 00000004:00200000:3.0:1746143777.548598:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143777.548611:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73a8e04 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adb5 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.548622:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73a8e04 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adb5 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.548632:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800972eca00, rc 0) 00000100:00100000:2.0:1746143777.548657:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622495360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9674us (10190us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143777.548664:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11715 00010000:00010000:3.0:1746143777.548680:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548686:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548691:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548695:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db02800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.548698:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548704:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548716:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.548719:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143777.548722:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548726:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db02800/0x87925e4cb73a8e43 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548751:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548755:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548759:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548763:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548766:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012224fa00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.548768:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548776:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548784:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143777.548786:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.548788:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548793:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a8e35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548801:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548806:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8e3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548810:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8e3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548814:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012224fc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.548816:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8e3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548820:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8e3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548825:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800937acf00) 00010000:00010000:3.0:1746143777.548826:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.548828:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8e3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548832:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8e3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.548869:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8e2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adca expref: 280 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.548876:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73a8e2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adca expref: 280 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.548882:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429400, rc 0) 00000100:00100000:3.0:1746143777.548971:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+279:32138:x1830963622496128:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2006us (2578us total) trans 8589943603 rc 301/301 00000100:00100000:3.0:1746143777.548978:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12854 00010000:00010000:3.0:1746143777.549023:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73a8def lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ada7 expref: 11 pid: 10936 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.549034:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626732416:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.549049:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549055:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549059:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143777.549066:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143777.549092:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549097:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549101:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143777.549104:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622495104:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14410us (14592us total) trans 0 rc 1830912/1830912 00010000:00010000:3.0:1746143777.549105:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad35800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.549107:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549112:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143777.549113:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3377 00010000:00010000:3.0:1746143777.549118:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00002000:00100000:1.0:1746143777.549121:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880093070380 x1830963622495104/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 504/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1830912/1830912 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.549128:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070380 with x1830963622495104 ext(2097152->4194303) 00010000:00010000:3.0:1746143777.549130:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143777.549133:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00002000:00010000:1.0:1746143777.549133:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093070380 00010000:00010000:3.0:1746143777.549138:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8e20 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549148:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549151:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549155:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549158:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549162:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.549164:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549168:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549174:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143777.549179:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.549181:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549185:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a8e12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549193:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73a8e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549197:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73a8e19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549201:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73a8e19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549205:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.549207:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73a8e19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549210:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73a8e19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549215:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800937acf00) 00010000:00010000:3.0:1746143777.549217:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.549219:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73a8e19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549222:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73a8e19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143777.549245:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a8e0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adc3 expref: 29 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.549250:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a8e0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adc3 expref: 29 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.549256:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1400, rc 0) 00000100:00100000:3.0:1746143777.549272:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:32136:x1830963622495744:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6299us (6586us total) trans 8589943604 rc 301/301 00000100:00100000:3.0:1746143777.549277:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12852 00000100:00100000:0.0:1746143777.549869:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.549899:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.549956:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.549969:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.549980:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.549995:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622496512 00000100:00100000:0.0:1746143777.549999:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622496512 00000100:00100000:0.0:1746143777.550020:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622496768 00000100:00100000:0.0:1746143777.550022:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622496768 00000100:00100000:0.0:1746143777.550032:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622497024 00000100:00100000:0.0:1746143777.550033:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622497024 00000100:00100000:0.0:1746143777.550042:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622496384 00000100:00100000:0.0:1746143777.550043:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622496384 00000100:00100000:0.0:1746143777.550051:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622496640 00000100:00100000:0.0:1746143777.550052:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622496640 00000100:00100000:0.0:1746143777.550063:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11716 00000100:00100000:0.0:1746143777.550068:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622496512:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143777.550099:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.550112:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.550123:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73a8dfd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adae expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.550129:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a8d9b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad84 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.550134:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.550136:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.550139:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.550167:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a8d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad84 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.550178:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a8d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad84 expref: 11 pid: 3135 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143777.550189:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626732544:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143777.550248:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73a8dfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adae expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.550256:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73a8dfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adae expref: 8 pid: 13436 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143777.550263:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626732672:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143777.550285:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.550292:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 23 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143777.550299:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626732800:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143777.550314:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.550348:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.550412:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622496896 00000100:00100000:3.0:1746143777.550419:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622496896 00000100:00100000:3.0:1746143777.550454:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11717 00000100:00100000:3.0:1746143777.550461:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622496768:12345-192.168.202.3@tcp:1:mirror_io.0 00000100:00100000:2.0:1746143777.550483:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11718 00000100:00100000:2.0:1746143777.550491:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622497024:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143777.550494:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.550511:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.550512:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.550519:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55da00/0x87925e4cb73a8be2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac96 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.550521:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.550526:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8b8e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac73 expref: 7 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.550526:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143777.550528:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143777.550530:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.550532:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.550534:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.550536:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.550543:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.550550:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 23 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.550557:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626732928:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.550561:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8b8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac73 expref: 7 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.550572:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8b8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac73 expref: 7 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.550579:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5610c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.550583:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626733056:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.550594:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11719 00000100:00100000:2.0:1746143777.550601:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622496384:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143777.550618:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.550625:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55da00/0x87925e4cb73a8be2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac96 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.550627:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a8869 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac1 expref: 22 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.550632:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55da00/0x87925e4cb73a8be2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac96 expref: 11 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.550638:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a896c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab46 expref: 7 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143777.550640:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626733184:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.550644:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a889a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaeb expref: 11 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.550649:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.550650:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.550652:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.550656:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.550662:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 22 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.550667:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a889a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaeb expref: 11 pid: 12328 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143777.550668:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626733312:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.550675:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a889a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaeb expref: 11 pid: 12328 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143777.550677:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143777.550683:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626733440:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.550693:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11720 00000100:00100000:3.0:1746143777.550699:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622496640:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143777.550712:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a896c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab46 expref: 7 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.550713:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.550720:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a896c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab46 expref: 7 pid: 1947 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.550722:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a8877 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aacf expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.550728:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4fbb000/0x87925e4cb73a8973 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab54 expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143777.550728:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626733568:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.550734:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73a88a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf9 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.550739:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.550740:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.550742:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.550753:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73a88a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf9 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.550753:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a8869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac1 expref: 22 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.550760:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73a88a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf9 expref: 11 pid: 3134 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.550762:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a8869 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac1 expref: 22 pid: 1945 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143777.550767:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626733824:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.550770:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626733696:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.550788:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4fbb000/0x87925e4cb73a8973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab54 expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143777.550788:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746143777.550794:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4fbb000/0x87925e4cb73a8973 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab54 expref: 8 pid: 9839 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143777.550800:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626733952:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.550805:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11721 00000100:00100000:2.0:1746143777.550811:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622496896:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143777.550815:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a8877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aacf expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.550821:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a8877 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aacf expref: 23 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.550828:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.550832:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626734080:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.550837:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.550840:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbea80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143777.550844:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1000/0x87925e4cb73a8da2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad8b expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.550850:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.550856:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.550857:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.550859:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.550880:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.550888:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 7 pid: 1945 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.550896:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626734208:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.552848:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c1000/0x87925e4cb73a8da2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad8b expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.552862:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1000/0x87925e4cb73a8da2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad8b expref: 11 pid: 1945 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746143777.552874:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626734336:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.552948:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.552957:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 22 pid: 1945 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.552965:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626734464:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.552990:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143777.568893:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626732800:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.570994:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626732928:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.571028:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.571139:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626732544:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.571747:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626733824:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.571756:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626733952:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.571762:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626734080:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.571787:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.571806:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626733056:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.571815:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626733184:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.571822:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626733312:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.571841:0:3134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.571897:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626733440:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.571903:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626733568:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.571909:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626733696:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.571968:0:9839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.571987:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626732672:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.572003:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.572023:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626734208:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.572029:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626734336:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.572035:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626734464:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.572048:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143777.572868:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.572909:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.572960:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.572980:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.573178:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622497536 00000100:00100000:3.0:1746143777.573185:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622497536 00010000:00010000:3.0:1746143777.573220:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55da00/0x87925e4cb73a8be2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac96 expref: 12 pid: 1945 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143777.573250:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622497152 00000100:00100000:3.0:1746143777.573252:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622497152 00010000:00010000:3.0:1746143777.573262:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a8d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad84 expref: 12 pid: 3135 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143777.573273:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622497408 00000100:00100000:3.0:1746143777.573274:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622497408 00010000:00010000:3.0:1746143777.573282:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73a8dfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adae expref: 9 pid: 13436 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143777.573306:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5519 00000100:00100000:3.0:1746143777.573313:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622497536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.573327:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.573348:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55da00/0x87925e4cb73a8be2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac96 expref: 12 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.573358:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55da00/0x87925e4cb73a8be2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac96 expref: 12 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.573381:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55da00/0x87925e4cb73a8be2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac96 expref: 12 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.573399:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.573437:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622497536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 125us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.573444:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5519 00000100:00100000:3.0:1746143777.573458:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5520 00000100:00100000:3.0:1746143777.573462:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622497152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.573470:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.573480:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a8d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad84 expref: 12 pid: 3135 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.573488:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a8d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad84 expref: 12 pid: 3135 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.573500:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73a8d9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad84 expref: 12 pid: 3135 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.573508:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.573519:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622497152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 57us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.573523:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5520 00000100:00100000:3.0:1746143777.573531:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5521 00000100:00100000:3.0:1746143777.573534:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622497408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.573540:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.573544:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73a8dfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adae expref: 9 pid: 13436 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.573551:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73a8dfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adae expref: 9 pid: 13436 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.573561:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73a8dfd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adae expref: 9 pid: 13436 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.573568:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.573577:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622497408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 43us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.573581:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5521 00000100:00100000:1.0:1746143777.573888:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622497280 00000100:00100000:1.0:1746143777.573892:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622497280 00002000:00100000:1.0:1746143777.573961:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2625536->2891775) req@ffff88012b7e1f80 x1830963622497280/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.573969:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e1f80 with x1830963622497280 ext(2625536->2891775) 00010000:00010000:1.0:1746143777.573976:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 24 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143777.573985:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 24 pid: 9587 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746143777.573991:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b7e1f80 00000100:00100000:1.0:1746143777.574009:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1420 00000100:00100000:1.0:1746143777.574019:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622497280:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143777.582656:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.583407:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.583601:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.583614:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622498432 00000100:00100000:2.0:1746143777.583624:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622498432 00010000:00010000:2.0:1746143777.583660:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 23 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.587448:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622498688 00000100:00100000:2.0:1746143777.587463:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622498688 00010000:00010000:2.0:1746143777.587508:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a8869 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac1 expref: 24 pid: 1945 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746143777.587540:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622497792 00000100:00100000:2.0:1746143777.587543:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622497792 00010000:00010000:2.0:1746143777.587556:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4fbb000/0x87925e4cb73a8973 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab54 expref: 8 pid: 9839 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746143777.587573:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5522 00000100:00100000:2.0:1746143777.587581:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2011:x1830963622498432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.587598:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.587623:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 24 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.587635:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 24 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.587659:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408de00/0x87925e4cb73a8b80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac65 expref: 24 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.587681:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.587729:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622498432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 149us (5085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.587735:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5522 00000100:00100000:2.0:1746143777.587752:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5523 00000100:00100000:2.0:1746143777.587757:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963622498688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.587763:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.587771:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a8869 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac1 expref: 22 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.587779:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a8869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac1 expref: 22 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.587790:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a8869 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aac1 expref: 22 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.587801:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.587815:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+21:2011:x1830963622498688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 58us (4409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.587820:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5523 00000100:00100000:2.0:1746143777.587830:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5524 00000100:00100000:2.0:1746143777.587835:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622497792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.587842:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.587854:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4fbb000/0x87925e4cb73a8973 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab54 expref: 8 pid: 9839 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.587861:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4fbb000/0x87925e4cb73a8973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab54 expref: 8 pid: 9839 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.587873:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4fbb000/0x87925e4cb73a8973 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab54 expref: 8 pid: 9839 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.587882:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.587895:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622497792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (4294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.587901:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5524 00000100:00100000:2.0:1746143777.588035:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.588048:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622498048 00000100:00100000:2.0:1746143777.588051:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622498048 00010000:00010000:2.0:1746143777.588061:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a889a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaeb expref: 11 pid: 12328 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746143777.588071:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5525 00000100:00100000:2.0:1746143777.588075:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622498048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.588081:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.588086:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a889a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaeb expref: 11 pid: 12328 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.588094:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a889a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaeb expref: 11 pid: 12328 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.588103:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73a889a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaeb expref: 11 pid: 12328 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.588111:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.588123:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622498048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.588128:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5525 00000100:00100000:2.0:1746143777.588194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.588202:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622498304 00000100:00100000:2.0:1746143777.588204:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622498304 00010000:00010000:2.0:1746143777.588213:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1000/0x87925e4cb73a8da2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad8b expref: 10 pid: 1945 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746143777.588223:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5526 00000100:00100000:2.0:1746143777.588227:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622498304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.588233:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.588239:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1000/0x87925e4cb73a8da2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad8b expref: 10 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.588246:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c1000/0x87925e4cb73a8da2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad8b expref: 10 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.588256:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1000/0x87925e4cb73a8da2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad8b expref: 10 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.588263:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.588273:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622498304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 46us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.588278:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5526 00000100:00100000:2.0:1746143777.588302:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.588310:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622498816 00000100:00100000:2.0:1746143777.588312:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622498816 00010000:00010000:2.0:1746143777.588319:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 21 pid: 1945 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.588328:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5527 00000100:00100000:2.0:1746143777.588332:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+21:2009:x1830963622498816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.588338:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.588343:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 21 pid: 1945 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.588350:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 21 pid: 1945 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.588359:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097368a00/0x87925e4cb73a8ce5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad29 expref: 21 pid: 1945 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.588367:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.588377:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+20:2009:x1830963622498816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 44us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.588382:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5527 00000100:00100000:2.0:1746143777.588407:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.588420:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622499072 00000100:00100000:2.0:1746143777.588422:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622499072 00000100:00100000:2.0:1746143777.588439:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11722 00000100:00100000:2.0:1746143777.588443:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622499072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.588457:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.588467:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8e82 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840add1 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.588481:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.588486:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8e82 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add1 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.588501:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73a8e82 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add1 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.588508:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467c00, rc 0) 00000100:00100000:2.0:1746143777.588519:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622499072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 76us (112us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143777.588523:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11722 00000100:00100000:2.0:1746143777.588550:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.588559:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622499328 00000100:00100000:2.0:1746143777.588562:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622499328 00000100:00100000:2.0:1746143777.588575:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11723 00000100:00100000:2.0:1746143777.588579:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622499328:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.588585:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.588592:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466e00/0x87925e4cb73a8e89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840addf expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.588601:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.588605:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466e00/0x87925e4cb73a8e89 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840addf expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.588612:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466e00/0x87925e4cb73a8e89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840addf expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.588619:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466e00, rc 0) 00000100:00100000:2.0:1746143777.588632:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622499328:12345-192.168.202.3@tcp:101:cat.0 Request processed in 53us (82us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143777.588637:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11723 00000100:00100000:2.0:1746143777.588667:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.588675:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622499584 00000100:00100000:2.0:1746143777.588678:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622499584 00000100:00100000:2.0:1746143777.588691:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11724 00000100:00100000:2.0:1746143777.588695:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622499584:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.588700:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.588706:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466c00/0x87925e4cb73a8e90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aded expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.588714:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.588718:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466c00/0x87925e4cb73a8e90 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aded expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.588724:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466c00/0x87925e4cb73a8e90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aded expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.588729:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466c00, rc 0) 00000100:00100000:2.0:1746143777.588742:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622499584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 47us (76us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143777.588747:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11724 00000100:00100000:2.0:1746143777.588777:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.588786:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622497664 00000100:00100000:2.0:1746143777.588789:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622497664 00010000:00010000:2.0:1746143777.588797:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8b8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac73 expref: 8 pid: 3135 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.588812:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5528 00000100:00100000:2.0:1746143777.588816:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622497664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.588821:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.588828:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8b8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac73 expref: 8 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.588835:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8b8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac73 expref: 8 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.588844:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8b8e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac73 expref: 8 pid: 3135 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.588851:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.588852:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.588857:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.588864:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.588902:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.588943:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622497664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 126us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.588948:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5528 00010000:00010000:2.0:1746143777.588965:0:3134:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.588977:0:3134:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.588992:0:3134:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.588999:0:3134:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589005:0:3134:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589010:0:3134:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b47a200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143777.589014:0:3134:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589022:0:3134:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589029:0:3134:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589035:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8e5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.589069:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622496768:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 38609us (39169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.589075:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11717 00000100:00100000:2.0:1746143777.589107:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.589115:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622497920 00000100:00100000:2.0:1746143777.589118:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622497920 00010000:00010000:2.0:1746143777.589128:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 26 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.589139:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5529 00000100:00100000:2.0:1746143777.589143:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622497920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.589148:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.589157:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 26 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.589164:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 26 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.589175:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73a8d78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad76 expref: 26 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.589183:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.589184:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.589186:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589192:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589208:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.589220:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622497920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.589224:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5529 00010000:00010000:2.0:1746143777.589245:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589251:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589261:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589267:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589273:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589278:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143777.589280:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589287:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589300:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.589306:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73a8e58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.589839:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622496512:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 39770us (39970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.589845:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11716 00000100:00100000:2.0:1746143777.589881:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.589892:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622498176 00000100:00100000:2.0:1746143777.589895:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622498176 00010000:00010000:2.0:1746143777.589905:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73a88a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf9 expref: 10 pid: 3134 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746143777.590985:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5530 00000100:00100000:2.0:1746143777.590991:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622498176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143777.591051:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.591075:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.591087:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.591096:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.591108:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.591118:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.591126:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622498560 00000100:00100000:0.0:1746143777.591129:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622498560 00010000:00010000:0.0:1746143777.591144:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 7 pid: 1945 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143777.591155:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622498944 00000100:00100000:0.0:1746143777.591157:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622498944 00010000:00010000:0.0:1746143777.591164:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a8877 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aacf expref: 26 pid: 1945 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143777.591170:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622499840 00000100:00100000:0.0:1746143777.591171:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622499840 00010000:00010000:0.0:1746143777.591177:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a896c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab46 expref: 8 pid: 1947 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143777.591184:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5531 00000100:00100000:0.0:1746143777.591188:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622498560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143777.591198:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143777.591210:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 8 pid: 1945 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143777.591217:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 8 pid: 1945 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143777.591234:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a8cec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad30 expref: 8 pid: 1945 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143777.591249:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.591250:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.591254:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.591260:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.591281:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143777.591295:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622498560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143777.591299:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5531 00000100:00100000:0.0:1746143777.591309:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5532 00000100:00100000:0.0:1746143777.591312:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622498944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143777.591319:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143777.591326:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a8877 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aacf expref: 26 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143777.591333:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a8877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aacf expref: 26 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143777.591343:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73a8877 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aacf expref: 26 pid: 1945 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143777.591352:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143777.591360:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622498944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 48us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.591374:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5533 00000100:00100000:0.0:1746143777.591382:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5532 00000100:00100000:3.0:1746143777.591390:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2008:x1830963622499840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143777.591396:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.591403:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.591407:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143777.591419:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.591425:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.591428:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a896c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab46 expref: 6 pid: 1947 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143777.591431:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.591435:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880123268600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143777.591438:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.591440:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a896c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab46 expref: 6 pid: 1947 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143777.591443:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.591450:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.591454:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73a8e7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.591459:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a896c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab46 expref: 6 pid: 1947 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.591481:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.591483:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143777.591483:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622496896:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 40672us (41134us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143777.591487:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143777.591487:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11721 00010000:00010000:3.0:1746143777.591495:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143777.591499:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622499200 00000100:00100000:0.0:1746143777.591502:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622499200 00000100:00100000:0.0:1746143777.591515:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622499456 00010000:00010000:3.0:1746143777.591516:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143777.591516:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622499456 00000100:00100000:0.0:1746143777.591525:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622499712 00000100:00100000:0.0:1746143777.591527:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622499712 00000100:00100000:0.0:1746143777.591536:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11725 00000100:00100000:1.0:1746143777.591539:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622497280:12345-192.168.202.3@tcp:4:cat.0 Request processed in 17520us (18674us total) trans 17179872977 rc 0/0 00000100:00100000:0.0:1746143777.591540:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622499200:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143777.591547:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1420 00010000:00010000:0.0:1746143777.591551:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143777.591553:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2008:x1830963622499840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 169us (432us total) trans 0 rc 0/0 00002000:00100000:1.0:1746143777.591556:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2625536->2891775) req@ffff88012b7e1f80 x1830963622497280/t17179872977(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/448 e 0 to 0 dl 1746143788 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143777.591561:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5533 00010000:00010000:0.0:1746143777.591562:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73a8e97 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840add8 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143777.591564:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e1f80 with x1830963622497280 ext(2625536->2891775) 00010000:00010000:1.0:1746143777.591570:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 24 pid: 9587 timeout: 936 lvb_type: 0 00002000:00010000:0.0:1746143777.591574:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a21, atime: 0x68140a20, ctime: 0x68140a21, blocks: 0x808 00010000:00010000:1.0:1746143777.591579:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 24 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143777.591583:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746143777.591585:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b7e1f80 00010000:00010000:0.0:1746143777.591585:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.591586:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.591590:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73a8e97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add8 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.591593:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.591600:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73a8e97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add8 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.591606:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143777.591608:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11726 00010000:00010000:0.0:1746143777.591608:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7fa00, rc 0) 00010000:00010000:3.0:1746143777.591612:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143777.591613:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2009:x1830963622499456:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.591618:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.591620:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143777.591620:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622499200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 79us (532us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143777.591623:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d7c200 already unused, calling callback (ffffffffa0864d70) 00000100:00100000:0.0:1746143777.591624:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11725 00010000:00010000:3.0:1746143777.591626:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.591627:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a8e9e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ade6 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.591632:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143777.591632:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11727 00000100:00100000:0.0:1746143777.591636:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622499712:12345-192.168.202.3@tcp:101:cat.0 00002000:00010000:1.0:1746143777.591638:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a21, atime: 0x68140a20, ctime: 0x68140a21, blocks: 0x808 00010000:00010000:0.0:1746143777.591640:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.591641:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.591644:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.591644:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a8ea5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840adf4 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.591646:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8e6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.591646:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.591650:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a8e9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ade6 expref: 6 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.591659:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a8e9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ade6 expref: 6 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.591665:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96800, rc 0) 00000100:00100000:1.0:1746143777.591675:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2009:x1830963622499456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 62us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143777.591676:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626734592:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143777.591679:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11726 00000100:00100000:3.0:1746143777.591688:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2009:x1830963622496384:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 41088us (41717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.591695:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11719 00000100:00100000:0.0:1746143777.591715:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143777.591724:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.591730:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622500096 00000100:00100000:1.0:1746143777.591736:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.591739:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622500096 00000100:00100000:1.0:1746143777.591749:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.592245:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622500352 00000100:00100000:3.0:1746143777.592246:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622500608 00000100:00100000:0.0:1746143777.592248:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622500352 00000100:00100000:3.0:1746143777.592252:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622500608 00000100:00100000:1.0:1746143777.592257:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11728 00000100:00100000:1.0:1746143777.592262:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622500096:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143777.592269:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143777.592269:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11729 00000100:00100000:0.0:1746143777.592274:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+20:2009:x1830963622500352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143777.592276:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a8eac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae02 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.592280:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143777.592283:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11730 00010000:00010000:0.0:1746143777.592285:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8eb3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae10 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.592287:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.592288:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143777.592289:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622500608:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143777.592292:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a8eac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae02 expref: 26 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.592293:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.592294:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.592298:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae10 expref: 21 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.592301:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.592301:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a8eac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae02 expref: 26 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.592306:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae10 expref: 21 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.592308:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97000, rc 0) 00010000:00010000:3.0:1746143777.592312:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a8eba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae1e expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.592312:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012224fc00, rc 0) 00000100:00100000:1.0:1746143777.592320:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622500096:12345-192.168.202.3@tcp:101:cat.0 Request processed in 58us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143777.592321:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+21:2009:x1830963622500352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 47us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.592325:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11728 00000100:00100000:0.0:1746143777.592327:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11729 00000100:00100000:3.0:1746143777.592346:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626734720:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143777.592351:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.592364:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.592366:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622499968 00000100:00100000:0.0:1746143777.592368:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622499968 00000100:00100000:3.0:1746143777.592384:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.592385:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11731 00000100:00100000:0.0:1746143777.592390:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+21:2009:x1830963622499968:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143777.592396:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143777.592398:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622500224 00000100:00100000:3.0:1746143777.592401:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622500224 00010000:00010000:0.0:1746143777.592403:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8ec1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840adfb expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143777.592412:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a20, atime: 0x68140a20, ctime: 0x68140a20, blocks: 0x7d8 00000100:00100000:3.0:1746143777.592415:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11732 00000100:00100000:3.0:1746143777.592419:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622500224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143777.592420:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.592421:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.592425:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143777.592425:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8ec1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adfb expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.592431:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8ec8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae09 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.592433:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8ec1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adfb expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.592439:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad35800, rc 0) 00010000:00010000:3.0:1746143777.592440:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.592445:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8ec8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae09 expref: 28 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.592458:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8ec8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae09 expref: 28 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.592464:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d800, rc 0) 00000100:00100000:0.0:1746143777.592768:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622499968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 377us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143777.592774:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11731 00000100:00100000:3.0:1746143777.592775:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622500224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 353us (407us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143777.592781:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11732 00000100:00100000:1.0:1746143777.592822:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.592882:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622500480 00000100:00100000:3.0:1746143777.592885:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622500480 00000100:00100000:3.0:1746143777.592903:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11733 00000100:00100000:3.0:1746143777.592907:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622500480:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.592944:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.592954:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae17 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143777.592966:0:13430:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4964768, mtime: 0x68140a21, atime: 0x68140a21, ctime: 0x68140a21, blocks: 0x15f0 00010000:00010000:3.0:1746143777.592974:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.592975:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.592981:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 23 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.592990:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 23 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.592995:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.592998:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b47bc00, rc 0) 00010000:00010000:2.0:1746143777.593011:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73a88a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf9 expref: 10 pid: 3134 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143777.593012:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622500480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 104us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.593017:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11733 00010000:00010000:2.0:1746143777.593022:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73a88a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf9 expref: 10 pid: 3134 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.593034:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73a88a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aaf9 expref: 10 pid: 3134 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746143777.593043:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.593044:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.593051:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.593057:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.593075:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143777.593087:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.593087:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622498176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2097us (3206us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143777.593094:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.593096:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5530 00010000:00010000:3.0:1746143777.593108:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.593114:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.593120:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.593125:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ee77000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143777.593128:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.593134:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.593144:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.593154:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73a8e74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.593184:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622496640:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 42485us (43202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.593190:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11720 00000100:00100000:2.0:1746143777.603399:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143777.603424:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143777 -> 1746143778 00000100:00100000:0.0:1746143777.603448:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626734592:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143777.603485:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a8ea5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adf4 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.603500:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73a8ea5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adf4 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.603516:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ec00, rc 0) 00000100:00100000:0.0:1746143777.603578:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622499712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11938us (12466us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143777.603587:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11727 00010000:00010000:3.0:1746143777.603769:0:9839:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff88012b7a9500 x1830963626734720) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 26 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.603789:0:9839:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 26 pid: 9587 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.603809:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73a8d1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->2891775) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ad53 expref: 26 pid: 9587 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.603828:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626734720:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143777.603846:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.603848:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.603853:0:9839:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.603862:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.603888:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a8eba lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae1e expref: 25 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.603895:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73a8eba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae1e expref: 25 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.603901:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c200, rc 0) 00000100:00100000:3.0:1746143777.603957:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622500608:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11667us (12205us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143777.603963:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11730 00000100:00100000:3.0:1746143777.603987:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622500736 00000100:00100000:3.0:1746143777.603993:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622500736 00000100:00100000:3.0:1746143777.604029:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 757 00000100:00100000:3.0:1746143777.604036:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622500736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.604049:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.604051:0:10930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 87925e4cb73a8d1d) 00010000:00010000:3.0:1746143777.604053:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.604065:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622500736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 30us (676us total) trans 0 rc 116/116 00000100:00100000:3.0:1746143777.604070:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 757 00010000:00010000:2.0:1746143777.604193:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.604202:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.604222:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.604229:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.604235:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.604246:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d7d800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143777.604250:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.604265:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.604276:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.604281:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73a8e66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.604325:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622497024:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 53835us (54369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.604332:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11718 00000100:00100000:0.0:1746143777.623856:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.623894:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.623988:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622500992 00000100:00100000:1.0:1746143777.623996:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622500992 00002000:00100000:1.0:1746143777.624032:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095e30a80 x1830963622500992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.624041:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30a80 with x1830963622500992 ext(4194304->4968447) 00002000:00010000:1.0:1746143777.624045:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e30a80 00000100:00100000:1.0:1746143777.624074:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3378 00000100:00100000:1.0:1746143777.624082:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622500992:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143777.624643:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622501248 00000100:00100000:3.0:1746143777.624648:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622501248 00000100:00100000:3.0:1746143777.624674:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12855 00000100:00100000:3.0:1746143777.624678:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32131:x1830963622501248:12345-192.168.202.3@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143777.624706:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.624726:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7dc00/0x87925e4cb73a8e27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adbc expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.624747:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.624751:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.624781:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32131:x1830963622501248:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 102us (886us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746143777.624787:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12855 00000100:00100000:2.0:1746143777.625377:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.625825:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622501376 00000100:00100000:3.0:1746143777.625832:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622501376 00000100:00100000:3.0:1746143777.625868:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11734 00000100:00100000:3.0:1746143777.625874:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:32135:x1830963622501376:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.625888:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.625906:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73a8ed6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae25 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.625963:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.625965:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.625972:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73a8ed6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae25 expref: 7 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.625986:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73a8ed6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae25 expref: 7 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.625995:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c200, rc 0) 00000100:00100000:3.0:1746143777.626026:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:32135:x1830963622501376:12345-192.168.202.3@tcp:101:cat.0 Request processed in 152us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.626031:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11734 00000100:00100000:0.0:1746143777.642136:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.642504:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622501504 00000100:00100000:3.0:1746143777.642514:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622501504 00000100:00100000:0.0:1746143777.642581:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.643261:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622501632 00000100:00100000:3.0:1746143777.643265:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622501632 00000100:00100000:3.0:1746143777.643298:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11735 00000100:00100000:3.0:1746143777.643305:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:32138:x1830963622501504:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:0.0:1746143777.643320:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11736 00010000:00010000:3.0:1746143777.643325:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143777.643328:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:32136:x1830963622501632:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143777.643336:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.643344:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae2c expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.643349:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae33 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143777.643365:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a21, atime: 0x68140a22, ctime: 0x68140a21, blocks: 0x1008 00010000:00010000:3.0:1746143777.643375:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.643376:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 24 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.643377:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.643383:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.643384:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.643384:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.643387:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3428352->3891199] (req 3428352->3891199) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 8 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.643398:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.643406:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c800, rc 0) 00010000:00010000:0.0:1746143777.643416:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 24 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.643427:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 24 pid: 13430 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143777.643440:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626734848:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.643449:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:32138:x1830963622501504:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 145us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.643455:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11735 00000100:00100000:0.0:1746143777.643512:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143777.645237:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.645308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.645402:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626734848:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143777.645427:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3428352->3891199] (req 3428352->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 8 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.645441:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466e00, rc 0) 00000100:00100000:2.0:1746143777.645474:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32136:x1830963622501632:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2147us (2893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.645481:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11736 00000100:00100000:2.0:1746143777.645522:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622502144 00000100:00100000:2.0:1746143777.645527:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622502144 00002000:00100000:2.0:1746143777.645561:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2363392->2367487) req@ffff880095e32a00 x1830963622502144/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.645570:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32a00 with x1830963622502144 ext(2363392->2367487) 00002000:00010000:2.0:1746143777.645574:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32a00 00000100:00100000:2.0:1746143777.645587:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3379 00000100:00100000:2.0:1746143777.645592:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622502144:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143777.645772:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622501888 00000100:00100000:1.0:1746143777.645775:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622501888 00000100:00100000:1.0:1746143777.646078:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4703 00000100:00100000:1.0:1746143777.646085:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32131:x1830963622501888:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143777.648196:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622502144:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 2594us (2878us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143777.648209:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3379 00002000:00100000:2.0:1746143777.648224:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2363392->2367487) req@ffff880095e32a00 x1830963622502144/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.648233:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32a00 with x1830963622502144 ext(2363392->2367487) 00002000:00010000:2.0:1746143777.648239:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32a00 00000100:00100000:1.0:1746143777.648391:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32131:x1830963622501888:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 2305us (3159us total) trans 8589943605 rc 0/0 00000100:00100000:1.0:1746143777.648399:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4703 00000100:00100000:1.0:1746143777.648499:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.648543:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.648561:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622502528 00000100:00100000:0.0:1746143777.648567:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622502528 00002000:00100000:0.0:1746143777.648597:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880090e26a00 x1830963622502528/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143777.648601:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622500992:12345-192.168.202.3@tcp:3:cat.0 Request processed in 24521us (24752us total) trans 0 rc 774144/774144 00002000:00100000:0.0:1746143777.648604:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e26a00 with x1830963622502528 ext(0->1048575) 00000100:00100000:1.0:1746143777.648607:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3378 00002000:00010000:0.0:1746143777.648607:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e26a00 00002000:00100000:1.0:1746143777.648612:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095e30a80 x1830963622500992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.648619:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30a80 with x1830963622500992 ext(4194304->4968447) 00000100:00100000:0.0:1746143777.648625:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622502656 00010000:00010000:1.0:1746143777.648626:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 23 pid: 13430 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143777.648627:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622502656 00002000:00100000:0.0:1746143777.648637:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095e32d80 x1830963622502656/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143777.648639:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 23 pid: 13430 timeout: 936 lvb_type: 1 00002000:00100000:0.0:1746143777.648643:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32d80 with x1830963622502656 ext(1048576->2097151) 00002000:00010000:1.0:1746143777.648646:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e30a80 00002000:00010000:0.0:1746143777.648646:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32d80 00000100:00100000:0.0:1746143777.648657:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3380 00000100:00100000:1.0:1746143777.648661:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3381 00000100:00100000:0.0:1746143777.648662:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622502528:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143777.648665:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622502656:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143777.657345:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.657589:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622502912 00000100:00100000:1.0:1746143777.657599:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622502912 00002000:00100000:1.0:1746143777.657657:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (3039232->3043327) req@ffff88009391d880 x1830963622502912/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.657667:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d880 with x1830963622502912 ext(3039232->3043327) 00002000:00010000:1.0:1746143777.657673:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391d880 00000100:00100000:1.0:1746143777.657808:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3382 00000100:00100000:1.0:1746143777.657817:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622502912:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143777.658769:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622502912:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 951us (1433us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143777.658777:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3382 00002000:00100000:1.0:1746143777.658784:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (3039232->3043327) req@ffff88009391d880 x1830963622502912/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.658796:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d880 with x1830963622502912 ext(3039232->3043327) 00002000:00010000:1.0:1746143777.658800:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391d880 00000100:00100000:1.0:1746143777.660343:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622502656:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 11671us (11795us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143777.660352:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3381 00002000:00100000:1.0:1746143777.660359:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095e32d80 x1830963622502656/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.660366:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32d80 with x1830963622502656 ext(1048576->2097151) 00002000:00010000:1.0:1746143777.660371:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32d80 00000100:00100000:2.0:1746143777.660795:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.660815:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.660872:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622503168 00000100:00100000:0.0:1746143777.660879:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622503168 00000100:00100000:2.0:1746143777.660959:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.661132:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622503552 00000100:00100000:1.0:1746143777.661136:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622503552 00000100:00100000:1.0:1746143777.661166:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4704 00000100:00100000:1.0:1746143777.661173:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32131:x1830963622503552:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143777.661326:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.661355:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622503040 00000100:00100000:0.0:1746143777.661358:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622503040 00000100:00100000:0.0:1746143777.661376:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11737 00000100:00100000:3.0:1746143777.661416:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11738 00000100:00100000:3.0:1746143777.661424:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622503040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.661435:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.661455:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8eeb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae3a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143777.661480:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a20, atime: 0x68140a20, ctime: 0x68140a20, blocks: 0x800 00010000:00010000:3.0:1746143777.661499:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.661501:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.661510:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8eeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae3a expref: 26 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.661526:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8eeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae3a expref: 26 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.661536:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d800, rc 0) 00000100:00100000:3.0:1746143777.661779:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622503040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 356us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.661785:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11738 00000100:00100000:3.0:1746143777.661804:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622503296 00000100:00100000:3.0:1746143777.661807:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622503296 00010000:00010000:3.0:1746143777.661825:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 24 pid: 13430 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143777.661882:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5534 00000100:00100000:3.0:1746143777.661888:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622503296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.661898:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.661939:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 24 pid: 13430 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.661950:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 24 pid: 13430 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143777.661968:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b47bc00/0x87925e4cb73a8ecf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae17 expref: 24 pid: 13430 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143777.662042:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622503168:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143777.662051:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143777.662060:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a8ef2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae41 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143777.662073:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143777.662079:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a8ef2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae41 expref: 25 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.662087:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a8ef2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae41 expref: 25 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143777.662098:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467400, rc 0) 00000100:00100000:0.0:1746143777.662117:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622503168:12345-192.168.202.3@tcp:101:cat.0 Request processed in 736us (1324us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143777.662123:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11737 00010000:00010000:3.0:1746143777.662268:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.662270:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.662275:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 9 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.662283:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 9 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.662312:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 9 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.662324:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626734976:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143777.662430:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32131:x1830963622503552:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 1256us (1613us total) trans 8589943606 rc 0/0 00000100:00100000:1.0:1746143777.662437:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4704 00000100:00100000:3.0:1746143777.662680:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143777.663837:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622502528:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 15170us (15333us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143777.663846:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3380 00002000:00100000:2.0:1746143777.663855:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880090e26a00 x1830963622502528/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.663864:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e26a00 with x1830963622502528 ext(0->1048575) 00002000:00010000:2.0:1746143777.663870:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e26a00 00000100:00100000:0.0:1746143777.671729:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.671765:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.671989:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622503808 00000100:00100000:1.0:1746143777.672000:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622503808 00000100:00100000:1.0:1746143777.672050:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4705 00000100:00100000:1.0:1746143777.672059:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:32138:x1830963622503808:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143777.672094:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622503936 00000100:00100000:3.0:1746143777.672098:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622503936 00000100:00100000:3.0:1746143777.672127:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11739 00000100:00100000:3.0:1746143777.672132:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:32130:x1830963622503936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.672144:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.672161:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae48 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.672186:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 7 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.672202:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143777.672204:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143777.672207:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4964352->5242879] (req 4964352->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.672237:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 7 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.672248:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 7 pid: 12327 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.672261:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626735104:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143777.673959:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626734976:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143777.673986:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.675320:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143777.675526:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+280:32138:x1830963622503808:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 3462us (3801us total) trans 8589943607 rc 0/0 00000100:00100000:1.0:1746143777.675540:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4705 00000100:00100000:0.0:1746143777.675846:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.676003:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622504192 00000100:00100000:3.0:1746143777.676010:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622504192 00002000:00100000:3.0:1746143777.676051:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3428352->3432447) req@ffff88009391d180 x1830963622504192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.676061:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d180 with x1830963622504192 ext(3428352->3432447) 00010000:00010000:3.0:1746143777.676071:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 8 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.676084:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 8 pid: 12327 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143777.676091:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391d180 00000100:00100000:3.0:1746143777.676110:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1421 00000100:00100000:3.0:1746143777.676124:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622504192:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143777.676258:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622504192:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 134us (412us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143777.676265:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1421 00002000:00100000:3.0:1746143777.676270:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3428352->3432447) req@ffff88009391d180 x1830963622504192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.676277:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d180 with x1830963622504192 ext(3428352->3432447) 00010000:00010000:3.0:1746143777.676282:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 8 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.676290:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 8 pid: 12327 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143777.676296:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391d180 00000100:00100000:2.0:1746143777.676365:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622503296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 14470us (15032us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.676375:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5534 00000100:00100000:0.0:1746143777.676732:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.676830:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622504320 00000100:00100000:1.0:1746143777.676834:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622504320 00000100:00100000:1.0:1746143777.676856:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11740 00000100:00100000:1.0:1746143777.676861:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32135:x1830963622504320:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143777.676871:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.676887:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a8f00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae4f expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.676909:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.676939:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.676947:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a8f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae4f expref: 9 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.676962:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a8f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae4f expref: 9 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.676971:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635e00, rc 0) 00000100:00100000:1.0:1746143777.676992:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32135:x1830963622504320:12345-192.168.202.3@tcp:101:cat.0 Request processed in 131us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143777.676997:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11740 00000100:00100000:3.0:1746143777.677798:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626735104:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.677821:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4964352->5242879] (req 4964352->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 23 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.677832:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b47a200, rc 0) 00000100:00100000:3.0:1746143777.678135:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:32130:x1830963622503936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6001us (6367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.678142:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11739 00000100:00100000:0.0:1746143777.682778:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.682961:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622504704 00000100:00100000:2.0:1746143777.682972:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622504704 00002000:00100000:2.0:1746143777.683020:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88009391f800 x1830963622504704/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.683030:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f800 with x1830963622504704 ext(1048576->2097151) 00002000:00010000:2.0:1746143777.683037:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391f800 00000100:00100000:2.0:1746143777.683074:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3383 00000100:00100000:2.0:1746143777.683081:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622504704:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143777.683889:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.683952:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622504832 00000100:00100000:0.0:1746143777.683957:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622504832 00002000:00100000:0.0:1746143777.683977:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095c31f80 x1830963622504832/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143777.683990:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c31f80 with x1830963622504832 ext(1048576->2097151) 00002000:00010000:0.0:1746143777.683994:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c31f80 00000100:00100000:0.0:1746143777.684006:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3384 00000100:00100000:0.0:1746143777.684011:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622504832:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143777.687796:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.688035:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622505088 00000100:00100000:2.0:1746143777.688048:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622505088 00002000:00100000:2.0:1746143777.688092:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3887104->3891199) req@ffff88012d841500 x1830963622505088/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.688102:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841500 with x1830963622505088 ext(3887104->3891199) 00010000:00010000:2.0:1746143777.688112:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 10 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.688126:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 10 pid: 12327 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746143777.688133:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d841500 00000100:00100000:2.0:1746143777.688874:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1422 00000100:00100000:2.0:1746143777.688886:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622505088:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143777.689089:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622505088:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 206us (1303us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143777.689096:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1422 00002000:00100000:2.0:1746143777.689102:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3887104->3891199) req@ffff88012d841500 x1830963622505088/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.689109:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841500 with x1830963622505088 ext(3887104->3891199) 00010000:00010000:2.0:1746143777.689114:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 10 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.689124:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 10 pid: 12327 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746143777.689129:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d841500 00000100:00100000:2.0:1746143777.694844:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622504704:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 11751us (12067us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143777.694857:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3383 00002000:00100000:2.0:1746143777.694871:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88009391f800 x1830963622504704/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.694882:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f800 with x1830963622504704 ext(1048576->2097151) 00002000:00010000:2.0:1746143777.694889:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391f800 00000100:00100000:0.0:1746143777.696249:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.696296:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.696356:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622505344 00000100:00100000:3.0:1746143777.696365:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622505344 00000100:00100000:2.0:1746143777.696366:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622505600 00000100:00100000:2.0:1746143777.696369:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622505600 00000100:00100000:1.0:1746143777.696386:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622504832:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 12372us (12495us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143777.696395:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3384 00000100:00100000:2.0:1746143777.696400:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4706 00002000:00100000:3.0:1746143777.696401:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3428352->3891199) req@ffff880092b73100 x1830963622505344/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.696401:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095c31f80 x1830963622504832/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143777.696407:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:32136:x1830963622505600:12345-192.168.202.3@tcp:35:multiop.0 00002000:00100000:1.0:1746143777.696409:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c31f80 with x1830963622504832 ext(1048576->2097151) 00002000:00100000:3.0:1746143777.696410:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73100 with x1830963622505344 ext(3428352->3891199) 00002000:00010000:1.0:1746143777.696414:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c31f80 00010000:00010000:3.0:1746143777.696418:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 9 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.696430:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 8 pid: 12327 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143777.696436:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b73100 00000100:00100000:3.0:1746143777.696457:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1423 00000100:00100000:3.0:1746143777.696461:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622505344:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143777.698575:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32136:x1830963622505600:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 2159us (2322us total) trans 8589943608 rc 0/0 00000100:00100000:2.0:1746143777.698586:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4706 00000100:00100000:0.0:1746143777.707269:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622505344:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 10790us (10955us total) trans 21474840299 rc 0/0 00000100:00100000:0.0:1746143777.707285:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1423 00002000:00100000:0.0:1746143777.707301:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3428352->3891199) req@ffff880092b73100 x1830963622505344/t21474840299(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/448 e 0 to 0 dl 1746143788 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143777.707311:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73100 with x1830963622505344 ext(3428352->3891199) 00010000:00010000:0.0:1746143777.707323:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 10 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143777.707338:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 10 pid: 12327 timeout: 936 lvb_type: 0 00002000:00010000:0.0:1746143777.707345:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b73100 00000100:00100000:2.0:1746143777.708739:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.708819:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622505728 00000100:00100000:3.0:1746143777.708828:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622505728 00000100:00100000:3.0:1746143777.708876:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11741 00000100:00100000:3.0:1746143777.708885:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32135:x1830963622505728:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.708901:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.708939:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae56 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.708966:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143777.708968:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143777.708972:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.708984:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.709000:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504400, rc 0) 00000100:00100000:3.0:1746143777.710034:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32135:x1830963622505728:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1147us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.710042:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11741 00000100:00100000:0.0:1746143777.713323:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.713386:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622505856 00000100:00100000:2.0:1746143777.713395:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622505856 00010000:00010000:2.0:1746143777.713431:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 11 pid: 12327 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746143777.713470:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5535 00000100:00100000:2.0:1746143777.713476:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622505856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.713492:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143777.713509:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143777 -> 1746143778 00002000:00010000:2.0:1746143777.713512:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143777 -> 1746143778 00010000:00010000:2.0:1746143777.713517:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 11 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.713528:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 11 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.713548:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73a8ee4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3428352->3891199) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae33 expref: 11 pid: 12327 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.713577:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.713579:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.713587:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 22 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.713596:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 22 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.713603:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.713604:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.713607:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.713613:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.713642:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.713655:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626735232:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143777.713751:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 22 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143777.713759:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626735360:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143777.714957:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.718021:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626735232:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143777.718032:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626735360:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143777.718055:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.718243:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622505856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4763us (4926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.718254:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5535 00000100:00100000:0.0:1746143777.718785:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.720124:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622506240 00000100:00100000:2.0:1746143777.720134:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622506240 00002000:00100000:2.0:1746143777.720187:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880092b73800 x1830963622506240/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.720204:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73800 with x1830963622506240 ext(2097152->3145727) 00002000:00010000:2.0:1746143777.720211:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b73800 00000100:00100000:2.0:1746143777.720243:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3385 00000100:00100000:2.0:1746143777.720252:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622506240:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143777.721108:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.722669:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622506368 00000100:00100000:1.0:1746143777.722679:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622506368 00002000:00100000:1.0:1746143777.722723:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4964352->4968447) req@ffff8801368e9c00 x1830963622506368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.722734:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9c00 with x1830963622506368 ext(4964352->4968447) 00002000:00010000:1.0:1746143777.722739:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9c00 00000100:00100000:1.0:1746143777.722778:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3386 00000100:00100000:1.0:1746143777.722786:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622506368:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143777.722954:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622506368:12345-192.168.202.3@tcp:3:cat.0 Request processed in 168us (1846us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143777.722962:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3386 00002000:00100000:1.0:1746143777.722968:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4964352->4968447) req@ffff8801368e9c00 x1830963622506368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143777.722974:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9c00 with x1830963622506368 ext(4964352->4968447) 00002000:00010000:1.0:1746143777.722976:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9c00 00000100:00100000:2.0:1746143777.729464:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622506240:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9200us (10667us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143777.729476:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3385 00002000:00100000:2.0:1746143777.729490:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880092b73800 x1830963622506240/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.729499:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73800 with x1830963622506240 ext(2097152->3145727) 00002000:00010000:2.0:1746143777.729506:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b73800 00000100:00100000:0.0:1746143777.736083:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.736148:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.736661:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622506624 00000100:00100000:2.0:1746143777.736672:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622506624 00000100:00100000:2.0:1746143777.736732:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4707 00000100:00100000:2.0:1746143777.736741:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e249850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+280:32130:x1830963622506624:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143777.736797:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622506752 00000100:00100000:3.0:1746143777.736801:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622506752 00000100:00100000:3.0:1746143777.737180:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11742 00000100:00100000:3.0:1746143777.737187:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32135:x1830963622506752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.737198:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.737216:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae5d expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.737246:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.737254:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143777.737256:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143777.737260:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.737290:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.737311:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 25 pid: 9839 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.737322:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626735488:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.738132:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143777.738198:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e249850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+281:32130:x1830963622506624:12345-192.168.202.3@tcp:35:cat.0 Request processed in 1458us (2127us total) trans 8589943609 rc 0/0 00000100:00100000:2.0:1746143777.738207:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4707 00000100:00100000:3.0:1746143777.742133:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626735488:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.742172:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.742191:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e505c00, rc 0) 00000100:00100000:3.0:1746143777.742239:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32135:x1830963622506752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5051us (6090us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.742248:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11742 00000100:00100000:0.0:1746143777.744752:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.744862:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622506880 00000100:00100000:2.0:1746143777.744871:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622506880 00002000:00100000:2.0:1746143777.745056:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2363392->3043327) req@ffff880091bca300 x1830963622506880/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.745070:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bca300 with x1830963622506880 ext(2363392->3043327) 00010000:00010000:2.0:1746143777.745080:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 26 pid: 9839 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746143777.745102:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 26 pid: 9839 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746143777.745108:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bca300 00000100:00100000:3.0:1746143777.746265:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1424 00000100:00100000:3.0:1746143777.746278:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622506880:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143777.756801:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622506880:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10514us (12043us total) trans 17179872978 rc 0/0 00000100:00100000:3.0:1746143777.756817:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1424 00002000:00100000:3.0:1746143777.756829:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (2363392->3043327) req@ffff880091bca300 x1830963622506880/t17179872978(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/448 e 0 to 0 dl 1746143788 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.756839:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bca300 with x1830963622506880 ext(2363392->3043327) 00010000:00010000:3.0:1746143777.756849:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 28 pid: 9839 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.756868:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 28 pid: 9839 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143777.756876:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bca300 00000100:00100000:0.0:1746143777.761386:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.761654:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622507008 00000100:00100000:3.0:1746143777.761664:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622507008 00010000:00010000:3.0:1746143777.761706:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 28 pid: 9839 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143777.761739:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5536 00000100:00100000:3.0:1746143777.761748:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622507008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.761763:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143777.761785:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143777 -> 1746143778 00002000:00010000:3.0:1746143777.761788:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143777 -> 1746143778 00010000:00010000:3.0:1746143777.761793:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 28 pid: 9839 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.761804:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 28 pid: 9839 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.761828:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c800/0x87925e4cb73a8edd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2363392->3043327) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae2c expref: 28 pid: 9839 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143777.762718:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.762722:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.762730:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.762738:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.762955:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.762968:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626735616:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143777.763252:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.765371:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626735616:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143777.765391:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.765428:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622507008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3681us (4053us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.765438:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5536 00000100:00100000:0.0:1746143777.770170:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.770224:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.770312:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622507392 00000100:00100000:2.0:1746143777.770322:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622507392 00002000:00100000:2.0:1746143777.770368:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bcb480 x1830963622507392/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.770378:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcb480 with x1830963622507392 ext(2097152->4194303) 00002000:00010000:2.0:1746143777.770384:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bcb480 00000100:00100000:2.0:1746143777.770402:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622507520 00000100:00100000:2.0:1746143777.770404:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622507520 00002000:00100000:2.0:1746143777.770416:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880091bc8a80 x1830963622507520/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.770423:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc8a80 with x1830963622507520 ext(3145728->4194303) 00002000:00010000:2.0:1746143777.770426:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc8a80 00000100:00100000:2.0:1746143777.770451:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3387 00000100:00100000:2.0:1746143777.770458:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622507392:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143777.771796:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3388 00000100:00100000:3.0:1746143777.771806:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622507520:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143777.785299:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622507520:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13483us (15062us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143777.785314:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3388 00002000:00100000:3.0:1746143777.785327:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880091bc8a80 x1830963622507520/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143777.785338:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc8a80 with x1830963622507520 ext(3145728->4194303) 00002000:00010000:3.0:1746143777.785345:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc8a80 00000100:00100000:2.0:1746143777.791958:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622507392:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21488us (21787us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143777.791971:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3387 00002000:00100000:2.0:1746143777.791984:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bcb480 x1830963622507392/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.791999:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcb480 with x1830963622507392 ext(2097152->4194303) 00002000:00010000:2.0:1746143777.792005:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bcb480 00000100:00100000:0.0:1746143777.799310:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.800154:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622507776 00000100:00100000:3.0:1746143777.800166:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622507776 00000100:00100000:3.0:1746143777.800279:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12856 00000100:00100000:3.0:1746143777.800289:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+281:32145:x1830963622507776:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143777.800316:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.800337:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae64 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.800419:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.800432:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.800444:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.800458:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.800463:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.800468:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.800571:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.800584:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.800590:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143777.800598:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143777.802539:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802550:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802556:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802563:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802572:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d7c200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.802576:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802582:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802596:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143777.802599:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.802602:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802607:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802643:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802649:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802654:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802658:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d7d000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.802660:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802664:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802671:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093ba5500) 00010000:00010000:3.0:1746143777.802674:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.802676:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802680:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.802731:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae64 expref: 284 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.802743:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae64 expref: 283 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.802750:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.802752:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143777.802754:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7c600, rc 0) 00000100:00100000:3.0:1746143777.803747:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+283:32145:x1830963622507776:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3456us (4444us total) trans 8589943610 rc 0/0 00000100:00100000:3.0:1746143777.803756:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12856 00000100:00100000:0.0:1746143777.810391:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.810493:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622508032 00000100:00100000:2.0:1746143777.810504:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622508032 00002000:00100000:2.0:1746143777.810555:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880091bcaa00 x1830963622508032/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.810565:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcaa00 with x1830963622508032 ext(4194304->4968447) 00002000:00010000:2.0:1746143777.810570:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bcaa00 00000100:00100000:2.0:1746143777.810603:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3389 00000100:00100000:2.0:1746143777.810612:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622508032:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143777.823158:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622508032:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12535us (12766us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143777.823171:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3389 00002000:00100000:2.0:1746143777.823185:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880091bcaa00 x1830963622508032/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143777.823195:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcaa00 with x1830963622508032 ext(4194304->4968447) 00002000:00010000:2.0:1746143777.823202:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bcaa00 00010000:00010000:2.0:1746143777.827085:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143777.837388:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.837388:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.837471:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622508288 00000100:00100000:2.0:1746143777.837482:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622508288 00000100:00100000:2.0:1746143777.837538:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4708 00000100:00100000:2.0:1746143777.837546:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32135:x1830963622508288:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143777.837780:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32135:x1830963622508288:12345-192.168.202.3@tcp:35:cat.0 Request processed in 233us (400us total) trans 8589943611 rc 0/0 00000100:00100000:2.0:1746143777.837788:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4708 00000100:00100000:3.0:1746143777.837894:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622508544 00000100:00100000:3.0:1746143777.837898:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622508544 00000100:00100000:3.0:1746143777.837956:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12857 00000100:00100000:3.0:1746143777.837961:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32148:x1830963622508544:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143777.837971:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.837992:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae6b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.838049:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838062:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838073:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838085:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838090:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838094:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838170:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838178:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838183:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143777.838191:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:3.0:1746143777.838224:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838230:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838234:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838239:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838244:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d7d000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.838247:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838253:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838262:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143777.838265:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.838268:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838273:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d000/0x87925e4cb73a8f3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838302:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838307:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838311:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838314:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d7c200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143777.838316:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838320:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838326:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800933da300) 00010000:00010000:3.0:1746143777.838328:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143777.838330:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838334:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c200/0x87925e4cb73a8f46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.838362:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae6b expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.838372:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae6b expref: 32 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.838377:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143777.838379:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143777.838381:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504600, rc 0) 00000100:00100000:3.0:1746143777.838418:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:32148:x1830963622508544:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 456us (1039us total) trans 8589943612 rc 0/0 00000100:00100000:3.0:1746143777.838424:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12857 00000100:00100000:0.0:1746143777.963367:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.963469:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622508672 00000100:00100000:3.0:1746143777.963480:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622508672 00000100:00100000:3.0:1746143777.963525:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11743 00000100:00100000:3.0:1746143777.963534:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32148:x1830963622508672:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143777.963554:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.963576:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae72 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.963605:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 22 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.963613:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.963619:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.963620:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.963623:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.963654:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.963665:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 11 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143777.963678:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626735744:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.963793:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 22 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.963801:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 22 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143777.963809:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626735872:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.963827:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143777.969437:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626735744:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143777.969450:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626735872:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143777.969487:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143777.969505:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7d800, rc 0) 00000100:00100000:3.0:1746143777.969555:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32148:x1830963622508672:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6022us (6198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.969564:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11743 00000100:00100000:0.0:1746143777.970442:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.970849:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622508800 00000100:00100000:3.0:1746143777.970966:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622508800 00010000:00010000:3.0:1746143777.970996:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 23 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143777.971023:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5537 00000100:00100000:3.0:1746143777.971031:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622508800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.971045:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.971063:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 23 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143777.971073:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 23 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143777.971096:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73a8ef9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae48 expref: 23 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143777.971704:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.971807:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622509056 00000100:00100000:2.0:1746143777.971812:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622509056 00000100:00100000:2.0:1746143777.971845:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12858 00000100:00100000:2.0:1746143777.971852:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+283:32153:x1830963622509056:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.971874:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.971891:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a8f62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae79 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.972020:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143777.972033:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143777.972042:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143777.972076:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143777.972114:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622508800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1083us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143777.972120:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5537 00000100:00100000:1.0:1746143777.973950:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000004:00200000:2.0:1746143777.974000:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143777.974119:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a8f62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae79 expref: 286 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.974138:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae79 expref: 285 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.974145:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143777.974148:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143777.974151:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a45c00, rc 0) 00000100:00100000:2.0:1746143777.974185:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+285:32153:x1830963622509056:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2333us (2484us total) trans 8589943613 rc 0/0 00000100:00100000:2.0:1746143777.974193:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12858 00000100:00100000:1.0:1746143777.975046:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143777.975069:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622509440 00000100:00100000:3.0:1746143777.975114:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622509184 00000100:00100000:3.0:1746143777.975126:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622509184 00010000:00010000:3.0:1746143777.975165:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 11 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143777.975199:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5538 00000100:00100000:3.0:1746143777.975206:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622509184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143777.975218:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143777.975235:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 11 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143777.975250:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 11 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143777.975264:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622509440 00010000:00010000:3.0:1746143777.975270:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73a8f07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae56 expref: 11 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143777.975283:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.975284:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143777.975289:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143777.975293:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12859 00010000:00010000:3.0:1746143777.975296:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143777.975299:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:32156:x1830963622509440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143777.975318:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.975323:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.975331:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a8f77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae80 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.975333:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626736000:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143777.975408:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143777.975421:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143777.975430:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143777.975435:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe3c0 going to sleep for 11 seconds 00000004:00200000:1.0:1746143777.975438:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143777.975491:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73a8f77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae80 expref: 35 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.975508:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae80 expref: 34 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.975514:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143777.975516:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143777.975519:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75800, rc 0) 00000100:00100000:1.0:1746143777.975542:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:32156:x1830963622509440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 243us (499us total) trans 8589943614 rc 0/0 00000100:00100000:1.0:1746143777.975547:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12859 00000100:00100000:0.0:1746143777.976712:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.976756:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143777.976947:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622509568 00000100:00100000:3.0:1746143777.976953:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622509568 00000100:00100000:3.0:1746143777.976987:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622509696 00000100:00100000:3.0:1746143777.976989:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622509696 00000100:00100000:3.0:1746143777.977010:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11744 00000100:00100000:3.0:1746143777.977015:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622509568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143777.977027:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143777.977038:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73a8f8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae87 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143777.977070:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626736128:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143777.977121:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143777.977334:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11745 00000100:00100000:2.0:1746143777.977342:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963622509696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143777.977349:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143777.977357:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73a8f93 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae8e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143777.977368:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.977370:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143777.977375:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73a8f93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae8e expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.977385:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73a8f93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae8e expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143777.977392:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7cc00, rc 0) 00000100:00100000:2.0:1746143777.977425:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622509696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 84us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.977430:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11745 00000100:00100000:0.0:1746143777.977603:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.977625:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622509952 00000100:00100000:0.0:1746143777.977628:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622509952 00002000:00100000:0.0:1746143777.977648:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3043328->3047423) req@ffff880093414e00 x1830963622509952/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143777.977656:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414e00 with x1830963622509952 ext(3043328->3047423) 00002000:00010000:0.0:1746143777.977659:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093414e00 00000100:00100000:0.0:1746143777.977670:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3390 00000100:00100000:0.0:1746143777.977674:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622509952:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143777.977751:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622509952:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 76us (147us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143777.977756:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3390 00002000:00100000:0.0:1746143777.977760:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3043328->3047423) req@ffff880093414e00 x1830963622509952/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:173/0 lens 488/4536 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143777.977771:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414e00 with x1830963622509952 ext(3043328->3047423) 00002000:00010000:0.0:1746143777.977773:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093414e00 00000100:00100000:2.0:1746143777.977970:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626736000:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143777.977982:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.978000:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622509184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2795us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.978006:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5538 00000100:00100000:0.0:1746143777.981759:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:3.0:1746143777.982166:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143777 -> 1746143778 00000100:00100000:1.0:1746143777.982231:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622510080 00000100:00100000:1.0:1746143777.982239:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622510080 00000100:00100000:3.0:1746143777.983073:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626736128:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143777.983110:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73a8f8c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae87 expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.983126:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73a8f8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae87 expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143777.983139:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ca00, rc 0) 00000100:00100000:3.0:1746143777.983292:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622509568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6274us (6579us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143777.983303:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11744 00000100:00100000:1.0:1746143777.983361:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11746 00000100:00100000:1.0:1746143777.983372:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32148:x1830963622510080:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143777.983388:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143777.983404:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae95 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.983431:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.983439:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73a8f93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae8e expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.983445:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.983446:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143777.983449:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->2813951] (req 2097152->2813951) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.983478:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73a8f93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae8e expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143777.983489:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73a8f93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae8e expref: 27 pid: 9586 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143777.983500:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626736256:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143777.983735:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143777.983743:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 11 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143777.983751:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626736384:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143777.983777:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143777.986304:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626736256:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143777.992183:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143777.992534:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622510208 00000100:00100000:2.0:1746143777.992545:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622510208 00010000:00010000:2.0:1746143777.992586:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73a8f93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae8e expref: 28 pid: 9586 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143777.992617:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5539 00000100:00100000:2.0:1746143777.992626:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622510208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143777.992641:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143777.992663:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73a8f93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae8e expref: 28 pid: 9586 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143777.992675:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73a8f93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae8e expref: 28 pid: 9586 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143777.992699:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73a8f93 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae8e expref: 28 pid: 9586 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143777.992730:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143777.992787:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963622510208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 162us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143777.992793:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5539 00000100:00100000:3.0:1746143777.993938:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143777.994038:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622510464 00000100:00100000:0.0:1746143777.994044:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622510464 00002000:00100000:0.0:1746143777.994081:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012b7ab480 x1830963622510464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/0 e 0 to 0 dl 1746143788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143777.994090:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ab480 with x1830963622510464 ext(0->1048575) 00002000:00010000:0.0:1746143777.994095:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7ab480 00000100:00100000:0.0:1746143777.994122:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3391 00000100:00100000:0.0:1746143777.994128:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622510464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143778.007282:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.007326:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.007355:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622510976 00000100:00100000:0.0:1746143778.007364:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622510976 00000100:00100000:0.0:1746143778.007424:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11747 00000100:00100000:0.0:1746143778.007433:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:32145:x1830963622510976:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143778.007454:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143778.007475:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ae9c expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.007634:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.007648:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143778.007650:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143778.007654:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3837952->4194303] (req 3837952->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.007686:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.007697:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 9 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143778.007709:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626736512:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.007792:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143778.008139:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622510848 00000100:00100000:2.0:1746143778.008144:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622510848 00010000:00010000:2.0:1746143778.008169:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.008191:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5540 00000100:00100000:2.0:1746143778.008197:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622510848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.008209:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.008229:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.008239:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.008258:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.008259:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.008265:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.008272:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.008294:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.008303:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626736640:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143778.008344:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00010000:00010000:1.0:1746143778.008473:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e505c00/0x87925e4cb73a8f0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae5d expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.008492:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626736384:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143778.008515:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.008524:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74200, rc 0) 00000100:00100000:1.0:1746143778.008564:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32148:x1830963622510080:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 25194us (26817us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.008571:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11746 00000100:00100000:3.0:1746143778.010683:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.010718:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.010733:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.010746:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.010772:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.010793:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622510720 00000100:00100000:3.0:1746143778.010799:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622510720 00002000:00100000:3.0:1746143778.010843:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012b7a9500 x1830963622510720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 504/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.010859:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9500 with x1830963622510720 ext(2097152->4194303) 00010000:00010000:3.0:1746143778.010867:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 10 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.010880:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 10 pid: 9839 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.010887:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7a9500 00000100:00100000:3.0:1746143778.010903:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622511232 00000100:00100000:3.0:1746143778.010905:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622511232 00002000:00100000:3.0:1746143778.010946:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095c3b480 x1830963622511232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.010953:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b480 with x1830963622511232 ext(1048576->2097151) 00002000:00010000:3.0:1746143778.010956:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3b480 00000100:00100000:3.0:1746143778.010965:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622511488 00000100:00100000:3.0:1746143778.010967:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622511488 00002000:00100000:3.0:1746143778.010974:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095c39880 x1830963622511488/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.010980:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39880 with x1830963622511488 ext(1048576->2097151) 00002000:00010000:3.0:1746143778.010983:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c39880 00000100:00100000:3.0:1746143778.010990:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622511744 00000100:00100000:3.0:1746143778.010991:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622511744 00002000:00100000:3.0:1746143778.010999:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092b4aa00 x1830963622511744/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.011004:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4aa00 with x1830963622511744 ext(1048576->2097151) 00002000:00010000:3.0:1746143778.011007:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b4aa00 00000100:00100000:3.0:1746143778.011013:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622511872 00000100:00100000:3.0:1746143778.011015:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622511872 00002000:00100000:3.0:1746143778.011023:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3043328->3145727) req@ffff8800939a4000 x1830963622511872/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.011028:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a4000 with x1830963622511872 ext(3043328->3145727) 00010000:00010000:3.0:1746143778.011032:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 11 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.011039:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 11 pid: 9839 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.011043:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800939a4000 00000100:00100000:3.0:1746143778.011052:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1425 00000100:00100000:3.0:1746143778.011057:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622510720:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143778.012113:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1426 00000100:00100000:2.0:1746143778.012125:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622511872:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143778.012348:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626736640:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143778.012367:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.012388:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622510848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4191us (5118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.012400:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5540 00000100:00100000:1.0:1746143778.012587:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3392 00000100:00100000:1.0:1746143778.012595:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622511232:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143778.013295:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3393 00000100:00100000:1.0:1746143778.013301:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622511488:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143778.014572:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3394 00000100:00100000:0.0:1746143778.014584:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622511744:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143778.017984:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626736512:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143778.018020:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3837952->4194303] (req 3837952->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 27 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.018040:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55be00, rc 0) 00000100:00100000:0.0:1746143778.018070:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:32145:x1830963622510976:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10638us (10742us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.018079:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11747 00000100:00100000:0.0:1746143778.018182:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622510464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 24054us (24272us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143778.018191:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3391 00002000:00100000:0.0:1746143778.018200:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012b7ab480 x1830963622510464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:173/0 lens 488/440 e 0 to 0 dl 1746143788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143778.018208:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ab480 with x1830963622510464 ext(0->1048575) 00002000:00010000:0.0:1746143778.018214:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7ab480 00000100:00100000:1.0:1746143778.020792:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622511872:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8660us (10008us total) trans 21474840300 rc 0/0 00000100:00100000:1.0:1746143778.020805:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1426 00002000:00100000:1.0:1746143778.020817:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3043328->3145727) req@ffff8800939a4000 x1830963622511872/t21474840300(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/448 e 0 to 0 dl 1746143789 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.020827:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a4000 with x1830963622511872 ext(3043328->3145727) 00010000:00010000:1.0:1746143778.020838:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 14 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143778.020853:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 14 pid: 9839 timeout: 937 lvb_type: 0 00002000:00010000:1.0:1746143778.020859:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800939a4000 00000100:00100000:0.0:1746143778.028282:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.028445:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622512128 00000100:00100000:1.0:1746143778.028456:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622512128 00002000:00100000:1.0:1746143778.028506:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2809856->2813951) req@ffff88012e35ad80 x1830963622512128/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.028516:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35ad80 with x1830963622512128 ext(2809856->2813951) 00002000:00010000:1.0:1746143778.028522:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35ad80 00000100:00100000:1.0:1746143778.028545:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3395 00000100:00100000:1.0:1746143778.028659:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622512128:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143778.028805:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622512128:12345-192.168.202.3@tcp:3:cat.0 Request processed in 252us (536us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143778.028811:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3395 00002000:00100000:1.0:1746143778.028817:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2809856->2813951) req@ffff88012e35ad80 x1830963622512128/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/4536 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.028823:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35ad80 with x1830963622512128 ext(2809856->2813951) 00002000:00010000:1.0:1746143778.028826:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35ad80 00000100:00100000:0.0:1746143778.043529:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622511744:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 28937us (32769us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143778.043543:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3394 00002000:00100000:0.0:1746143778.043556:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092b4aa00 x1830963622511744/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143778.043565:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4aa00 with x1830963622511744 ext(1048576->2097151) 00002000:00010000:0.0:1746143778.043571:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b4aa00 00000100:00100000:1.0:1746143778.043798:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622511232:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 31201us (33076us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143778.043805:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3392 00002000:00100000:1.0:1746143778.043812:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095c3b480 x1830963622511232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.043819:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b480 with x1830963622511232 ext(1048576->2097151) 00002000:00010000:1.0:1746143778.043822:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3b480 00000100:00100000:1.0:1746143778.043882:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622511488:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 30581us (33147us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143778.043888:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3393 00002000:00100000:1.0:1746143778.043893:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095c39880 x1830963622511488/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.043899:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39880 with x1830963622511488 ext(1048576->2097151) 00002000:00010000:1.0:1746143778.043902:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c39880 00000100:00100000:3.0:1746143778.056475:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622510720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 45403us (45787us total) trans 0 rc 1994752/1994752 00000100:00100000:3.0:1746143778.056489:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1425 00002000:00100000:3.0:1746143778.056502:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012b7a9500 x1830963622510720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 504/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:H/200/0 rc 1994752/1994752 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.056512:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9500 with x1830963622510720 ext(2097152->4194303) 00010000:00010000:3.0:1746143778.056524:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.056540:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.056547:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7a9500 00000100:00100000:0.0:1746143778.062569:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.062613:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.062703:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.062964:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622512384 00000100:00100000:2.0:1746143778.062977:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622512384 00000100:00100000:2.0:1746143778.063026:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4709 00000100:00100000:2.0:1746143778.063034:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:32148:x1830963622512384:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143778.063215:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622512512 00000100:00100000:1.0:1746143778.063219:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622512512 00000100:00100000:1.0:1746143778.064766:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11748 00000100:00100000:1.0:1746143778.064778:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622512512:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143778.064792:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.064815:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73a8fa8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aea3 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143778.064867:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626736768:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143778.065041:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622512640 00000100:00100000:0.0:1746143778.065046:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622512640 00000100:00100000:0.0:1746143778.065074:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11749 00000100:00100000:0.0:1746143778.065078:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622512640:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143778.065086:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143778.065095:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55ba00/0x87925e4cb73a8faf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aeaa expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.065117:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093910700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626736896:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143778.065186:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:32148:x1830963622512384:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 2152us (2628us total) trans 8589943615 rc 0/0 00000100:00100000:2.0:1746143778.065194:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4709 00000100:00100000:1.0:1746143778.066056:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.066155:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.067253:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.067642:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622512896 00000100:00100000:3.0:1746143778.067653:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622512896 00002000:00100000:3.0:1746143778.067695:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880093910a80 x1830963622512896/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.067703:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093910a80 with x1830963622512896 ext(4194304->4968447) 00010000:00010000:3.0:1746143778.067712:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.067724:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.067731:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093910a80 00000100:00100000:3.0:1746143778.067758:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1427 00000100:00100000:3.0:1746143778.067765:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622512896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143778.069103:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093910700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626736896:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143778.069136:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55ba00/0x87925e4cb73a8faf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeaa expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.069149:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55ba00/0x87925e4cb73a8faf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeaa expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.069164:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55ba00, rc 0) 00000100:00100000:0.0:1746143778.069197:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622512640:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4117us (6493us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143778.069205:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11749 00000100:00100000:1.0:1746143778.069323:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626736768:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143778.069342:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73a8fa8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aea3 expref: 24 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.069357:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73a8fa8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aea3 expref: 24 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.069368:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74e00, rc 0) 00000100:00100000:1.0:1746143778.069390:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622512512:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4615us (6775us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143778.069395:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11748 00000100:00100000:3.0:1746143778.074734:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622512896:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6956us (7473us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143778.074747:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1427 00002000:00100000:3.0:1746143778.074759:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880093910a80 x1830963622512896/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:H/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.074770:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093910a80 with x1830963622512896 ext(4194304->4968447) 00010000:00010000:3.0:1746143778.074780:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.074799:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.074805:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093910a80 00000100:00100000:0.0:1746143778.080818:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.081440:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.082045:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622513152 00000100:00100000:3.0:1746143778.082056:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622513152 00002000:00100000:3.0:1746143778.082105:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2813952->3145727) req@ffff880093910700 x1830963622513152/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.082116:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093910700 with x1830963622513152 ext(2813952->3145727) 00002000:00010000:3.0:1746143778.082121:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093910700 00000100:00100000:3.0:1746143778.082388:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3396 00000100:00100000:3.0:1746143778.082397:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622513152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143778.083645:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622513280 00000100:00100000:1.0:1746143778.083653:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622513280 00000100:00100000:1.0:1746143778.083692:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11750 00000100:00100000:1.0:1746143778.083697:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:32153:x1830963622513280:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143778.083709:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.083726:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aeb1 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.083751:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143778.083754:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143778.083758:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.083769:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.083778:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75000, rc 0) 00000100:00100000:1.0:1746143778.085248:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:32153:x1830963622513280:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1544us (3802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.085260:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11750 00000100:00100000:1.0:1746143778.085827:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.087125:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622513408 00000100:00100000:3.0:1746143778.087136:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622513408 00010000:00010000:3.0:1746143778.087173:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.087199:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5541 00000100:00100000:3.0:1746143778.087211:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622513408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.087227:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.087247:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.087259:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.087282:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a8f5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae72 expref: 12 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.087313:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.087315:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.087322:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.087331:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.087342:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.087344:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.087347:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.087353:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.087386:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.087399:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626737024:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143778.087480:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.087492:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626737152:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143778.087510:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.093066:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.093129:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626737024:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143778.093179:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622513664 00000100:00100000:1.0:1746143778.093186:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622513664 00002000:00100000:1.0:1746143778.093228:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880093911180 x1830963622513664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143778.093234:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622513152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10838us (12428us total) trans 0 rc 331776/331776 00002000:00100000:1.0:1746143778.093237:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093911180 with x1830963622513664 ext(2097152->3145727) 00002000:00010000:1.0:1746143778.093242:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093911180 00000100:00100000:3.0:1746143778.093244:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3396 00002000:00100000:3.0:1746143778.093251:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2813952->3145727) req@ffff880093910700 x1830963622513152/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 331776/331776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.093258:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093910700 with x1830963622513152 ext(2813952->3145727) 00002000:00010000:3.0:1746143778.093261:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093910700 00000100:00100000:1.0:1746143778.093264:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3397 00000100:00100000:1.0:1746143778.093271:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622513664:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143778.094937:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.095135:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622513920 00000100:00100000:2.0:1746143778.095142:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622513920 00002000:00100000:2.0:1746143778.095175:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3837952->3842047) req@ffff880093911500 x1830963622513920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.095184:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093911500 with x1830963622513920 ext(3837952->3842047) 00002000:00010000:2.0:1746143778.095189:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093911500 00000100:00100000:2.0:1746143778.095206:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3398 00000100:00100000:2.0:1746143778.095213:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622513920:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143778.095375:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622513920:12345-192.168.202.3@tcp:3:cat.0 Request processed in 162us (467us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143778.095382:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3398 00002000:00100000:2.0:1746143778.095386:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3837952->3842047) req@ffff880093911500 x1830963622513920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/4536 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.095393:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093911500 with x1830963622513920 ext(3837952->3842047) 00002000:00010000:2.0:1746143778.095395:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093911500 00000100:00100000:3.0:1746143778.096554:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626737152:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143778.096579:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.096604:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622513408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9399us (10780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.096612:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5541 00000100:00100000:0.0:1746143778.101334:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.101440:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622514048 00000100:00100000:1.0:1746143778.102013:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622514048 00000100:00100000:1.0:1746143778.102065:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11751 00000100:00100000:1.0:1746143778.102073:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32156:x1830963622514048:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143778.102093:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.102111:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aeb8 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.102141:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.102148:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143778.102150:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143778.102153:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.102189:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.102201:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 25 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.102213:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626737280:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.102307:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143778.103179:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622513664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9906us (10122us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143778.103189:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3397 00002000:00100000:1.0:1746143778.103197:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880093911180 x1830963622513664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.103206:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093911180 with x1830963622513664 ext(2097152->3145727) 00002000:00010000:1.0:1746143778.103210:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093911180 00000100:00100000:0.0:1746143778.110027:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.110299:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622514176 00000100:00100000:2.0:1746143778.110310:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622514176 00000100:00100000:2.0:1746143778.111472:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11752 00000100:00100000:2.0:1746143778.111486:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:32145:x1830963622514176:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143778.111697:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.111718:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aebf expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.111753:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 9 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.111761:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143778.111763:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143778.111766:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->3829759] (req 3145728->3829759) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.111799:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 9 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.111809:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 9 pid: 12327 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.111822:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626737408:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143778.113373:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.114519:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.114581:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.114665:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626737280:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143778.114695:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.114714:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75200, rc 0) 00000100:00100000:1.0:1746143778.114758:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32156:x1830963622514048:12345-192.168.202.3@tcp:101:cat.0 Request processed in 12685us (13436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.114766:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11751 00000100:00100000:1.0:1746143778.114794:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622514432 00000100:00100000:1.0:1746143778.114800:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622514432 00000100:00100000:1.0:1746143778.114828:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11753 00000100:00100000:1.0:1746143778.114835:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:32153:x1830963622514432:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143778.114850:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.114865:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aec6 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.114886:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143778.114888:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143778.114891:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.114898:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.114905:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:1.0:1746143778.114952:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:32153:x1830963622514432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 117us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.114957:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11753 00000100:00100000:2.0:1746143778.115059:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622514304 00000100:00100000:2.0:1746143778.115062:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622514304 00002000:00100000:2.0:1746143778.115092:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (3837952->4194303) req@ffff880093911f80 x1830963622514304/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.115107:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093911f80 with x1830963622514304 ext(3837952->4194303) 00010000:00010000:2.0:1746143778.115112:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 24 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.115122:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 24 pid: 1945 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746143778.115128:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093911f80 00000100:00100000:2.0:1746143778.115139:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1428 00000100:00100000:2.0:1746143778.115142:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622514304:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143778.119860:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626737408:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.119884:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143778.119895:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->3829759] (req 3145728->3829759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 29 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.120216:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551e00, rc 0) 00000100:00100000:2.0:1746143778.120301:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:32145:x1830963622514176:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8819us (10283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.120309:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11752 00000100:00100000:2.0:1746143778.120406:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622514560 00000100:00100000:2.0:1746143778.120412:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622514560 00002000:00100000:2.0:1746143778.120445:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2813951) req@ffff880093912680 x1830963622514560/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.120454:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093912680 with x1830963622514560 ext(2097152->2813951) 00010000:00010000:2.0:1746143778.120461:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 10 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.120473:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 10 pid: 12327 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746143778.120479:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093912680 00000100:00100000:2.0:1746143778.120500:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1429 00000100:00100000:2.0:1746143778.120507:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622514560:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143778.124425:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622514304:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9268us (9899us total) trans 21474840301 rc 0/0 00000100:00100000:3.0:1746143778.124439:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1428 00002000:00100000:3.0:1746143778.124453:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (3837952->4194303) req@ffff880093911f80 x1830963622514304/t21474840301(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/448 e 0 to 0 dl 1746143789 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.124462:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093911f80 with x1830963622514304 ext(3837952->4194303) 00010000:00010000:3.0:1746143778.124473:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 26 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.124487:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 26 pid: 1945 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.124494:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093911f80 00000100:00100000:0.0:1746143778.126670:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.126732:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622514688 00000100:00100000:3.0:1746143778.126742:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622514688 00010000:00010000:3.0:1746143778.126780:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 26 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.126830:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5542 00000100:00100000:3.0:1746143778.126839:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622514688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.126855:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.126873:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 26 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.126884:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 26 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.126909:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a8fa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3837952->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae9c expref: 26 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.126972:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.126974:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.126981:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.126993:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.127027:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.127040:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626737536:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143778.127130:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.127381:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622514560:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6874us (7496us total) trans 17179872979 rc 0/0 00000100:00100000:3.0:1746143778.127390:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1429 00002000:00100000:3.0:1746143778.127400:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2813951) req@ffff880093912680 x1830963622514560/t17179872979(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/448 e 0 to 0 dl 1746143789 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.127408:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093912680 with x1830963622514560 ext(2097152->2813951) 00010000:00010000:3.0:1746143778.127416:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 12 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.127426:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 12 pid: 12327 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.127431:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093912680 00000100:00100000:3.0:1746143778.130494:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626737536:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143778.130519:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.130582:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963622514688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3742us (3924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.130594:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5542 00000100:00100000:2.0:1746143778.131013:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.131267:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622514816 00000100:00100000:3.0:1746143778.131274:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622514816 00010000:00010000:3.0:1746143778.131304:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 12 pid: 12327 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.131456:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5543 00000100:00100000:0.0:1746143778.132025:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.132124:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622514816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.132137:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.132159:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 12 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.132171:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 12 pid: 12327 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.132192:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622515072 00010000:00010000:3.0:1746143778.132194:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74200/0x87925e4cb73a8f9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae95 expref: 12 pid: 12327 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.132196:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622515072 00010000:00010000:3.0:1746143778.132210:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.132212:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.132219:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.132227:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143778.132227:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880093912d80 x1830963622515072/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.132235:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093912d80 with x1830963622515072 ext(3145728->4194303) 00010000:00010000:3.0:1746143778.132236:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.132237:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.132240:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 28 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143778.132240:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093912d80 00010000:00010000:3.0:1746143778.132247:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 28 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.132264:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3399 00000100:00100000:2.0:1746143778.132269:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622515072:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143778.132276:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 28 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.132288:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626737664:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143778.132358:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.132365:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626737792:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143778.132380:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.141085:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626737664:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143778.141100:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626737792:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143778.141130:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.141192:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622514816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9071us (10179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.141204:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5543 00000100:00100000:0.0:1746143778.145792:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.145833:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.145900:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622515328 00000100:00100000:3.0:1746143778.145951:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622515328 00002000:00100000:3.0:1746143778.146002:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880093913100 x1830963622515328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.146017:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093913100 with x1830963622515328 ext(2097152->3145727) 00002000:00010000:3.0:1746143778.146022:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093913100 00000100:00100000:3.0:1746143778.146105:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622515584 00000100:00100000:3.0:1746143778.146108:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622515584 00002000:00100000:3.0:1746143778.146121:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3825664->3829759) req@ffff880093913480 x1830963622515584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.146127:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093913480 with x1830963622515584 ext(3825664->3829759) 00002000:00010000:3.0:1746143778.146130:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093913480 00000100:00100000:3.0:1746143778.146160:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3400 00000100:00100000:3.0:1746143778.146168:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622515328:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143778.146305:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622515072:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14034us (14279us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143778.146311:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3399 00002000:00100000:2.0:1746143778.146316:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880093912d80 x1830963622515072/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.146322:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093912d80 with x1830963622515072 ext(3145728->4194303) 00002000:00010000:2.0:1746143778.146325:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093912d80 00000100:00100000:2.0:1746143778.146341:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3401 00000100:00100000:2.0:1746143778.146348:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622515584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143778.146401:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622515584:12345-192.168.202.3@tcp:3:cat.0 Request processed in 54us (566us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143778.146405:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3401 00002000:00100000:2.0:1746143778.146409:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3825664->3829759) req@ffff880093913480 x1830963622515584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/4536 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.146414:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093913480 with x1830963622515584 ext(3825664->3829759) 00002000:00010000:2.0:1746143778.146416:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093913480 00000100:00100000:0.0:1746143778.155064:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.155422:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622515840 00000100:00100000:2.0:1746143778.155433:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622515840 00000100:00100000:2.0:1746143778.156092:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4710 00000100:00100000:2.0:1746143778.156102:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+285:32145:x1830963622515840:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143778.156348:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+286:32145:x1830963622515840:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 247us (1446us total) trans 8589943616 rc 0/0 00000100:00100000:2.0:1746143778.156355:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4710 00000100:00100000:2.0:1746143778.156829:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.156847:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622515968 00000100:00100000:0.0:1746143778.156852:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622515968 00000100:00100000:0.0:1746143778.156886:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11754 00000100:00100000:0.0:1746143778.156892:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32156:x1830963622515968:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143778.156904:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143778.156949:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aecd expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.156976:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 30 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.156985:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143778.156986:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143778.156989:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.157030:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 30 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.157041:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 30 pid: 12327 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143778.157053:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093913b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626737920:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.157124:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.157293:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622515328:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11125us (11513us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143778.157302:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3400 00002000:00100000:3.0:1746143778.157312:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880093913100 x1830963622515328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.157320:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093913100 with x1830963622515328 ext(2097152->3145727) 00002000:00010000:3.0:1746143778.157324:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093913100 00000100:00100000:2.0:1746143778.163559:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093913b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626737920:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143778.163594:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.163615:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d600, rc 0) 00000100:00100000:2.0:1746143778.163707:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32156:x1830963622515968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6811us (6875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.163717:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11754 00000100:00100000:0.0:1746143778.175020:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.175078:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.175207:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622516096 00000100:00100000:3.0:1746143778.175219:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622516096 00002000:00100000:3.0:1746143778.175277:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3829759) req@ffff880093913b80 x1830963622516096/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.175288:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093913b80 with x1830963622516096 ext(3145728->3829759) 00010000:00010000:3.0:1746143778.175299:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 29 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.175315:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 29 pid: 12327 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.175321:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093913b80 00000100:00100000:3.0:1746143778.175344:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1430 00000100:00100000:3.0:1746143778.175352:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622516096:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143778.175573:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622516224 00000100:00100000:2.0:1746143778.175577:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622516224 00000100:00100000:2.0:1746143778.175603:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11755 00000100:00100000:2.0:1746143778.175608:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+25:32153:x1830963622516224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143778.175618:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.175634:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73a8fd9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aed4 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.175654:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.175656:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.175663:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73a8fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aed4 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.175678:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73a8fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aed4 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.175687:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3be00, rc 0) 00000100:00100000:2.0:1746143778.175714:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:32153:x1830963622516224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 106us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.175720:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11755 00000100:00100000:3.0:1746143778.186324:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622516096:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10959us (11300us total) trans 17179872980 rc 0/0 00000100:00100000:3.0:1746143778.186338:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1430 00002000:00100000:3.0:1746143778.186352:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3829759) req@ffff880093913b80 x1830963622516096/t17179872980(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/448 e 0 to 0 dl 1746143789 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.186362:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093913b80 with x1830963622516096 ext(3145728->3829759) 00010000:00010000:3.0:1746143778.186374:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 31 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.186390:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 31 pid: 12327 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.186397:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093913b80 00000100:00100000:0.0:1746143778.186874:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.187734:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622516480 00000100:00100000:3.0:1746143778.187745:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622516480 00002000:00100000:3.0:1746143778.187786:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880093726300 x1830963622516480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.187793:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093726300 with x1830963622516480 ext(3145728->4194303) 00002000:00010000:3.0:1746143778.187798:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093726300 00000100:00100000:3.0:1746143778.187818:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3402 00000100:00100000:3.0:1746143778.187825:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622516480:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143778.196051:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.196139:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622516608 00000100:00100000:3.0:1746143778.196148:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622516608 00010000:00010000:3.0:1746143778.196188:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 31 pid: 12327 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.196226:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5544 00000100:00100000:3.0:1746143778.196233:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622516608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.196248:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.196268:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 31 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.196279:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 31 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.196300:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73a8fc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aebf expref: 31 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.196319:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.196321:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.196328:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.196335:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.196372:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.196385:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626738048:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143778.196823:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143778.199978:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622516480:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12139us (13091us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143778.199992:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3402 00002000:00100000:2.0:1746143778.200006:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880093726300 x1830963622516480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.200017:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093726300 with x1830963622516480 ext(3145728->4194303) 00002000:00010000:2.0:1746143778.200023:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093726300 00000100:00100000:3.0:1746143778.201532:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626738048:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143778.201556:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.201604:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963622516608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5367us (5561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.201613:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5544 00000100:00100000:0.0:1746143778.207815:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.208448:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622516864 00000100:00100000:2.0:1746143778.208459:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622516864 00002000:00100000:2.0:1746143778.208513:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880092b63b80 x1830963622516864/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.208523:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b63b80 with x1830963622516864 ext(3145728->4194303) 00002000:00010000:2.0:1746143778.208530:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b63b80 00000100:00100000:2.0:1746143778.208555:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3403 00000100:00100000:2.0:1746143778.208563:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622516864:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143778.221132:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.223075:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622516992 00000100:00100000:3.0:1746143778.223088:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622516992 00000100:00100000:3.0:1746143778.223155:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11756 00000100:00100000:3.0:1746143778.223164:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:32153:x1830963622516992:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.223185:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.223204:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a8fe0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aedb expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.223231:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.223232:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.223240:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a8fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aedb expref: 31 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.223255:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a8fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aedb expref: 31 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.223271:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7000, rc 0) 00000100:00100000:3.0:1746143778.224962:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:32153:x1830963622516992:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1789us (3834us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.224971:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11756 00000100:00100000:2.0:1746143778.225320:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622516864:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16757us (17514us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143778.225327:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3403 00002000:00100000:2.0:1746143778.225337:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880092b63b80 x1830963622516864/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.225344:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b63b80 with x1830963622516864 ext(3145728->4194303) 00002000:00010000:2.0:1746143778.225350:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b63b80 00000100:00100000:0.0:1746143778.229770:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.229903:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622517248 00000100:00100000:2.0:1746143778.229947:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622517248 00002000:00100000:2.0:1746143778.229997:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880092b60380 x1830963622517248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.230007:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60380 with x1830963622517248 ext(3145728->4194303) 00002000:00010000:2.0:1746143778.230013:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b60380 00000100:00100000:2.0:1746143778.230033:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3404 00000100:00100000:2.0:1746143778.230040:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622517248:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143778.234174:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.234241:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622517504 00000100:00100000:1.0:1746143778.234253:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622517504 00002000:00100000:1.0:1746143778.234302:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092b62680 x1830963622517504/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.234311:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62680 with x1830963622517504 ext(4194304->4968447) 00002000:00010000:1.0:1746143778.234317:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b62680 00000100:00100000:1.0:1746143778.234348:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3405 00000100:00100000:1.0:1746143778.234357:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622517504:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143778.248093:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622517248:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18041us (18320us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143778.248106:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3404 00002000:00100000:2.0:1746143778.248119:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880092b60380 x1830963622517248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.248129:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60380 with x1830963622517248 ext(3145728->4194303) 00002000:00010000:2.0:1746143778.248135:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b60380 00000100:00100000:1.0:1746143778.248638:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622517504:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14280us (14471us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143778.248646:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3405 00002000:00100000:1.0:1746143778.248652:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092b62680 x1830963622517504/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.248659:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62680 with x1830963622517504 ext(4194304->4968447) 00002000:00010000:1.0:1746143778.248663:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b62680 00000100:00100000:0.0:1746143778.253120:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.255539:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622517760 00000100:00100000:1.0:1746143778.255553:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622517760 00002000:00100000:1.0:1746143778.255609:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880091d4ea00 x1830963622517760/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.255619:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4ea00 with x1830963622517760 ext(4194304->4968447) 00002000:00010000:1.0:1746143778.255625:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4ea00 00000100:00100000:1.0:1746143778.255667:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3406 00000100:00100000:1.0:1746143778.255675:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622517760:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143778.265238:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622517760:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9552us (12117us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143778.265250:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3406 00002000:00100000:1.0:1746143778.265264:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880091d4ea00 x1830963622517760/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.265273:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4ea00 with x1830963622517760 ext(4194304->4968447) 00002000:00010000:1.0:1746143778.265279:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4ea00 00000100:00100000:0.0:1746143778.282020:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.282439:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622517888 00000100:00100000:1.0:1746143778.282449:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622517888 00000100:00100000:1.0:1746143778.282517:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12860 00000100:00100000:1.0:1746143778.282525:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32160:x1830963622517888:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143778.282550:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.282570:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8fe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aee2 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.282632:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282645:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282655:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282666:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a8ff5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282672:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a8ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282676:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a8ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282741:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282749:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282754:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143778.282792:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:1.0:1746143778.282796:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143778.282810:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282818:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282827:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282832:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282837:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282843:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282847:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143778.282851:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282856:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282865:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143778.282868:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143778.282871:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282876:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73a8fee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282905:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a8ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282936:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a8ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282941:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a8ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282944:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143778.282946:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a8ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282950:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a8ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282955:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e030300) 00010000:00010000:1.0:1746143778.282957:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143778.282959:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a8ff5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282963:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73a8ff5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.282987:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73a8fe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee2 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.282997:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee2 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.283003:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143778.283005:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143778.283007:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2c00, rc 0) 00000100:00100000:1.0:1746143778.283053:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:32160:x1830963622517888:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 530us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.283059:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12860 00000100:00080000:2.0:1746143778.283085:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143778.289723:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.289787:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.290150:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622518016 00000100:00100000:3.0:1746143778.290161:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622518016 00000100:00100000:3.0:1746143778.290212:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622518144 00000100:00100000:3.0:1746143778.290214:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622518144 00000100:00100000:3.0:1746143778.290235:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11757 00000100:00100000:3.0:1746143778.290243:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2008:x1830963622518016:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143778.290264:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.290283:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a9003 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aee9 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.290306:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.290308:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.290317:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a9003 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee9 expref: 7 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.290335:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a9003 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee9 expref: 7 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.290347:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2db400, rc 0) 00000100:00100000:3.0:1746143778.290393:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622518016:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 150us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.290399:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11757 00000100:00100000:3.0:1746143778.290415:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11758 00000100:00100000:3.0:1746143778.290420:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622518144:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143778.290427:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.290436:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73a900a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aef0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.290446:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.290447:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.290451:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73a900a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef0 expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.290460:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73a900a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef0 expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.290467:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2db600, rc 0) 00000100:00100000:3.0:1746143778.290478:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622518144:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 58us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.290482:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11758 00000100:00100000:2.0:1746143778.292121:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.292145:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.292170:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.292201:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622518272 00000100:00100000:1.0:1746143778.292209:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622518272 00000100:00100000:2.0:1746143778.292228:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.292246:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622518400 00000100:00100000:1.0:1746143778.292249:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622518400 00000100:00100000:1.0:1746143778.292279:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622518528 00000100:00100000:1.0:1746143778.292282:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622518528 00000100:00100000:0.0:1746143778.292311:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622518656 00000100:00100000:0.0:1746143778.292315:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622518656 00000100:00100000:1.0:1746143778.292317:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11759 00000100:00100000:1.0:1746143778.292323:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622518272:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:2.0:1746143778.292328:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11760 00010000:00010000:1.0:1746143778.292335:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143778.292341:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622518400:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143778.292344:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11761 00010000:00010000:1.0:1746143778.292349:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73a9011 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aef7 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.292350:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622518528:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143778.292357:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.292360:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.292365:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.292366:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a9018 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af05 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.292367:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.292373:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73a9011 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef7 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.292377:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.292378:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.292384:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a9018 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af05 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.292385:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73a9011 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef7 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.292394:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2400, rc 0) 00010000:00010000:0.0:1746143778.292394:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a9018 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af05 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.292401:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55ba00, rc 0) 00000100:00100000:0.0:1746143778.292428:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622518528:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.292429:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622518272:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 105us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.292433:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11761 00010000:00010000:2.0:1746143778.292492:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a901f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aefe expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143778.292507:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11759 00000100:00100000:0.0:1746143778.292512:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11762 00010000:00010000:2.0:1746143778.292515:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143778.292516:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622518656:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143778.292517:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.292522:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.292525:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a901f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aefe expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.292528:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a9026 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af0c expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.292537:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.292538:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a901f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aefe expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.292539:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.292543:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a9026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af0c expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143778.292551:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086200, rc 0) 00010000:00010000:0.0:1746143778.292551:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a9026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af0c expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.292557:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b600, rc 0) 00000100:00100000:0.0:1746143778.292570:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622518656:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 54us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.292574:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11762 00000100:00100000:2.0:1746143778.292586:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622518400:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 249us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.292594:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11760 00000100:00100000:0.0:1746143778.304613:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.304700:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622518912 00000100:00100000:1.0:1746143778.305226:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622518912 00000100:00100000:1.0:1746143778.305289:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12861 00000100:00100000:1.0:1746143778.305298:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:32160:x1830963622518912:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143778.305319:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.305338:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73a902d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af13 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.305443:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.305463:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae64 expref: 285 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.305471:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae6b expref: 34 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.305478:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee2 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.305485:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.305518:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee2 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.305529:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee2 expref: 14 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.305542:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626738176:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143778.305651:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae6b expref: 34 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.306213:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae6b expref: 34 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.306222:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626738304:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143778.306436:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae64 expref: 285 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.306562:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae64 expref: 285 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.306575:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626738432:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.306641:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.311973:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.311996:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626738176:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.312006:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c38700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626738304:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.312014:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626738432:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.312015:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143778.312041:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143778.312044:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.312143:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622519040 00000100:00100000:2.0:1746143778.312150:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622519040 00010000:00010000:2.0:1746143778.312184:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee2 expref: 15 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.312208:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622519168 00000100:00100000:2.0:1746143778.312209:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622519168 00010000:00010000:2.0:1746143778.312217:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae6b expref: 35 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.312227:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622519296 00000100:00100000:2.0:1746143778.312228:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622519296 00010000:00010000:2.0:1746143778.312236:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae64 expref: 286 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.312247:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5545 00000100:00100000:2.0:1746143778.312253:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622519040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.312266:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.312271:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee2 expref: 15 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.312280:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee2 expref: 15 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.312299:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73a8ffc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee2 expref: 15 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.312331:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5546 00000100:00100000:1.0:1746143778.312336:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:2009:x1830963622519168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.312343:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.312347:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae6b expref: 35 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143778.312354:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae6b expref: 35 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143778.312364:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a8f4d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae6b expref: 35 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143778.312378:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143778.312383:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.312391:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.312396:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.312436:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2009:x1830963622519168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 99us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.312441:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5546 00000100:00100000:3.0:1746143778.312459:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5547 00000100:00100000:3.0:1746143778.312466:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+286:2008:x1830963622519296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.312474:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.312478:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae64 expref: 286 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.312486:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae64 expref: 286 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.312501:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a8f2a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae64 expref: 286 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.312512:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.312515:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.312522:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.312528:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.312542:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143778.312756:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.312763:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143778.312782:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:1.0:1746143778.312907:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73a902d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af13 expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.312947:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af13 expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.312957:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143778.312959:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143778.312961:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3400, rc 0) 00000100:00100000:1.0:1746143778.312985:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:32160:x1830963622518912:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7689us (8384us total) trans 8589943617 rc 0/0 00000100:00100000:1.0:1746143778.312990:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12861 00010000:00010000:2.0:1746143778.313162:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.313166:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.313186:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2010:x1830963622519040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 933us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.313191:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5545 00000100:00100000:3.0:1746143778.313278:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+285:2008:x1830963622519296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 812us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.313283:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5547 00000100:00100000:0.0:1746143778.317564:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.317993:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622519424 00000100:00100000:1.0:1746143778.318004:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622519424 00000100:00100000:1.0:1746143778.318525:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12862 00000100:00100000:1.0:1746143778.318534:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32160:x1830963622519424:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143778.318562:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.318580:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a9042 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af1a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.318676:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.318691:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af13 expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.318698:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143778.318729:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af13 expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.318740:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af13 expref: 15 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.318757:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626738560:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.319230:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.320740:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.320815:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626738560:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143778.320834:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143778.320891:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622519552 00000100:00100000:2.0:1746143778.320896:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622519552 00010000:00010000:2.0:1746143778.320949:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af13 expref: 16 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.321292:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5548 00000100:00100000:2.0:1746143778.321299:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963622519552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.321312:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.321318:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af13 expref: 16 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.321326:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af13 expref: 16 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.321346:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73a9034 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af13 expref: 16 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.321359:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.321364:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.321371:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.321377:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.321577:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143778.321676:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143778.321683:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143778.321736:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:0.0:1746143778.321741:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143778.321759:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143778.321786:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73a9042 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af1a expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.321813:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622519552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 514us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.321820:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5548 00010000:00010000:0.0:1746143778.322156:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af1a expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.322164:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143778.322167:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143778.322169:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3a00, rc 0) 00000100:00100000:0.0:1746143778.322398:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32160:x1830963622519424:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3864us (4845us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.322404:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12862 00000100:00100000:0.0:1746143778.325069:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.326878:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622519808 00000100:00100000:2.0:1746143778.326891:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622519808 00000100:00100000:2.0:1746143778.327013:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12863 00000100:00100000:2.0:1746143778.327022:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32160:x1830963622519808:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143778.327045:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.327068:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73a9050 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af21 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.327180:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087200/0x87925e4cb73a9057 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.327195:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087200/0x87925e4cb73a9057 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.327207:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087200/0x87925e4cb73a9057 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143778.327220:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00010000:00010000:2.0:1746143778.327318:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73a9050 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af21 expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.327333:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087200/0x87925e4cb73a9057 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af21 expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.327341:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.327344:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143778.327347:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087200, rc 0) 00000100:00100000:2.0:1746143778.327417:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32160:x1830963622519808:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 397us (2355us total) trans 8589943618 rc 0/0 00000100:00100000:2.0:1746143778.327424:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12863 00000100:00100000:0.0:1746143778.331005:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.331050:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.331123:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622519936 00000100:00100000:3.0:1746143778.331133:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622519936 00000100:00100000:3.0:1746143778.331175:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622520064 00000100:00100000:3.0:1746143778.331177:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622520064 00000100:00100000:3.0:1746143778.331194:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11763 00000100:00100000:3.0:1746143778.331201:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622519936:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143778.331245:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.331263:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8ec1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adfb expref: 25 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.331275:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a9003 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee9 expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.331283:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73a8ed6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae25 expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.331290:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.331291:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.331295:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.331326:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73a8ed6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae25 expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.331339:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73a8ed6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae25 expref: 11 pid: 9586 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.331352:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626738688:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.331434:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a9003 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee9 expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.331442:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a9003 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee9 expref: 9 pid: 9839 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.331451:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626738816:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.331479:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8ec1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adfb expref: 25 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.331487:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8ec1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adfb expref: 25 pid: 9587 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.331494:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626738944:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.331509:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.331530:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11764 00000100:00100000:3.0:1746143778.331535:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622520064:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143778.331555:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.331565:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73a8e97 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add8 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.331572:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73a900a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef0 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.331579:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a8eac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae02 expref: 30 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.331584:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.331586:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.331588:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.331607:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a8eac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae02 expref: 30 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.331615:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a8eac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae02 expref: 30 pid: 12328 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.331623:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626739072:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.331649:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73a900a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef0 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.331656:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73a900a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef0 expref: 10 pid: 9839 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.331663:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626739200:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.331685:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73a8e97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add8 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.331692:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73a8e97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add8 expref: 11 pid: 1945 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.331699:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626739328:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.331712:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.334481:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.334517:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.334549:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.334570:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.334595:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622520192 00000100:00100000:0.0:1746143778.334601:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622520192 00000100:00100000:0.0:1746143778.334630:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622520320 00000100:00100000:0.0:1746143778.334632:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622520320 00000100:00100000:0.0:1746143778.334643:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622520448 00000100:00100000:0.0:1746143778.334645:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622520448 00000100:00100000:0.0:1746143778.334653:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622520576 00000100:00100000:0.0:1746143778.334655:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622520576 00000100:00100000:0.0:1746143778.334665:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11765 00000100:00100000:0.0:1746143778.334671:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622520192:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:3.0:1746143778.335392:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11766 00000100:00100000:3.0:1746143778.335401:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622520320:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143778.335438:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.335453:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a8e9e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ade6 expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.335461:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a901f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aefe expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.335467:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8eb3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae10 expref: 25 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.335473:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.335474:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.335477:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.335502:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae10 expref: 25 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.335511:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8eb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae10 expref: 25 pid: 12327 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.335522:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626739456:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.335590:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a901f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aefe expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.335601:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a901f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aefe expref: 11 pid: 3135 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.335608:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626739584:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.335631:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a8e9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ade6 expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.335638:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a8e9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ade6 expref: 11 pid: 9587 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.335645:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626739712:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.335659:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.335676:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11767 00000100:00100000:3.0:1746143778.335681:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622520448:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143778.335696:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.335705:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.335711:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a9018 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af05 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.335717:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73a8fd9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aed4 expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.335724:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.335728:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143778.335730:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143778.335732:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 7/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.335746:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.335753:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 25 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.335760:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626739840:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.335792:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73a8fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aed4 expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.335799:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73a8fd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aed4 expref: 25 pid: 12327 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.335806:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626739968:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.335829:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a9018 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af05 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.335840:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a9018 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af05 expref: 11 pid: 1945 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.335853:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626740096:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.335873:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.335880:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 11 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.335886:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626740224:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.335899:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe240 going to sleep for 11 seconds 00010000:00010000:0.0:1746143778.335991:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.336002:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8eeb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae3a expref: 30 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.336008:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73a9011 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef7 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.336015:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a8f00 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae4f expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.336020:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.336021:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.336023:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.336038:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a8f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae4f expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.336039:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11768 00000100:00100000:3.0:1746143778.336046:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622520576:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143778.336046:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a8f00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae4f expref: 11 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143778.336059:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626740352:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.336061:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.336068:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.336075:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a9026 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af0c expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.336081:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a8fe0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aedb expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.336087:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.336087:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73a9011 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef7 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.336092:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143778.336093:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143778.336094:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73a9011 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef7 expref: 12 pid: 9586 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143778.336095:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 7/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.336102:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626740480:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.336107:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.336115:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 30 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143778.336115:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8eeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae3a expref: 30 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143778.336122:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626740608:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143778.336122:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8eeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae3a expref: 30 pid: 9586 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143778.336128:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626740736:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.336136:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00010000:00010000:3.0:1746143778.336139:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a8fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aedb expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.336145:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a8fe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aedb expref: 30 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.336151:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626740864:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.336166:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a9026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af0c expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.336177:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a9026 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af0c expref: 12 pid: 1945 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.336184:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626740992:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.336198:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.336205:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 11 pid: 12327 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.336212:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626741120:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.336223:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.337489:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626738688:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.337500:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880082ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626738816:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.349562:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.349577:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.349588:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.349639:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626739072:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.351750:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622520832 00000100:00100000:1.0:1746143778.351762:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622520832 00000100:00100000:0.0:1746143778.351770:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143778.351825:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a9003 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee9 expref: 12 pid: 9839 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143778.351854:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622521088 00000100:00100000:1.0:1746143778.351856:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622521088 00010000:00010000:1.0:1746143778.351870:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a8eac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae02 expref: 31 pid: 12328 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143778.351882:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622520704 00000100:00100000:1.0:1746143778.351884:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622520704 00010000:00010000:1.0:1746143778.351896:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73a8ed6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae25 expref: 12 pid: 9586 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.351905:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622520960 00000100:00100000:1.0:1746143778.351907:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622520960 00010000:00010000:1.0:1746143778.351943:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8ec1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adfb expref: 26 pid: 9587 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143778.351956:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5549 00000100:00100000:1.0:1746143778.351964:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622520832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.351979:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.352001:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a9003 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee9 expref: 12 pid: 9839 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.352011:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a9003 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee9 expref: 12 pid: 9839 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.352040:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73a9003 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aee9 expref: 12 pid: 9839 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143778.352050:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5550 00010000:00010000:1.0:1746143778.352062:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143778.352063:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622521088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143778.352079:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143778.352102:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a8eac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae02 expref: 31 pid: 12328 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143778.352114:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a8eac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae02 expref: 31 pid: 12328 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143778.352118:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622520832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 154us (2563us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.352125:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5549 00010000:00010000:0.0:1746143778.352133:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73a8eac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae02 expref: 31 pid: 12328 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143778.352142:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5551 00000100:00100000:1.0:1746143778.352147:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622520704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143778.352150:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143778.352154:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.352161:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73a8ed6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae25 expref: 12 pid: 9586 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143778.352171:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73a8ed6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae25 expref: 12 pid: 9586 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143778.352182:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73a8ed6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae25 expref: 12 pid: 9586 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143778.352184:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622521088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 126us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.352190:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5550 00010000:00010000:1.0:1746143778.352196:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143778.352208:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5552 00000100:00100000:1.0:1746143778.352214:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622520704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.352214:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622520960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143778.352220:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5551 00010000:00010000:0.0:1746143778.352221:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143778.352230:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8ec1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adfb expref: 26 pid: 9587 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143778.352239:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8ec1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adfb expref: 26 pid: 9587 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143778.352249:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.352251:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.352255:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.352263:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.352276:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.352283:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.352288:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622520960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.352293:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5552 00000100:00100000:1.0:1746143778.352303:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622521216 00000100:00100000:1.0:1746143778.352305:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622521216 00010000:00010000:1.0:1746143778.352316:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73a900a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef0 expref: 13 pid: 9839 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143778.352335:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5553 00000100:00100000:1.0:1746143778.352340:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622521216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.352347:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.352357:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73a900a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef0 expref: 13 pid: 9839 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.352373:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73a900a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef0 expref: 13 pid: 9839 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.352385:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.352401:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622521216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.352406:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5553 00000100:00100000:1.0:1746143778.352468:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.352616:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.352629:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.352639:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622521344 00000100:00100000:1.0:1746143778.352641:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622521344 00010000:00010000:1.0:1746143778.352652:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73a8e97 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add8 expref: 12 pid: 1945 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143778.352666:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622521472 00000100:00100000:1.0:1746143778.352667:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622521472 00010000:00010000:1.0:1746143778.352675:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8eb3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae10 expref: 26 pid: 12327 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143778.352685:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622521728 00000100:00100000:1.0:1746143778.352687:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622521728 00010000:00010000:1.0:1746143778.352694:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a8e9e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ade6 expref: 11 pid: 9587 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143778.352703:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5554 00000100:00100000:1.0:1746143778.352708:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622521344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.352714:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.352720:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73a8e97 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add8 expref: 12 pid: 1945 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.352729:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73a8e97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add8 expref: 12 pid: 1945 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.352740:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.352742:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.352746:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.352757:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.352771:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.352787:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622521344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.352793:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5554 00000100:00100000:1.0:1746143778.352802:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5555 00000100:00100000:1.0:1746143778.352806:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622521472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.352813:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.352821:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8eb3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae10 expref: 26 pid: 12327 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.352830:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8eb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae10 expref: 26 pid: 12327 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.352839:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.352851:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622521472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 44us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.352856:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5555 00000100:00100000:1.0:1746143778.352864:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5556 00000100:00100000:1.0:1746143778.352868:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622521728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.352874:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.352879:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a8e9e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ade6 expref: 11 pid: 9587 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.352887:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a8e9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ade6 expref: 11 pid: 9587 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.352896:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.352907:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622521728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 39us (277us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143778.353342:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73a900a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef0 expref: 12 pid: 9839 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143778.353354:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a8ec1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840adfb expref: 25 pid: 9587 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143778.353360:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626739200:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.353374:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626738944:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143778.353387:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73a8e97 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840add8 expref: 11 pid: 1945 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143778.353396:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626739328:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.353401:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353422:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353425:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73a8eb3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae10 expref: 24 pid: 12327 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143778.353430:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353437:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.353438:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626739456:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.353448:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626739584:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143778.353453:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353457:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a8e9e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ade6 expref: 11 pid: 9587 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.353464:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626739712:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143778.353466:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353473:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353479:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092137e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143778.353480:0:1947:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353483:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353492:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353501:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353502:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353507:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353508:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73a906c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353522:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353529:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353536:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353546:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092136000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143778.353549:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.353551:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622520064:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 22015us (22500us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143778.353556:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.353559:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11764 00010000:00010000:3.0:1746143778.353566:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353571:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73a9065 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.353614:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622519936:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 22413us (22619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.353622:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11763 00000100:00100000:2.0:1746143778.353626:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.353648:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622521600 00000100:00100000:3.0:1746143778.353654:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622521600 00010000:00010000:3.0:1746143778.353669:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a901f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aefe expref: 10 pid: 3135 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.353684:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5557 00000100:00100000:3.0:1746143778.353689:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622521600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.353697:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.353706:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a901f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aefe expref: 10 pid: 3135 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143778.353714:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a901f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aefe expref: 10 pid: 3135 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143778.353724:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082086200/0x87925e4cb73a901f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aefe expref: 10 pid: 3135 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143778.353731:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.353733:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.353735:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353743:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.353756:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.353776:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622521600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 87us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.353782:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5557 00010000:00010000:2.0:1746143778.353946:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353958:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353971:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353977:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353984:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353989:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880124adfc00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143778.353992:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.353998:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.354006:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.354012:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73a9073 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.354045:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622520320:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 18645us (19526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.354051:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11766 00000100:00100000:1.0:1746143778.354223:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5556 00000100:00100000:3.0:1746143778.354341:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626740096:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.354350:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626740224:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.354366:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626740352:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.354367:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626740608:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.354375:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626740480:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.354382:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626740736:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143778.354398:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.354508:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626739840:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.354515:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626739968:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143778.354530:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.354604:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626740864:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.354613:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626741120:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.357359:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.357407:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.357434:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.357447:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.357469:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.357496:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.357574:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622521856 00000100:00100000:2.0:1746143778.357583:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622521856 00010000:00010000:2.0:1746143778.357614:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a9018 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af05 expref: 8 pid: 1945 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143778.357633:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622522112 00000100:00100000:2.0:1746143778.357635:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622522112 00010000:00010000:2.0:1746143778.357651:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a8f00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae4f expref: 11 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.357660:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622522368 00000100:00100000:2.0:1746143778.357662:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622522368 00010000:00010000:2.0:1746143778.357672:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 30 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.357679:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622521984 00000100:00100000:2.0:1746143778.357681:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622521984 00010000:00010000:2.0:1746143778.357690:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 10 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.357697:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622522240 00000100:00100000:2.0:1746143778.357699:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622522240 00010000:00010000:2.0:1746143778.357708:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73a9011 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef7 expref: 11 pid: 9586 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143778.357715:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622522624 00000100:00100000:2.0:1746143778.357717:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622522624 00010000:00010000:2.0:1746143778.357724:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8eeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae3a expref: 31 pid: 9586 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143778.357733:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5558 00000100:00100000:2.0:1746143778.357740:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622521856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.357755:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.357772:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a9018 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af05 expref: 8 pid: 1945 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143778.357781:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a9018 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af05 expref: 8 pid: 1945 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143778.357803:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a9018 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af05 expref: 8 pid: 1945 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143778.357819:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.358146:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5559 00000100:00100000:3.0:1746143778.358165:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622522112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.358183:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.358208:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a8f00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae4f expref: 11 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.358222:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a8f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae4f expref: 11 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.358243:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a8f00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae4f expref: 11 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.358262:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.358315:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622522112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 158us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.358322:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5559 00000100:00100000:3.0:1746143778.358347:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5560 00000100:00100000:3.0:1746143778.358352:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622522368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.358360:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.358369:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 31 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.358377:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 31 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.358389:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73a8fcb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aec6 expref: 31 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.358404:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.358418:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963622522368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.358423:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5560 00000100:00100000:3.0:1746143778.358432:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5561 00000100:00100000:3.0:1746143778.358437:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622521984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.358444:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143778.358499:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5562 00000100:00100000:1.0:1746143778.358507:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622522240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.358514:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.358523:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73a9011 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef7 expref: 11 pid: 9586 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.358531:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73a9011 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef7 expref: 11 pid: 9586 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.358542:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73a9011 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aef7 expref: 11 pid: 9586 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.358551:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.358567:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622522240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 62us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.358571:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5562 00000100:00100000:1.0:1746143778.358582:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5563 00000100:00100000:1.0:1746143778.358587:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622522624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.358595:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.358601:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8eeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae3a expref: 29 pid: 9586 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.358609:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8eeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae3a expref: 29 pid: 9586 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.358618:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7d800/0x87925e4cb73a8eeb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae3a expref: 29 pid: 9586 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143778.358625:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.358627:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.358632:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.358640:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.358665:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.358678:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622522624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 91us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.358682:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5563 00010000:00010000:3.0:1746143778.358731:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 10 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.358741:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 10 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.358743:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2010:x1830963622521856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 118us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.358753:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5558 00010000:00010000:3.0:1746143778.358754:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d75200/0x87925e4cb73a8fbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb8 expref: 10 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.358762:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.358777:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622521984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 340us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.358783:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5561 00010000:00010000:0.0:1746143778.358851:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.358865:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.358890:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.358897:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.358903:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.358908:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55a400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143778.358940:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.358948:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.358960:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.358966:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a400/0x87925e4cb73a9081 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.359022:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622520192:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 24350us (24547us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.359031:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11765 00000100:00100000:0.0:1746143778.360034:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.361493:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.362203:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.362573:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626740992:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.362601:0:9839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.362659:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622522496 00000100:00100000:2.0:1746143778.362665:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622522496 00010000:00010000:2.0:1746143778.362692:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 24 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.362709:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622522880 00000100:00100000:2.0:1746143778.362711:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622522880 00010000:00010000:2.0:1746143778.362719:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a9026 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af0c expref: 9 pid: 1945 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143778.362744:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622523008 00000100:00100000:2.0:1746143778.362746:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622523008 00010000:00010000:2.0:1746143778.362754:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a8fe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aedb expref: 28 pid: 9839 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.362765:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5564 00000100:00100000:2.0:1746143778.362770:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622522496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.362781:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.362796:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 24 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.362805:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 24 pid: 1945 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143778.362818:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143778.362822:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d75000/0x87925e4cb73a8fb6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aeb1 expref: 24 pid: 1945 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.362834:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143778.362838:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.362873:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622522496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 103us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.362879:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5564 00000100:00100000:2.0:1746143778.362889:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622522752 00000100:00100000:2.0:1746143778.362891:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622522752 00010000:00010000:2.0:1746143778.362898:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 10 pid: 12327 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.362909:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622523136 00000100:00100000:2.0:1746143778.362931:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622523136 00010000:00010000:2.0:1746143778.362939:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73a8fd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aed4 expref: 23 pid: 12327 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.362947:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5565 00000100:00100000:2.0:1746143778.362951:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622522880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.362957:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.362970:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a9026 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af0c expref: 9 pid: 1945 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143778.362977:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a9026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af0c expref: 9 pid: 1945 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143778.362990:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73a9026 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af0c expref: 9 pid: 1945 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143778.362996:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.363010:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622522880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 58us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.363014:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5565 00000100:00100000:2.0:1746143778.363021:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5566 00000100:00100000:2.0:1746143778.363025:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622523008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.363030:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.363035:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a8fe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aedb expref: 28 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.363041:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a8fe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aedb expref: 28 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.363049:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7000/0x87925e4cb73a8fe0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aedb expref: 28 pid: 9839 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.363054:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.363062:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963622523008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 37us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.363066:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5566 00000100:00100000:2.0:1746143778.363091:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5567 00000100:00100000:2.0:1746143778.363095:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622522752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.363099:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.363104:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 10 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.363110:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 10 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.363117:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d600/0x87925e4cb73a8fd2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aecd expref: 10 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.363123:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.363130:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.363133:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.363141:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.363155:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.363166:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622522752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 71us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.363170:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5567 00000100:00100000:2.0:1746143778.363177:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5568 00000100:00100000:2.0:1746143778.363180:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622523136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.363185:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.363189:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73a8fd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aed4 expref: 23 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.363196:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73a8fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aed4 expref: 23 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.363203:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73a8fd9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aed4 expref: 23 pid: 12327 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.363277:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.363283:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.363296:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.363301:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.363307:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.363316:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143778.363319:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.363325:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.363333:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.363338:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73a9088 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.363382:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622520576:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 27337us (28810us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.363388:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11768 00010000:00010000:2.0:1746143778.363424:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.363425:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.363428:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.363433:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.363602:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.363624:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622523136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 443us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.363629:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5568 00010000:00010000:1.0:1746143778.363684:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.363691:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.363705:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.363710:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.363715:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.363719:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096011c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143778.363721:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.363726:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.363733:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.363738:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096011c00/0x87925e4cb73a907a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143778.363779:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2009:x1830963622520448:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 28098us (29229us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.363784:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11767 00000100:00100000:0.0:1746143778.366085:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.366146:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622523392 00000100:00100000:3.0:1746143778.366156:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622523392 00000100:00100000:3.0:1746143778.366200:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12864 00000100:00100000:3.0:1746143778.366206:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32160:x1830963622523392:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1746143778.366241:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.366259:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73a9049 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af1a expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366272:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.366275:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143778.366292:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.366302:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe0 expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366308:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac34 expref: 284 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366314:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab23 expref: 284 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366319:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a8965 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab38 expref: 33 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366329:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae79 expref: 284 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366334:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae80 expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366339:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 9/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.366361:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae80 expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366369:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae80 expref: 33 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.366378:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741248:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.366456:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae79 expref: 284 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366463:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae79 expref: 284 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.366469:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741376:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.366485:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a8965 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab38 expref: 33 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366490:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a8965 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab38 expref: 33 pid: 14991 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.366497:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741504:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.366510:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab23 expref: 284 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366516:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab23 expref: 284 pid: 14991 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.366521:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741632:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.366534:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac34 expref: 284 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366539:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac34 expref: 284 pid: 7244 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.366544:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741760:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.366558:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe0 expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.366564:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe0 expref: 33 pid: 7244 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.366569:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741888:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.366578:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.371378:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.371414:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.371437:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.371450:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.371460:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.371535:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741248:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.371547:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741376:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.371554:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741504:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.371565:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741632:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.371572:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741760:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.371578:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626741888:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.371613:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143778.371901:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622523648 00000100:00100000:1.0:1746143778.371937:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622523648 00000100:00100000:1.0:1746143778.371981:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4711 00000100:00100000:1.0:1746143778.371988:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:16365:x1830963622523648:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143778.372615:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622524032 00000100:00100000:2.0:1746143778.372620:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622524032 00000100:00100000:0.0:1746143778.372634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143778.372639:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab23 expref: 285 pid: 14991 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.372656:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622524288 00000100:00100000:2.0:1746143778.372658:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622524288 00010000:00010000:2.0:1746143778.372665:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe0 expref: 36 pid: 7244 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.372685:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622523904 00000100:00100000:2.0:1746143778.372687:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622523904 00010000:00010000:2.0:1746143778.372693:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a8965 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab38 expref: 37 pid: 14991 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.372699:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622524160 00000100:00100000:2.0:1746143778.372701:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622524160 00010000:00010000:2.0:1746143778.372707:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac34 expref: 286 pid: 7244 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.372713:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5569 00000100:00100000:2.0:1746143778.372717:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:2010:x1830963622524032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.372729:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.372733:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab23 expref: 286 pid: 14991 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.372741:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab23 expref: 286 pid: 14991 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.372756:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a8934 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab23 expref: 286 pid: 14991 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.372767:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.372770:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143778.372777:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.372804:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+285:2010:x1830963622524032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.372809:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5570 00000100:00100000:3.0:1746143778.372825:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622524416 00000100:00100000:3.0:1746143778.372830:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622524416 00000100:00100000:3.0:1746143778.372855:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4712 00000100:00100000:3.0:1746143778.372860:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:8586:x1830963622524416:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143778.372980:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5569 00000100:00100000:2.0:1746143778.372996:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5571 00000100:00100000:2.0:1746143778.373000:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+37:2010:x1830963622523904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.373007:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.373011:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a8965 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab38 expref: 37 pid: 14991 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.373018:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a8965 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab38 expref: 37 pid: 14991 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.373027:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e200/0x87925e4cb73a8965 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ab38 expref: 37 pid: 14991 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.373031:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:8586:x1830963622524416:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 170us (399us total) trans 8589943620 rc 0/0 00010000:00010000:2.0:1746143778.373035:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00000100:00100000:3.0:1746143778.373037:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4712 00010000:00010000:2.0:1746143778.373039:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143778.373043:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.373058:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+36:2010:x1830963622523904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 58us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.373063:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5571 00000100:00100000:3.0:1746143778.373068:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:2010:x1830963622524288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143778.373070:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5572 00000100:00100000:2.0:1746143778.373074:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+285:2010:x1830963622524160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.373078:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.373079:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.373082:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac34 expref: 285 pid: 7244 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.373085:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe0 expref: 35 pid: 7244 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.373088:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac34 expref: 285 pid: 7244 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.373096:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe0 expref: 35 pid: 7244 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.373175:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:16365:x1830963622523648:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 1186us (1807us total) trans 8589943619 rc 0/0 00000100:00100000:1.0:1746143778.373182:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4711 00010000:00010000:2.0:1746143778.373690:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73a8af4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ac34 expref: 285 pid: 7244 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.373699:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.373702:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143778.373707:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.373848:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+284:2010:x1830963622524160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 772us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.373853:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5572 00000100:00100000:0.0:1746143778.374507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143778.374696:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73a8a68 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840abe0 expref: 34 pid: 7244 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.374717:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.374721:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.374729:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.374777:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2010:x1830963622524288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1957us (3335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.374785:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5570 00000100:00100000:3.0:1746143778.375153:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622524544 00000100:00100000:3.0:1746143778.375161:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622524544 00010000:00010000:3.0:1746143778.375194:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae80 expref: 33 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.375217:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5573 00000100:00100000:3.0:1746143778.375224:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2010:x1830963622524544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.375237:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.375242:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae80 expref: 33 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.375252:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae80 expref: 33 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.375264:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73a8f7e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae80 expref: 33 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.375274:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.375277:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.375283:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.375306:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2010:x1830963622524544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 82us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.375311:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5573 00000100:00100000:0.0:1746143778.376395:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.376832:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622524672 00000100:00100000:2.0:1746143778.376839:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622524672 00010000:00010000:2.0:1746143778.376863:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae79 expref: 284 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.376891:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5574 00000100:00100000:2.0:1746143778.376896:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+284:2010:x1830963622524672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.376906:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.376935:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae79 expref: 284 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.376944:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae79 expref: 284 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.376962:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45c00/0x87925e4cb73a8f69 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ae79 expref: 284 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.376972:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.376975:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143778.376982:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143778.376988:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143778.377010:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.377043:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+283:2010:x1830963622524672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 147us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.377048:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5574 00010000:00010000:3.0:1746143778.377443:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.377454:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000040:00080000:3.0:1746143778.377717:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2635, 88 off219592 00000004:00080000:3.0:1746143778.377724:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837601811657ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.377775:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2601, 88 off216952 00000004:00080000:3.0:1746143778.377780:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837601868129ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.377804:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2602, 88 off217040 00000004:00080000:3.0:1746143778.377807:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837601895197ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.377815:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2636, 88 off219680 00000004:00080000:3.0:1746143778.377818:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837601905719ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.377825:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2637, 88 off219768 00000004:00080000:3.0:1746143778.377828:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837601915569ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.377959:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2603, 88 off217128 00000004:00080000:3.0:1746143778.377963:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837602050563ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.377973:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2604, 88 off217216 00000004:00080000:3.0:1746143778.377976:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837602063436ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.377983:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2605, 88 off217304 00000004:00080000:3.0:1746143778.377985:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837602073406ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.377993:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2638, 88 off219856 00000004:00080000:3.0:1746143778.377996:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837602084243ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.378003:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2606, 88 off217392 00000004:00080000:3.0:1746143778.378006:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837602093671ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.378013:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2639, 88 off219944 00000004:00080000:3.0:1746143778.378015:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837602103006ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.378022:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2607, 88 off217480 00000004:00080000:3.0:1746143778.378024:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837602112038ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.378031:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2640, 88 off220032 00000004:00080000:3.0:1746143778.378033:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837602120888ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.378040:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2641, 88 off220120 00000004:00080000:3.0:1746143778.378042:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837602129629ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.378048:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2642, 88 off220208 00000004:00080000:3.0:1746143778.378050:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837602138416ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.378057:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2643, 88 off220296 00000004:00080000:3.0:1746143778.378059:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837602147187ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.378066:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2608, 88 off217568 00000004:00080000:3.0:1746143778.378068:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837602155668ns, next at 770855090093ns, rc = 0 00000001:00080000:2.0:1746143778.379989:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943621 is committed 00000004:00080000:2.0:1746143778.379997:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1838 committed 00000004:00080000:2.0:1746143778.380423:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1871 committed 00000004:00080000:2.0:1746143778.380434:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1870 committed 00000004:00080000:2.0:1746143778.380435:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1869 committed 00000004:00080000:2.0:1746143778.380437:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1868 committed 00000004:00080000:2.0:1746143778.380438:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1837 committed 00000004:00080000:2.0:1746143778.380439:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1867 committed 00000004:00080000:2.0:1746143778.380441:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1836 committed 00000004:00080000:2.0:1746143778.380442:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1866 committed 00000004:00080000:2.0:1746143778.380443:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1835 committed 00000004:00080000:2.0:1746143778.380444:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1834 committed 00000004:00080000:2.0:1746143778.380445:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1833 committed 00000004:00080000:2.0:1746143778.380446:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1865 committed 00000004:00080000:2.0:1746143778.380448:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1864 committed 00000004:00080000:2.0:1746143778.380449:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1832 committed 00000004:00080000:2.0:1746143778.380450:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1831 committed 00000004:00080000:2.0:1746143778.380451:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1863 committed 00000001:00080000:2.0:1746143778.380456:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943620 is committed 00000001:00080000:2.0:1746143778.380459:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943619 is committed 00000004:00010000:3.0:1746143778.380675:0:14991:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800911faa00 reply state ffff880122646800 transno 8589943621 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.380691:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.380698:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.380700:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746143778.380703:0:14991:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746143778.380768:0:14991:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143778.380780:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32160:x1830963622523392:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 14571us (14701us total) trans 8589943621 rc 0/0 00000100:00100000:3.0:1746143778.380790:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12864 00000100:00100000:0.0:1746143778.381012:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626742016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.381047:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.381065:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626742528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.381074:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.381092:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626743040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.381102:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.381113:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143778.381117:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626742400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.381127:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.381134:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626742912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.381146:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.381163:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626742016 00000100:00100000:0.0:1746143778.381167:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626742016 00000100:00100000:0.0:1746143778.381192:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626742528 00000100:00100000:0.0:1746143778.381193:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626742528 00000100:00100000:0.0:1746143778.381200:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626743040 00000100:00100000:0.0:1746143778.381201:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626743040 00000100:00100000:0.0:1746143778.381208:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626742400 00000100:00100000:0.0:1746143778.381210:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626742400 00000100:00100000:0.0:1746143778.381216:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626742912 00000100:00100000:0.0:1746143778.381217:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626742912 00000100:00100000:0.0:1746143778.381224:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11769 00000100:00100000:0.0:1746143778.381229:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3774:x1830963626742016:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143778.382635:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143778.382646:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143778.382653:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143778.382658:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b24000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143778.382662:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143778.382668:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11770 00010000:00010000:2.0:1746143778.382671:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143778.382678:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3774:x1830963626742528:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143778.382682:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.382684:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143778.382686:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143778.382691:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73a908f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00000100:00080000:2.0:1746143778.382713:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143778.382726:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11771 00000100:00100000:2.0:1746143778.382734:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3774:x1830963626743040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.383129:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3774:x1830963626742528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 452us (2052us total) trans 21474840303 rc 0/0 00000100:00100000:2.0:1746143778.383129:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3774:x1830963626743040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 396us (2024us total) trans 21474840304 rc 0/0 00000100:00100000:3.0:1746143778.383135:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11770 00000100:00100000:2.0:1746143778.383138:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11771 00000100:00100000:3.0:1746143778.383148:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11772 00000100:00100000:2.0:1746143778.383151:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11773 00000100:00100000:3.0:1746143778.383152:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3774:x1830963626742400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143778.383156:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3774:x1830963626742912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.383197:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3774:x1830963626742400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (2069us total) trans 21474840305 rc 0/0 00000100:00100000:3.0:1746143778.383202:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11772 00002000:00010000:2.0:1746143778.383203:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143778.383205:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143778.383207:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143778.383208:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143778.383210:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:2.0:1746143778.383229:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3774:x1830963626742912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (2082us total) trans 21474840306 rc 0/0 00000100:00100000:2.0:1746143778.383234:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11773 00000100:00100000:0.0:1746143778.383261:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3774:x1830963626742016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2031us (2212us total) trans 21474840302 rc 0/0 00000100:00100000:0.0:1746143778.383266:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11769 00000100:00100000:0.0:1746143778.383301:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840291 gen 2 00000004:00080000:0.0:1746143778.383305:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921ce680, transno 21474840246 00000004:00080000:0.0:1746143778.383311:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cca80, transno 21474840247 00000004:00080000:0.0:1746143778.383313:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cc700, transno 21474840248 00000004:00080000:0.0:1746143778.383316:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cdc00, transno 21474840249 00000004:00080000:0.0:1746143778.383318:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cc380, transno 21474840250 00000004:00080000:0.0:1746143778.383320:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921ced80, transno 21474840251 00000004:00080000:0.0:1746143778.383322:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cea00, transno 21474840252 00000004:00080000:0.0:1746143778.383324:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cce00, transno 21474840253 00000004:00080000:0.0:1746143778.383325:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cc000, transno 21474840254 00000004:00080000:0.0:1746143778.383327:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cf100, transno 21474840255 00000004:00080000:0.0:1746143778.383329:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921ce300, transno 21474840256 00000004:00080000:0.0:1746143778.383331:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cd180, transno 21474840257 00000004:00080000:0.0:1746143778.383333:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cf800, transno 21474840258 00000004:00080000:0.0:1746143778.383335:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cf480, transno 21474840259 00000004:00080000:0.0:1746143778.383337:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cdf80, transno 21474840260 00000004:00080000:0.0:1746143778.383339:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cd880, transno 21474840261 00000004:00080000:0.0:1746143778.383340:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb5c00, transno 21474840262 00000004:00080000:0.0:1746143778.383342:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb4380, transno 21474840263 00000004:00080000:0.0:1746143778.383344:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d840000, transno 21474840270 00000004:00080000:0.0:1746143778.383346:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d841c00, transno 21474840271 00000004:00080000:0.0:1746143778.383347:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d843480, transno 21474840272 00000004:00080000:0.0:1746143778.383349:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d841f80, transno 21474840273 00000004:00080000:0.0:1746143778.383351:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d840e00, transno 21474840274 00000004:00080000:0.0:1746143778.383352:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d842300, transno 21474840275 00000004:00080000:0.0:1746143778.383354:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d840380, transno 21474840276 00000004:00080000:0.0:1746143778.383355:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d843100, transno 21474840277 00000004:00080000:0.0:1746143778.383357:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136ac8a80, transno 21474840278 00000004:00080000:0.0:1746143778.383358:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b23800, transno 21474840283 00000004:00080000:0.0:1746143778.383360:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b21f80, transno 21474840284 00000004:00080000:0.0:1746143778.383362:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b22a00, transno 21474840285 00000004:00080000:0.0:1746143778.383363:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b21500, transno 21474840286 00000004:00080000:0.0:1746143778.383365:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b20380, transno 21474840287 00000004:00080000:0.0:1746143778.383366:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b23480, transno 21474840288 00000004:00080000:0.0:1746143778.383368:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b23b80, transno 21474840289 00000004:00080000:0.0:1746143778.383369:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7ab100, transno 21474840290 00000004:00080000:0.0:1746143778.383371:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b22300, transno 21474840291 00000100:00100000:0.0:1746143778.383375:0:3774:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800911f9c00 x1830963626742400/t21474840305(21474840305) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143794 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143778.383382:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f9c00/2, rc 0, transno 21474840305 00000100:00100000:0.0:1746143778.383386:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626742400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.383391:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911fa680/2, rc 0, transno 21474840306 00000100:00100000:0.0:1746143778.383394:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626742912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.383399:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f9880/2, rc 0, transno 21474840302 00000100:00100000:0.0:1746143778.383401:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626742016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.383405:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f9f80/2, rc 0, transno 21474840303 00000100:00100000:0.0:1746143778.383407:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626742528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.383412:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911fb100/2, rc 0, transno 21474840304 00000100:00100000:0.0:1746143778.383413:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626743040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.383551:0:8224:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 3 in flight, 36 done 00000100:00100000:1.0:1746143778.383669:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626742272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.383694:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.383707:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626742784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.383717:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.383724:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626743296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.383733:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.383752:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626743808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.383762:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.383771:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746143778.383774:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626742144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.383783:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.383790:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626742656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.383800:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.383806:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626743168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.383815:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.383821:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626743680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.383832:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.383848:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626742272 00000100:00100000:1.0:1746143778.383852:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626742272 00000100:00100000:1.0:1746143778.383871:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626742784 00000100:00100000:1.0:1746143778.383873:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626742784 00000100:00100000:1.0:1746143778.383880:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626743296 00000100:00100000:1.0:1746143778.383881:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626743296 00000100:00100000:1.0:1746143778.383885:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626743808 00000100:00100000:1.0:1746143778.383886:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626743808 00000100:00100000:1.0:1746143778.383890:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626742144 00000100:00100000:1.0:1746143778.383892:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626742144 00000100:00100000:1.0:1746143778.383896:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626742656 00000100:00100000:1.0:1746143778.383897:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626742656 00000100:00100000:1.0:1746143778.383901:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626743168 00000100:00100000:1.0:1746143778.383903:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626743168 00000100:00100000:1.0:1746143778.383907:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626743680 00000100:00100000:1.0:1746143778.383908:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626743680 00000100:00100000:1.0:1746143778.383938:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11774 00000100:00100000:1.0:1746143778.383942:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963626742272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.384005:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626742272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (311us total) trans 17179872981 rc 0/0 00000100:00100000:1.0:1746143778.384009:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11774 00000100:00100000:1.0:1746143778.384017:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11775 00000100:00100000:1.0:1746143778.384021:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963626742784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.384057:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963626742784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 36us (339us total) trans 21474840307 rc 0/0 00000100:00100000:1.0:1746143778.384061:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11775 00000100:00100000:1.0:1746143778.384068:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11776 00000100:00100000:1.0:1746143778.384071:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963626743296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.384104:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626743296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 33us (370us total) trans 17179872982 rc 0/0 00000100:00100000:1.0:1746143778.384111:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11776 00000100:00100000:1.0:1746143778.384118:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11777 00000100:00100000:1.0:1746143778.384121:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963626743808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.384156:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626743808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 34us (392us total) trans 17179872983 rc 0/0 00000100:00100000:1.0:1746143778.384160:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11777 00000100:00100000:1.0:1746143778.384166:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11778 00000100:00100000:1.0:1746143778.384169:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963626742144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.384202:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963626742144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 33us (418us total) trans 21474840308 rc 0/0 00000100:00100000:1.0:1746143778.384206:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11778 00000100:00100000:1.0:1746143778.384212:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11779 00000100:00100000:1.0:1746143778.384216:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963626742656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.384247:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963626742656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 31us (446us total) trans 21474840309 rc 0/0 00000100:00100000:1.0:1746143778.384251:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11779 00000100:00100000:1.0:1746143778.384257:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11780 00000100:00100000:1.0:1746143778.384260:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963626743168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.384291:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963626743168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 30us (475us total) trans 21474840310 rc 0/0 00000100:00080000:2.0:1746143778.384292:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143778.384295:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11780 00000100:00100000:1.0:1746143778.384301:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11781 00000100:00100000:1.0:1746143778.384305:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963626743680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143778.384341:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143778.384343:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143778.384345:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143778.384346:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143778.384348:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746143778.384360:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626743680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (527us total) trans 17179872984 rc 0/0 00000100:00100000:1.0:1746143778.384363:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11781 00000004:00080000:1.0:1746143778.384385:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f8a80/2, rc 0, transno 21474840308 00000100:00100000:1.0:1746143778.384387:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626742144:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143778.384393:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f9180/2, rc 0, transno 21474840309 00000100:00100000:1.0:1746143778.384395:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626742656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143778.384399:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921ce680/2, rc 0, transno 21474840310 00000100:00100000:1.0:1746143778.384401:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626743168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.384406:0:3772:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872969 gen 2 00000004:00080000:1.0:1746143778.384409:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fd8e00, transno 17179872927 00000004:00080000:1.0:1746143778.384412:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fdbb80, transno 17179872928 00000004:00080000:1.0:1746143778.384414:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fd9500, transno 17179872929 00000004:00080000:1.0:1746143778.384416:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fdad80, transno 17179872930 00000004:00080000:1.0:1746143778.384417:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fd9180, transno 17179872931 00000004:00080000:1.0:1746143778.384419:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fd9880, transno 17179872932 00000004:00080000:1.0:1746143778.384421:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fd8380, transno 17179872933 00000004:00080000:1.0:1746143778.384423:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096fd9f80, transno 17179872934 00000004:00080000:1.0:1746143778.384425:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c32a00, transno 17179872935 00000004:00080000:1.0:1746143778.384427:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c30a80, transno 17179872936 00000004:00080000:1.0:1746143778.384429:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c32300, transno 17179872937 00000004:00080000:1.0:1746143778.384431:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c32680, transno 17179872938 00000004:00080000:1.0:1746143778.384433:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c30700, transno 17179872939 00000004:00080000:1.0:1746143778.384434:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c31180, transno 17179872940 00000004:00080000:1.0:1746143778.384436:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c31880, transno 17179872941 00000004:00080000:1.0:1746143778.384438:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c30e00, transno 17179872942 00000004:00080000:1.0:1746143778.384439:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092144700, transno 17179872950 00000004:00080000:1.0:1746143778.384441:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092146a00, transno 17179872951 00000004:00080000:1.0:1746143778.384443:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092147100, transno 17179872952 00000004:00080000:1.0:1746143778.384445:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092144a80, transno 17179872953 00000004:00080000:1.0:1746143778.384447:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092147800, transno 17179872954 00000004:00080000:1.0:1746143778.384449:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457d880, transno 17179872955 00000004:00080000:1.0:1746143778.384450:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092145880, transno 17179872956 00000004:00080000:1.0:1746143778.384452:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092146300, transno 17179872957 00000004:00080000:1.0:1746143778.384454:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1dbb80, transno 17179872962 00000004:00080000:1.0:1746143778.384456:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b44e00, transno 17179872963 00000004:00080000:1.0:1746143778.384458:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b46300, transno 17179872964 00000004:00080000:1.0:1746143778.384459:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef1880, transno 17179872965 00000004:00080000:1.0:1746143778.384461:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b47480, transno 17179872966 00000004:00080000:1.0:1746143778.384463:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d9500, transno 17179872967 00000004:00080000:1.0:1746143778.384464:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d9180, transno 17179872968 00000004:00080000:1.0:1746143778.384466:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef1c00, transno 17179872969 00000100:00100000:1.0:1746143778.384468:0:3772:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009e491c00 x1830963626743680/t17179872984(17179872984) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143794 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746143778.384474:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e491c00/2, rc 0, transno 17179872984 00000100:00100000:1.0:1746143778.384476:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626743680:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143778.384480:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e490e00/2, rc 0, transno 17179872981 00000100:00100000:1.0:1746143778.384482:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626742272:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143778.384486:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911fa300/2, rc 0, transno 21474840307 00000100:00100000:1.0:1746143778.384488:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626742784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143778.384493:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e491180/2, rc 0, transno 17179872982 00000100:00100000:1.0:1746143778.384495:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626743296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143778.384499:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e491f80/2, rc 0, transno 17179872983 00000100:00100000:1.0:1746143778.384500:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626743808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143778.384600:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 32 done 00000100:00100000:0.0:1746143778.384695:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626743424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.384713:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.384732:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626743936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.384741:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.384756:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143778.384759:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626743552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.384769:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.384776:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626744064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143778.384779:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626743424 00000100:00100000:2.0:1746143778.384784:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626743424 00000100:00100000:0.0:1746143778.384784:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.384801:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626743936 00000100:00100000:2.0:1746143778.384803:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626743936 00000100:00100000:0.0:1746143778.384807:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626743552 00000100:00100000:0.0:1746143778.384810:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626743552 00000100:00100000:2.0:1746143778.384816:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626744064 00000100:00100000:2.0:1746143778.384818:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626744064 00000100:00100000:0.0:1746143778.384822:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11782 00000100:00100000:0.0:1746143778.384826:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626743424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143778.384831:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11783 00000100:00100000:2.0:1746143778.384836:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626743936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.384874:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963626743424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (159us total) trans 17179872985 rc 0/0 00000100:00100000:0.0:1746143778.384878:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11782 00000100:00100000:0.0:1746143778.384887:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11784 00000100:00100000:0.0:1746143778.384890:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626743552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143778.384898:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626743936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (155us total) trans 17179872986 rc 0/0 00000100:00100000:2.0:1746143778.384904:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11783 00000100:00100000:2.0:1746143778.384942:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11785 00002000:00010000:0.0:1746143778.384945:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00000100:00100000:2.0:1746143778.384947:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626744064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143778.384947:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143778.384949:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:0.0:1746143778.384951:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143778.384952:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143778.384966:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626743552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (196us total) trans 17179872987 rc 0/0 00000100:00100000:0.0:1746143778.384970:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11784 00000004:00080000:0.0:1746143778.384985:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e491880/2, rc 0, transno 17179872987 00000100:00100000:0.0:1746143778.384987:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626743552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143778.384992:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e491500/2, rc 0, transno 17179872985 00000100:00100000:0.0:1746143778.384994:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626743424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143778.384999:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e492300/2, rc 0, transno 17179872986 00000100:00100000:0.0:1746143778.385001:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626743936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143778.385002:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626744064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (216us total) trans 17179872988 rc 0/0 00000100:00100000:2.0:1746143778.385007:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11785 00000004:00080000:0.0:1746143778.385007:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e492680/2, rc 0, transno 17179872988 00000100:00100000:0.0:1746143778.385009:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626744064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.388468:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.388526:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622524800 00000100:00100000:3.0:1746143778.388533:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622524800 00000100:00100000:3.0:1746143778.388581:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12865 00000100:00100000:3.0:1746143778.388587:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32160:x1830963622524800:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143778.388605:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.388620:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a9096 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af28 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.388663:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a9096 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af28 expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.388674:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a9096 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af28 expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.388687:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.388690:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143778.388692:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087000, rc 0) 00000100:00100000:3.0:1746143778.389642:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32160:x1830963622524800:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1052us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.389650:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12865 00000100:00100000:0.0:1746143778.396813:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.396882:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622524928 00000100:00100000:2.0:1746143778.396890:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622524928 00000100:00100000:2.0:1746143778.397377:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12866 00000100:00100000:2.0:1746143778.397386:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32160:x1830963622524928:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143778.397402:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.397416:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a909d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af2f expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.397484:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a90a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.397495:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a90a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.397504:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a90a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143778.397524:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 16777217 00000004:00200000:2.0:1746143778.397527:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143778.397539:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a90a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.397556:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a909d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af2f expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.398062:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a90a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af2f expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.398070:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.398073:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143778.398075:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55be00, rc 0) 00000100:00100000:2.0:1746143778.398118:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32160:x1830963622524928:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 734us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.398124:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12866 00000100:00100000:1.0:1746143778.402532:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.402571:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.402599:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.402693:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.402693:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622525056 00000100:00100000:0.0:1746143778.402706:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622525056 00000100:00100000:1.0:1746143778.403143:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.403362:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.403470:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622525312 00000100:00100000:0.0:1746143778.403471:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622525568 00000100:00100000:0.0:1746143778.403475:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622525568 00000100:00100000:3.0:1746143778.403478:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622525312 00000100:00100000:0.0:1746143778.403495:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622525184 00000100:00100000:3.0:1746143778.403498:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622525440 00000100:00100000:0.0:1746143778.403498:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622525184 00000100:00100000:3.0:1746143778.403500:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622525440 00000100:00100000:0.0:1746143778.403520:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11786 00000100:00100000:2.0:1746143778.403546:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622525696 00000100:00100000:2.0:1746143778.403551:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622525696 00000100:00100000:3.0:1746143778.403580:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11787 00000100:00100000:0.0:1746143778.403584:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622525056:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:3.0:1746143778.403588:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622525568:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143778.403603:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143778.403603:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.403623:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73a90b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af52 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.403623:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a90ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af36 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143778.403645:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4964768, mtime: 0x68140a22, atime: 0x68140a22, ctime: 0x68140a22, blocks: 0x15f0 00002000:00010000:0.0:1746143778.403645:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a20, atime: 0x68140a20, ctime: 0x68140a20, blocks: 0x7d8 00010000:00010000:3.0:1746143778.403661:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.403662:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.403663:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.403664:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.403671:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73a90b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af52 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.403671:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a90ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af36 expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.403685:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73a90b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af52 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.403685:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a90ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af36 expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.403694:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087c00, rc 0) 00010000:00010000:0.0:1746143778.403695:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:3.0:1746143778.403731:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622525568:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 144us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.403737:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11787 00000100:00100000:0.0:1746143778.403737:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622525056:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 210us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.403744:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11786 00000100:00100000:3.0:1746143778.403753:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11788 00000100:00100000:3.0:1746143778.403758:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622525184:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143778.403759:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11789 00010000:00010000:3.0:1746143778.403764:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143778.403764:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622525440:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143778.403770:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.403773:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a90b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af3d expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.403776:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a90c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af4b expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143778.403784:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a21, atime: 0x68140a20, ctime: 0x68140a21, blocks: 0x808 00002000:00010000:0.0:1746143778.403786:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a21, atime: 0x68140a20, ctime: 0x68140a21, blocks: 0x808 00010000:00010000:3.0:1746143778.403791:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.403792:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.403793:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.403795:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.403796:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a90b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af3d expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.403799:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a90c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af4b expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.403805:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a90b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af3d expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.403808:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a90c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af4b expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.403811:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086c00, rc 0) 00010000:00010000:0.0:1746143778.403815:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55cc00, rc 0) 00000100:00100000:3.0:1746143778.403826:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622525184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 69us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.403830:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622525440:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 66us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.403832:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11788 00000100:00100000:0.0:1746143778.403836:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11789 00000100:00100000:3.0:1746143778.403842:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11790 00000100:00100000:3.0:1746143778.403846:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622525696:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143778.403851:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143778.403995:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11791 00000100:00100000:2.0:1746143778.404001:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622525312:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143778.404008:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.404018:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a90c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af44 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143778.404038:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a20, atime: 0x68140a20, ctime: 0x68140a20, blocks: 0x800 00010000:00010000:2.0:1746143778.404046:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.404047:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.404052:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a90c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af44 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143778.404062:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a90c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af44 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143778.404068:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55aa00, rc 0) 00000100:00100000:2.0:1746143778.404085:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622525312:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 84us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.404090:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11791 00010000:00010000:3.0:1746143778.404478:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a90ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af59 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143778.404492:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a22, atime: 0x68140a22, ctime: 0x68140a22, blocks: 0x1008 00010000:00010000:3.0:1746143778.404503:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.404505:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.404509:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a90ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af59 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.404518:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a90ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af59 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.404525:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087600, rc 0) 00000100:00100000:3.0:1746143778.404544:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622525696:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 697us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.404550:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11790 00000100:00100000:0.0:1746143778.407494:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143778.407509:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626744192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143778.407554:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.407632:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626744192 00000100:00100000:2.0:1746143778.407643:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626744192 00000100:00100000:2.0:1746143778.408334:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1746143778.408344:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626744192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746143778.408372:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1013087424 pending 995328 free 3913007104 avail 3671965696 00000100:00100000:2.0:1746143778.408445:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626744192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.408451:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1746143778.408612:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626744192:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1746143778.408699:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143778.410806:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.410841:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.410862:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.410882:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.410896:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.410946:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622525824 00000100:00100000:0.0:1746143778.410956:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622525824 00000100:00100000:2.0:1746143778.410957:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.410976:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622525952 00000100:00100000:2.0:1746143778.410981:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622525952 00000100:00100000:0.0:1746143778.410989:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622526080 00000100:00100000:0.0:1746143778.410991:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622526080 00000100:00100000:0.0:1746143778.411005:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622526208 00000100:00100000:0.0:1746143778.411007:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622526208 00000100:00100000:2.0:1746143778.411094:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622526336 00000100:00100000:0.0:1746143778.411096:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622526464 00000100:00100000:2.0:1746143778.411097:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622526336 00000100:00100000:0.0:1746143778.411099:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622526464 00000100:00100000:0.0:1746143778.411119:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11792 00000100:00100000:0.0:1746143778.411125:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622525824:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143778.411126:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11793 00000100:00100000:2.0:1746143778.411133:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622526080:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143778.411222:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622526080:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 89us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.411229:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11793 00000100:00100000:2.0:1746143778.411244:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11794 00000100:00100000:2.0:1746143778.411249:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622525952:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143778.411301:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11795 00000100:00100000:3.0:1746143778.411309:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622526208:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143778.411373:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11796 00000100:00100000:1.0:1746143778.411381:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622526464:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143778.411449:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622525824:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 319us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.411455:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11792 00000100:00100000:2.0:1746143778.411464:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622525952:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 214us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.411468:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11797 00000100:00100000:2.0:1746143778.411472:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11794 00000100:00100000:0.0:1746143778.411473:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622526336:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143778.411499:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622526336:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 27us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.411504:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11797 00000100:00100000:3.0:1746143778.411690:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622526208:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 381us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.411696:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11795 00000100:00100000:1.0:1746143778.411751:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622526464:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 370us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.411757:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11796 00000100:00100000:0.0:1746143778.419590:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.419934:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.419967:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.419987:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.420006:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622526592 00000100:00100000:0.0:1746143778.420013:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622526592 00000100:00100000:0.0:1746143778.420046:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622526720 00000100:00100000:0.0:1746143778.420048:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622526720 00000100:00100000:0.0:1746143778.420056:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622526848 00000100:00100000:0.0:1746143778.420058:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622526848 00000100:00100000:0.0:1746143778.420067:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622526976 00000100:00100000:0.0:1746143778.420068:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622526976 00000100:00100000:0.0:1746143778.420078:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11798 00000100:00100000:0.0:1746143778.420083:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622526592:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143778.421044:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11799 00000100:00100000:2.0:1746143778.421062:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622526720:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143778.421641:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622526720:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 585us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.421649:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11799 00000100:00100000:1.0:1746143778.421667:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11800 00000100:00100000:2.0:1746143778.421673:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11801 00000100:00100000:1.0:1746143778.421678:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622526848:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143778.421679:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622526976:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143778.421981:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622526976:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 301us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.421981:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622526592:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 1895us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.421988:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11798 00000100:00100000:2.0:1746143778.421992:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11801 00000100:00100000:0.0:1746143778.422069:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.422089:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622527104 00000100:00100000:0.0:1746143778.422093:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622527104 00000100:00100000:0.0:1746143778.422112:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11802 00000100:00100000:0.0:1746143778.422116:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622527104:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143778.422152:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622527104:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 36us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.422160:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11802 00000100:00100000:0.0:1746143778.422215:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.422225:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622527232 00000100:00100000:0.0:1746143778.422227:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622527232 00000100:00100000:0.0:1746143778.422239:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11803 00000100:00100000:0.0:1746143778.422242:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622527232:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143778.422269:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622527232:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 26us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.422273:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11803 00000100:00100000:1.0:1746143778.422648:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622526848:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 971us (2678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.422654:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11800 00000100:00100000:0.0:1746143778.430109:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.430465:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622527360 00000100:00100000:3.0:1746143778.430473:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622527360 00000100:00100000:3.0:1746143778.431697:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11804 00000100:00100000:3.0:1746143778.431708:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622527360:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:3.0:1746143778.431874:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143778.431878:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143778.431880:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:3.0:1746143778.431882:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143778.431884:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143778.432215:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622527360:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 507us (2113us total) trans 17179872989 rc 0/0 00000100:00100000:3.0:1746143778.432221:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11804 00000100:00100000:0.0:1746143778.435751:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.436096:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622527488 00000100:00100000:1.0:1746143778.436105:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622527488 00000100:00100000:1.0:1746143778.437344:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11805 00000100:00100000:1.0:1746143778.437354:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622527488:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:1.0:1746143778.437587:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143778.437590:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143778.437591:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143778.437593:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143778.437595:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143778.437643:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622527488:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 291us (1900us total) trans 21474840311 rc 0/0 00000100:00100000:1.0:1746143778.437649:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11805 00000100:00100000:0.0:1746143778.444769:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.444813:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.444842:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.444882:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.444976:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622527872 00000100:00100000:3.0:1746143778.444987:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622527872 00000100:00100000:0.0:1746143778.444998:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622528000 00000100:00100000:0.0:1746143778.445005:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622528000 00000100:00100000:3.0:1746143778.445044:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622528384 00000100:00100000:3.0:1746143778.445046:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622528384 00000100:00100000:3.0:1746143778.445063:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622528256 00000100:00100000:3.0:1746143778.445065:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622528256 00000100:00100000:3.0:1746143778.445088:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3407 00000100:00100000:3.0:1746143778.445095:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622527872:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143778.445129:0:29558:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a90d5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.445142:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.445143:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143778.445143:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3408 00010000:00010000:3.0:1746143778.445148:0:29558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a90d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.445160:0:29558:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a90d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143778.447106:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3409 00000100:00100000:1.0:1746143778.447125:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622528256:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143778.447165:0:20385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73a90dc lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.447177:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.447179:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143778.447179:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622528384:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143778.447184:0:20385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73a90dc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.447195:0:20385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73a90dc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.447199:0:29555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a90e3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.447208:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.447209:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.447212:0:29555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a90e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.447257:0:29555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a90e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.447998:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3410 00000100:00100000:1.0:1746143778.448285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.448425:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622528896 00000100:00100000:2.0:1746143778.448434:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622528896 00000100:00100000:3.0:1746143778.448448:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622528000:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143778.448478:0:20387:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a90ea lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.448481:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3411 00010000:00010000:3.0:1746143778.448488:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143778.448488:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622528896:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143778.448490:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.448494:0:20387:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a90ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.448503:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a90f1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.448504:0:20387:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a90ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.448511:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.448513:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.448516:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a90f1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.448524:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a90f1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.455441:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.455483:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.455543:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622529024 00000100:00100000:1.0:1746143778.455553:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622529024 00000100:00100000:1.0:1746143778.455618:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622529280 00000100:00100000:1.0:1746143778.455620:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622529280 00000100:00100000:1.0:1746143778.455641:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3412 00000100:00100000:1.0:1746143778.455648:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2010:x1830963622529024:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143778.455684:0:20386:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e520200/0x87925e4cb73a90f8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.455699:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.455700:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.455706:0:20386:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e520200/0x87925e4cb73a90f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.455721:0:20386:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e520200/0x87925e4cb73a90f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.455801:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3413 00000100:00100000:2.0:1746143778.455819:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622529280:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143778.455861:0:29557:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a000/0x87925e4cb73a90ff lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.455875:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.455877:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.455881:0:29557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a000/0x87925e4cb73a90ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.455894:0:29557:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55a000/0x87925e4cb73a90ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.460319:0:29558:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a90d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.460334:0:29558:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a90d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.460341:0:29558:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a90d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.460346:0:29558:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad34000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143778.460350:0:29558:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a90d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.460355:0:29558:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a90d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.460370:0:29558:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a90d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.460375:0:29558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a90d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.460789:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2010:x1830963622527872:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 15690us (16026us total) trans 0 rc 1024000/1024000 00000100:00100000:3.0:1746143778.460801:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3407 00010000:00010000:1.0:1746143778.464906:0:20385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73a90dc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.464957:0:20385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73a90dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.465033:0:20385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73a90dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.465039:0:20385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408c600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143778.465043:0:20385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73a90dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.465051:0:20385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73a90dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.465067:0:20385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73a90dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.465073:0:20385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73a90dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143778.465714:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622528256:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 18588us (20825us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143778.465724:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3409 00010000:00010000:3.0:1746143778.471827:0:20387:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a90ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.471844:0:20387:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a90ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.471851:0:20387:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a90ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.471857:0:20387:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad35800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143778.471861:0:20387:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a90ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.471868:0:20387:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a90ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.471886:0:20387:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a90ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.471891:0:20387:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad35800/0x87925e4cb73a90ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.472003:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2010:x1830963622528000:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 23557us (27184us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143778.472012:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3410 00010000:00010000:3.0:1746143778.474044:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a90f1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.474058:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a90f1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.474064:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a90f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.474069:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55bc00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143778.474073:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a90f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.474079:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a90f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.474093:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a90f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.474099:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a90f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.474158:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622528896:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 25667us (25871us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143778.474167:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3411 00010000:00010000:2.0:1746143778.480410:0:29555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a90e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.480429:0:29555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a90e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.480438:0:29555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a90e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.480445:0:29555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55dc00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143778.480450:0:29555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a90e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.480458:0:29555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a90e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.480477:0:29555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a90e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.480483:0:29555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73a90e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.480591:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622528384:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 33481us (35745us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143778.480602:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3408 00010000:00010000:1.0:1746143778.481478:0:20386:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e520200/0x87925e4cb73a90f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.481489:0:20386:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e520200/0x87925e4cb73a90f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.481495:0:20386:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e520200/0x87925e4cb73a90f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.481500:0:20386:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e520200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143778.481503:0:20386:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e520200/0x87925e4cb73a90f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.481508:0:20386:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e520200/0x87925e4cb73a90f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.481518:0:20386:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e520200/0x87925e4cb73a90f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.481528:0:20386:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e520200/0x87925e4cb73a90f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143778.481571:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622529024:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 25922us (26139us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143778.481578:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3412 00010000:00010000:2.0:1746143778.488075:0:29557:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a000/0x87925e4cb73a90ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.488095:0:29557:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a000/0x87925e4cb73a90ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.488209:0:29557:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e55a000/0x87925e4cb73a90ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.488217:0:29557:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55a000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143778.488220:0:29557:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55a000/0x87925e4cb73a90ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.488229:0:29557:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55a000/0x87925e4cb73a90ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.488248:0:29557:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e55a000/0x87925e4cb73a90ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.488253:0:29557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a000/0x87925e4cb73a90ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.488348:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622529280:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 32529us (32856us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143778.488359:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3413 00000100:00100000:0.0:1746143778.496728:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.496835:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622529664 00000100:00100000:2.0:1746143778.496847:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622529664 00000100:00100000:3.0:1746143778.496962:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12867 00000100:00100000:3.0:1746143778.496974:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32160:x1830963622529664:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1746143778.497031:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.497059:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a90a4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af2f expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.497093:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.497097:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143778.497148:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.497161:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.497170:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00010000:3.0:1746143778.497278:0:14991:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d840000 reply state ffff88009c506000 transno 8589943622 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.497287:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.497292:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.497295:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746143778.497297:0:14991:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143778.497387:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32160:x1830963622529664:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 413us (668us total) trans 8589943622 rc 0/0 00000100:00100000:3.0:1746143778.497393:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12867 00000100:00100000:0.0:1746143778.503077:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.505018:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622529792 00000100:00100000:1.0:1746143778.505032:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622529792 00000100:00100000:0.0:1746143778.505095:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.505097:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11806 00000100:00100000:1.0:1746143778.505105:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622529792:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:0.0:1746143778.505116:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622529920 00000100:00100000:0.0:1746143778.505120:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622529920 00000100:00100000:0.0:1746143778.505139:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11807 00000100:00100000:0.0:1746143778.505143:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622529920:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143778.505256:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143778.505259:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143777 -> 1746143778 00002000:00010000:0.0:1746143778.505260:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143776 -> 1746143778 00002000:00010000:0.0:1746143778.505262:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143777 -> 1746143778 00002000:00010000:0.0:1746143778.505264:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143778.505318:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622529920:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 173us (226us total) trans 17179872990 rc 0/0 00000100:00100000:0.0:1746143778.505325:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11807 00000100:00100000:0.0:1746143778.505361:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.505375:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622530176 00000100:00100000:3.0:1746143778.505379:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622530176 00000100:00100000:3.0:1746143778.505412:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11808 00000100:00100000:0.0:1746143778.505415:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.505417:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622530176:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:0.0:1746143778.505425:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622530432 00000100:00100000:0.0:1746143778.505428:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622530432 00000100:00100000:0.0:1746143778.505442:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11809 00000100:00100000:0.0:1746143778.505446:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622530432:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:3.0:1746143778.505474:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143778.505477:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143777 -> 1746143778 00002000:00010000:3.0:1746143778.505479:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143776 -> 1746143778 00002000:00010000:3.0:1746143778.505481:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143777 -> 1746143778 00002000:00010000:0.0:1746143778.505482:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143778.505483:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746143778.505484:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.505485:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.505487:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.505489:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00002000:00010000:1.0:1746143778.505747:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143778.505750:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143776 -> 1746143778 00002000:00010000:1.0:1746143778.505752:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143776 -> 1746143778 00002000:00010000:1.0:1746143778.505754:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143776 -> 1746143778 00002000:00010000:1.0:1746143778.505757:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:3.0:1746143778.505797:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622530176:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 378us (433us total) trans 21474840312 rc 0/0 00000100:00100000:3.0:1746143778.505803:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11808 00000100:00100000:0.0:1746143778.505904:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622530432:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 457us (487us total) trans 17179872991 rc 0/0 00000100:00100000:3.0:1746143778.505906:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.505933:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11809 00000100:00100000:1.0:1746143778.505935:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622529792:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 806us (2844us total) trans 21474840313 rc 0/0 00000100:00100000:1.0:1746143778.505942:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11806 00000100:00100000:0.0:1746143778.505943:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622530048 00000100:00100000:0.0:1746143778.505945:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622530048 00000100:00100000:1.0:1746143778.505955:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11810 00000100:00100000:1.0:1746143778.505961:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622530048:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:3.0:1746143778.505974:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.505984:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622530304 00000100:00100000:0.0:1746143778.505986:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622530304 00000100:00100000:0.0:1746143778.506004:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11811 00002000:00010000:1.0:1746143778.506005:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143778.506008:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143776 -> 1746143778 00000100:00100000:0.0:1746143778.506008:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622530304:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:1.0:1746143778.506010:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143776 -> 1746143778 00002000:00010000:1.0:1746143778.506012:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143776 -> 1746143778 00002000:00010000:1.0:1746143778.506014:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746143778.506030:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622530048:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 69us (123us total) trans 17179872992 rc 0/0 00000100:00100000:1.0:1746143778.506035:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11810 00002000:00010000:0.0:1746143778.506055:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:0.0:1746143778.506057:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.506059:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.506061:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.506063:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00000100:00100000:0.0:1746143778.506079:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622530304:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 70us (104us total) trans 21474840314 rc 0/0 00000100:00100000:0.0:1746143778.506084:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11811 00000100:00100000:0.0:1746143778.507499:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.507748:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622530688 00000100:00100000:1.0:1746143778.507754:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622530688 00000100:00100000:1.0:1746143778.507792:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4713 00000100:00100000:1.0:1746143778.507798:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e249450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32160:x1830963622530688:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:1.0:1746143778.507849:0:24157:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x34a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087200/0x87925e4cb73a9057 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af21 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.507894:0:24157:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24157 initiator: MDT0 00010000:00010000:1.0:1746143778.507937:0:24157:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a9096 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af28 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.507944:0:24157:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24157 initiator: MDT0 00010000:00010000:1.0:1746143778.507977:0:24157:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a9096 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af28 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.507989:0:24157:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a9096 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af28 expref: 10 pid: 14991 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.508001:0:24157:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24157:1830963626744320:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.508352:0:24157:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143778.510344:0:24157:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24157:1830963626744320:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143778.510370:0:24157:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24157 initiator: MDT0 00000100:00100000:0.0:1746143778.512410:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.512619:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622530816 00000100:00100000:2.0:1746143778.512628:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622530816 00010000:00010000:2.0:1746143778.512674:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a9096 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af28 expref: 11 pid: 14991 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.512704:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5575 00000100:00100000:2.0:1746143778.512712:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622530816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.512726:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.512732:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a9096 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af28 expref: 11 pid: 14991 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.512744:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a9096 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af28 expref: 11 pid: 14991 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.512766:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a9096 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af28 expref: 11 pid: 14991 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.512800:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.512804:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143778.512813:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143778.512819:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143778.512839:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.512897:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622530816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 185us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.512903:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5575 00010000:00010000:1.0:1746143778.513578:0:24157:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24157 initiator: MDT0 00010000:00010000:1.0:1746143778.513588:0:24157:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24157 initiator: MDT0 00000040:00080000:1.0:1746143778.513894:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2644, 88 off220384 00000004:00080000:1.0:1746143778.513901:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837737988110ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143778.514038:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2609, 88 off217656 00000004:00080000:1.0:1746143778.514043:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837738130893ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143778.514057:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2610, 88 off217744 00000004:00080000:1.0:1746143778.514060:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837738147636ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143778.514069:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2645, 88 off220472 00000004:00080000:1.0:1746143778.514072:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837738159551ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143778.514079:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2646, 88 off220560 00000004:00080000:1.0:1746143778.514081:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837738169320ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143778.514089:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2611, 88 off217832 00000004:00080000:1.0:1746143778.514091:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837738179263ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143778.514099:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2612, 88 off217920 00000004:00080000:1.0:1746143778.514101:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837738189021ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143778.514109:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2613, 88 off218008 00000004:00080000:1.0:1746143778.514111:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837738199175ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143778.514119:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2647, 88 off220648 00000004:00080000:1.0:1746143778.514122:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837738209301ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143778.514131:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2614, 88 off218096 00000004:00080000:1.0:1746143778.514133:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837738221148ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143778.514141:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2648, 88 off220736 00000004:00080000:1.0:1746143778.514143:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837738231116ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143778.514150:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2615, 88 off218184 00000004:00080000:1.0:1746143778.514152:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837738239838ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143778.514159:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2649, 88 off220824 00000004:00080000:1.0:1746143778.514161:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837738249126ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143778.514171:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2650, 88 off220912 00000004:00080000:1.0:1746143778.514199:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837738286866ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143778.514220:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2651, 88 off221000 00000004:00080000:1.0:1746143778.514223:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837738310970ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143778.514232:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2652, 88 off221088 00000004:00080000:1.0:1746143778.514234:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837738321883ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143778.514478:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2616, 88 off218272 00000004:00080000:1.0:1746143778.514483:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837738570525ns, next at 770855090093ns, rc = 0 00000001:00080000:2.0:1746143778.517326:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943623 is committed 00000004:00080000:2.0:1746143778.517338:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1846 committed 00000004:00080000:2.0:1746143778.517346:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1880 committed 00000004:00080000:2.0:1746143778.517351:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1879 committed 00000004:00080000:2.0:1746143778.517353:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1878 committed 00000004:00080000:2.0:1746143778.517355:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1877 committed 00000004:00080000:2.0:1746143778.517356:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1845 committed 00000004:00080000:2.0:1746143778.517358:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1876 committed 00000004:00080000:2.0:1746143778.517360:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1844 committed 00000004:00080000:2.0:1746143778.517362:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1875 committed 00000004:00080000:2.0:1746143778.517363:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1843 committed 00000004:00080000:2.0:1746143778.517365:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1842 committed 00000004:00080000:2.0:1746143778.517366:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1841 committed 00000004:00080000:2.0:1746143778.517368:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1874 committed 00000004:00080000:2.0:1746143778.517370:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1873 committed 00000004:00080000:2.0:1746143778.517371:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1840 committed 00000004:00080000:2.0:1746143778.517373:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1839 committed 00000004:00080000:2.0:1746143778.517374:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1872 committed 00010000:00010000:3.0:1746143778.517444:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.517457:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.517465:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.517471:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082087400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143778.517475:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.517482:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.517499:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.517502:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143778.517506:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143778.517511:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73a9106 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00000004:00010000:1.0:1746143778.517854:0:24157:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e249450 reply state ffff880082e94000 transno 8589943623 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24157 initiator: MDT0 00010000:00010000:1.0:1746143778.517868:0:24157:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24157 initiator: MDT0 00010000:00010000:1.0:1746143778.517873:0:24157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143778.517875:0:24157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746143778.517879:0:24157:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746143778.517884:0:24157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143778.517885:0:24157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143778.517892:0:24157:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087200/0x87925e4cb73a9057 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af21 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.517989:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626744576:0@lo:2:osp-syn-1-0.0 00010000:00080000:1.0:1746143778.518018:0:24157:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746143778.518030:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e249450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32160:x1830963622530688:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 10231us (10533us total) trans 8589943623 rc 0/0 00000100:00100000:1.0:1746143778.518039:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4713 00000100:00100000:0.0:1746143778.518047:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.518086:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626745088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.518097:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626744448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.518104:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.518119:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.518122:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143778.518128:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626744704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.518136:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626744960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.518142:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.518151:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.518155:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626745216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.518165:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143778.518169:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626744832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.518170:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.518183:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.518195:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626745344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.518198:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626744576 00000100:00100000:1.0:1746143778.518206:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.518206:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626744576 00000100:00100000:0.0:1746143778.518232:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626745088 00000100:00100000:1.0:1746143778.518234:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626744448 00000100:00100000:0.0:1746143778.518234:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626745088 00000100:00100000:1.0:1746143778.518237:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626744448 00000100:00100000:0.0:1746143778.518243:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626744704 00000100:00100000:0.0:1746143778.518245:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626744704 00000100:00100000:1.0:1746143778.518252:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626744960 00000100:00100000:1.0:1746143778.518254:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626744960 00000100:00100000:0.0:1746143778.518255:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626745216 00000100:00100000:0.0:1746143778.518257:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626745216 00000100:00100000:1.0:1746143778.518261:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626744832 00000100:00100000:1.0:1746143778.518263:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626744832 00000100:00100000:0.0:1746143778.518264:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626745344 00000100:00100000:0.0:1746143778.518266:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626745344 00000100:00100000:1.0:1746143778.518273:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11812 00000100:00100000:0.0:1746143778.518277:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11813 00000100:00100000:1.0:1746143778.518279:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3773:x1830963626744576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.518282:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3773:x1830963626745088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.518298:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11814 00000100:00100000:0.0:1746143778.518302:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3772:x1830963626744448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.518392:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11815 00000100:00100000:0.0:1746143778.518397:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963626744704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143778.518410:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143778.518413:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:1.0:1746143778.518415:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:1.0:1746143778.518417:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:1.0:1746143778.518419:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746143778.518442:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963626744576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (396us total) trans 17179872994 rc 0/0 00002000:00010000:0.0:1746143778.518447:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143778.518450:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00000100:00100000:1.0:1746143778.518451:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11812 00002000:00010000:0.0:1746143778.518451:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.518454:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.518456:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143778.518462:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11816 00000100:00100000:1.0:1746143778.518467:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3772:x1830963626744960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143778.518507:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143778.518509:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143778.518511:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143778.518512:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143778.518514:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746143778.518531:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626744960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (380us total) trans 17179872996 rc 0/0 00000100:00100000:1.0:1746143778.518536:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11816 00000100:00100000:1.0:1746143778.518543:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11817 00000100:00100000:1.0:1746143778.518547:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963626745216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.518592:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963626745216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (421us total) trans 17179872997 rc 0/0 00000100:00100000:1.0:1746143778.518596:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11817 00000100:00100000:1.0:1746143778.518603:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11818 00000100:00100000:1.0:1746143778.518607:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3772:x1830963626744832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143778.518635:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143778.518638:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143778.518639:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:1.0:1746143778.518641:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143778.518643:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143778.518655:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626744832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (471us total) trans 17179872998 rc 0/0 00000100:00100000:1.0:1746143778.518660:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11818 00000100:00100000:1.0:1746143778.518666:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11819 00000100:00100000:1.0:1746143778.518670:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3772:x1830963626745344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.518712:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626745344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (505us total) trans 17179872999 rc 0/0 00000100:00100000:1.0:1746143778.518717:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11819 00000100:00100000:1.0:1746143778.518773:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963626745088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 491us (668us total) trans 17179873000 rc 0/0 00000100:00100000:1.0:1746143778.518778:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11813 00002000:00010000:1.0:1746143778.518797:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143778.518799:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:1.0:1746143778.518801:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:1.0:1746143778.518803:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:1.0:1746143778.518804:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143778.518816:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3772:x1830963626744448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 513us (697us total) trans 17179872993 rc 0/0 00000100:00100000:1.0:1746143778.518819:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11814 00000004:00080000:1.0:1746143778.518846:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b23800/2, rc 0, transno 17179872998 00000100:00100000:1.0:1746143778.518850:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626744832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143778.518857:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b20380/2, rc 0, transno 17179872999 00000100:00100000:1.0:1746143778.518860:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626745344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143778.518864:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d840380/2, rc 0, transno 17179872993 00000100:00100000:1.0:1746143778.518867:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626744448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143778.518872:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b21f80/2, rc 0, transno 17179872996 00000100:00100000:1.0:1746143778.518875:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626744960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.519652:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963626744704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1251us (1506us total) trans 17179872995 rc 0/0 00000100:00100000:0.0:1746143778.519659:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11815 00000004:00080000:0.0:1746143778.519690:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7ab100/2, rc 0, transno 17179872995 00000100:00100000:0.0:1746143778.519694:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626744704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143778.519702:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b21500/2, rc 0, transno 17179872997 00000100:00100000:0.0:1746143778.519704:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626745216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143778.519711:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d843100/2, rc 0, transno 17179872994 00000100:00100000:0.0:1746143778.519713:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626744576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143778.519719:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b22a00/2, rc 0, transno 17179873000 00000100:00100000:0.0:1746143778.519721:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626745088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143778.519830:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626745728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.519861:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143778.519873:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24157 initiator: MDT0 00000100:00100000:0.0:1746143778.519878:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626746240:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143778.519883:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24157 initiator: MDT0 00010000:00010000:3.0:1746143778.519889:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24157 initiator: MDT0 00000100:00100000:0.0:1746143778.519892:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143778.519894:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8b800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143778.519897:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24157 initiator: MDT0 00000100:00100000:0.0:1746143778.519902:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:3.0:1746143778.519903:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24157 initiator: MDT0 00000100:00100000:0.0:1746143778.519906:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626745600:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143778.519939:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.519942:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143778.519945:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24157 initiator: MDT0 00000100:00100000:0.0:1746143778.519945:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143778.519950:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73a910d lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24157 initiator: MDT0 00000100:00100000:0.0:1746143778.519956:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626746112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.519969:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626745728 00000100:00100000:0.0:1746143778.519970:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143778.519974:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626745728 00000100:00100000:0.0:1746143778.519986:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626746240 00000100:00100000:0.0:1746143778.519989:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626746240 00000100:00100000:3.0:1746143778.519995:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626745600 00000100:00100000:3.0:1746143778.519997:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626745600 00000100:00100000:0.0:1746143778.520000:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626746112 00000100:00100000:0.0:1746143778.520002:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626746112 00000100:00100000:3.0:1746143778.520006:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11820 00000100:00100000:3.0:1746143778.520011:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3774:x1830963626745728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.520012:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11821 00000100:00100000:0.0:1746143778.520016:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3774:x1830963626746240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143778.520090:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:3.0:1746143778.520092:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.520094:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.520094:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143778.520096:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.520096:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143778.520099:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00002000:00010000:0.0:1746143778.520099:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143778.520100:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143778.520102:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143778.520124:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3774:x1830963626745728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (264us total) trans 21474840315 rc 0/0 00000100:00100000:0.0:1746143778.520125:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3774:x1830963626746240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (232us total) trans 21474840316 rc 0/0 00000100:00100000:3.0:1746143778.520129:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11820 00000100:00100000:0.0:1746143778.520132:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11821 00000100:00100000:3.0:1746143778.520140:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11822 00000100:00100000:0.0:1746143778.520143:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11823 00000100:00100000:3.0:1746143778.520144:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3774:x1830963626745600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.520148:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3774:x1830963626746112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143778.520176:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143778.520179:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.520180:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.520182:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.520184:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143778.520198:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3774:x1830963626745600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (253us total) trans 21474840317 rc 0/0 00000100:00100000:3.0:1746143778.520202:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11822 00000100:00100000:0.0:1746143778.520202:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3774:x1830963626746112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (231us total) trans 21474840318 rc 0/0 00000100:00100000:0.0:1746143778.520207:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11823 00000004:00080000:0.0:1746143778.520227:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093415880/2, rc 0, transno 21474840317 00000100:00100000:0.0:1746143778.520233:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626745600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.520239:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f8000/2, rc 0, transno 21474840318 00000100:00100000:0.0:1746143778.520241:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626746112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.520246:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093415f80/2, rc 0, transno 21474840315 00000100:00100000:0.0:1746143778.520249:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626745728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.520253:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f8700/2, rc 0, transno 21474840316 00000100:00100000:0.0:1746143778.520255:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626746240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.522175:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626745856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.522227:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.523494:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626746368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.523526:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.524338:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1746143778.524346:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626745472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.524368:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.524477:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626745856 00000100:00100000:2.0:1746143778.524485:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626745856 00000100:00100000:2.0:1746143778.524526:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626746368 00000100:00100000:2.0:1746143778.524527:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626746368 00000100:00100000:2.0:1746143778.524540:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11824 00000100:00100000:2.0:1746143778.524546:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3771:x1830963626745856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143778.524690:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626745856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (2463us total) trans 21474840319 rc 0/0 00000100:00100000:2.0:1746143778.524696:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11824 00000100:00100000:0.0:1746143778.524774:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11825 00000100:00100000:0.0:1746143778.524784:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3771:x1830963626746368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.524861:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626746368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1334us total) trans 21474840320 rc 0/0 00000100:00100000:0.0:1746143778.524867:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11825 00000100:00100000:1.0:1746143778.524874:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626745984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.524880:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626745472 00000100:00100000:0.0:1746143778.524883:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626745472 00000100:00100000:1.0:1746143778.524889:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143778.524898:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626746496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.524899:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626745984 00000100:00100000:0.0:1746143778.524901:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626745984 00000100:00100000:1.0:1746143778.524907:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143778.524937:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626746496 00000100:00100000:0.0:1746143778.524940:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626746496 00000100:00100000:0.0:1746143778.524953:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11826 00000004:00080000:1.0:1746143778.524955:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f8e00/2, rc 0, transno 21474840319 00000100:00100000:0.0:1746143778.524958:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3771:x1830963626745472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.524960:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626745856:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143778.524966:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f8380/2, rc 0, transno 21474840320 00000100:00100000:1.0:1746143778.524968:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626746368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.524989:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11827 00000100:00100000:1.0:1746143778.524995:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626745984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143778.525005:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143778.525008:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.525010:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.525012:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:0.0:1746143778.525013:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:0.0:1746143778.525034:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626745472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (665us total) trans 21474840321 rc 0/0 00000100:00100000:0.0:1746143778.525039:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11826 00000100:00100000:0.0:1746143778.525048:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11828 00000100:00100000:0.0:1746143778.525052:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626746496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.525073:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626745984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (181us total) trans 21474840322 rc 0/0 00000100:00100000:1.0:1746143778.525078:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11827 00000004:00080000:1.0:1746143778.525096:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093416300/2, rc 0, transno 21474840321 00000100:00100000:1.0:1746143778.525100:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626745472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.525100:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626746496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (191us total) trans 21474840323 rc 0/0 00000004:00080000:1.0:1746143778.525105:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911fad80/2, rc 0, transno 21474840322 00000100:00100000:0.0:1746143778.525105:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11828 00000100:00100000:1.0:1746143778.525108:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626745984:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143778.525114:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdc700/2, rc 0, transno 21474840323 00000100:00100000:1.0:1746143778.525116:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626746496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143778.527354:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.528316:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622530944 00000100:00100000:3.0:1746143778.528326:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622530944 00000100:00100000:3.0:1746143778.528384:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12868 00000100:00100000:3.0:1746143778.528392:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:32160:x1830963622530944:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143778.528416:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.528437:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73a9114 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af60 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.528498:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73a9114 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af60 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.528516:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73a9114 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af60 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.528535:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.528538:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143778.528542:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25000, rc 0) 00000100:00100000:3.0:1746143778.528590:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32160:x1830963622530944:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 199us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.528595:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12868 00000100:00100000:0.0:1746143778.533507:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.533998:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622531200 00000100:00100000:1.0:1746143778.534010:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622531200 00000100:00100000:1.0:1746143778.534622:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4714 00000100:00100000:1.0:1746143778.534632:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32160:x1830963622531200:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143778.534858:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32160:x1830963622531200:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 228us (1363us total) trans 8589943624 rc 0/0 00000100:00100000:1.0:1746143778.534864:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4714 00000100:00100000:0.0:1746143778.561458:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.561692:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622531456 00000100:00100000:2.0:1746143778.561703:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622531456 00000100:00100000:2.0:1746143778.562891:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12869 00000100:00100000:2.0:1746143778.562905:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+260:32170:x1830963622531456:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143778.562955:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.562977:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a800/0x87925e4cb73a911b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af67 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.563025:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.563061:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622531712 00000100:00100000:2.0:1746143778.563065:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622531712 00000100:00100000:2.0:1746143778.563089:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12870 00000100:00100000:2.0:1746143778.563093:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:32171:x1830963622531712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143778.563101:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.563105:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73a9122 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af6e expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.563129:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563141:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563151:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563165:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73a9130 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563169:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73a9130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563174:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73a9130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563278:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563285:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563292:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143778.563300:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143778.563379:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563385:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563390:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563396:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563401:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012323ac00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143778.563405:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563410:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563421:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143778.563424:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143778.563427:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563432:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73a9129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563465:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73a9130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563474:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73a9130 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563479:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73a9130 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563483:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012323a600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143778.563485:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73a9130 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563489:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73a9130 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563495:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880082e65500) 00010000:00010000:2.0:1746143778.563497:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143778.563499:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73a9130 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563503:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73a9130 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.563539:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73a9122 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af6e expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.563549:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af6e expref: 9 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.563555:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.563557:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143778.563559:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad34000, rc 0) 00000100:00100000:2.0:1746143778.563617:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32171:x1830963622531712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 523us (593us total) trans 8589943625 rc 0/0 00000100:00100000:2.0:1746143778.563625:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12870 00010000:00010000:2.0:1746143778.563648:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563655:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563661:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563671:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a914c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563676:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a914c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563681:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a914c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563716:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563722:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563727:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143778.563733:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143778.563762:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563767:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563775:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563779:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563783:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012323b200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143778.563785:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563790:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563797:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143778.563799:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143778.563801:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563805:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73a9145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563812:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a914c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563816:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a914c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563820:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a914c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563824:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096f6d600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143778.563827:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a914c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563834:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a914c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563839:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880082e65400) 00010000:00010000:2.0:1746143778.563841:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143778.563842:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a914c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563847:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a914c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.563868:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a800/0x87925e4cb73a911b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af67 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.563877:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af67 expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.563882:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.563884:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143778.563885:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5aa400, rc 0) 00000100:00100000:2.0:1746143778.563902:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32170:x1830963622531456:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1002us (2457us total) trans 8589943626 rc 0/0 00000100:00100000:2.0:1746143778.563908:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12869 00000100:00100000:0.0:1746143778.568193:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.568239:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.568243:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622531840 00000100:00100000:3.0:1746143778.568254:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622531840 00000100:00100000:3.0:1746143778.568293:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11829 00000100:00100000:3.0:1746143778.568300:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32171:x1830963622531840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.568319:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.568338:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a9161 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af75 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.568365:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.568367:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.568376:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a9161 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af75 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.568392:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a9161 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af75 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.568402:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24c00, rc 0) 00000100:00100000:2.0:1746143778.568709:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622532096 00000100:00100000:2.0:1746143778.568713:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622532096 00000100:00100000:2.0:1746143778.568748:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12871 00000100:00100000:2.0:1746143778.568753:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+262:32173:x1830963622532096:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143778.568766:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.568779:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9168 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af7c expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.568868:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73a916f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.568878:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73a916f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.568886:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73a916f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143778.568895:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000100:00100000:3.0:1746143778.568943:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32171:x1830963622531840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 642us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.568949:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11829 00010000:00010000:2.0:1746143778.569029:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9168 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af7c expref: 265 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.569041:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73a916f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af7c expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.569048:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.569050:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143778.569053:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0200, rc 0) 00000100:00100000:2.0:1746143778.569437:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:32173:x1830963622532096:12345-192.168.202.3@tcp:101:cat.0 Request processed in 682us (1196us total) trans 8589943627 rc 0/0 00000100:00100000:2.0:1746143778.569442:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12871 00000100:00100000:0.0:1746143778.571784:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.572766:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.572985:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622532224 00000100:00100000:3.0:1746143778.572996:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622532224 00000100:00100000:3.0:1746143778.573040:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11830 00000100:00100000:3.0:1746143778.573047:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:32173:x1830963622532224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.573067:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.573085:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a917d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af83 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.573112:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.573114:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.573121:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a917d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af83 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.573137:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a917d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af83 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.573147:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25a00, rc 0) 00000100:00100000:2.0:1746143778.573290:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622532480 00000100:00100000:2.0:1746143778.573294:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622532480 00002000:00100000:2.0:1746143778.573324:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88009e490000 x1830963622532480/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.573334:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490000 with x1830963622532480 ext(0->1048575) 00002000:00010000:2.0:1746143778.573339:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490000 00000100:00100000:3.0:1746143778.573690:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+23:32173:x1830963622532224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 642us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.573697:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11830 00000100:00100000:2.0:1746143778.573888:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3414 00000100:00100000:2.0:1746143778.573895:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622532480:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143778.584105:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.584177:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622532992 00000100:00100000:3.0:1746143778.584188:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622532992 00000100:00100000:3.0:1746143778.585713:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12872 00000100:00100000:3.0:1746143778.585729:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32172:x1830963622532992:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143778.585761:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.585860:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a9184 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af8a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.585997:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.586012:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af6e expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.586020:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af67 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.586027:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.586059:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af67 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.586072:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af67 expref: 263 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.586083:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626746624:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.586176:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af6e expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.586183:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af6e expref: 10 pid: 10936 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.586195:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626746752:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.586213:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143778.586706:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622532480:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12809us (13939us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143778.586716:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3414 00000100:00100000:1.0:1746143778.586868:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.586886:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622532736 00000100:00100000:1.0:1746143778.586892:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622532736 00002000:00100000:1.0:1746143778.586943:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880095c32680 x1830963622532736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.586952:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32680 with x1830963622532736 ext(0->1048575) 00002000:00010000:1.0:1746143778.586956:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c32680 00000100:00100000:1.0:1746143778.588068:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3415 00000100:00100000:1.0:1746143778.588077:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622532736:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143778.594034:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88009e490000 x1830963622532480/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.594050:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490000 with x1830963622532480 ext(0->1048575) 00002000:00010000:2.0:1746143778.594058:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490000 00000100:00100000:0.0:1746143778.595105:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.595234:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626746624:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.595246:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626746752:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.595271:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143778.595345:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.597095:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622533248 00000100:00100000:2.0:1746143778.597105:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622533248 00010000:00010000:2.0:1746143778.597147:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af6e expref: 11 pid: 10936 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.597180:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622533120 00000100:00100000:2.0:1746143778.597183:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622533120 00010000:00010000:2.0:1746143778.597194:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af67 expref: 264 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.597214:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5576 00000100:00100000:2.0:1746143778.597221:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622533248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.597236:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.597242:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af6e expref: 11 pid: 10936 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.597252:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af6e expref: 11 pid: 10936 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.597274:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73a9137 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af6e expref: 11 pid: 10936 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.597320:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5577 00000100:00100000:3.0:1746143778.597327:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:2010:x1830963622533120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.597333:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.597337:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af67 expref: 264 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.597345:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af67 expref: 264 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.597357:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9153 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af67 expref: 264 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.597367:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.597371:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.597381:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.597392:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.597412:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143778.597622:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.597625:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.597662:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2010:x1830963622533120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 334us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.597668:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5577 00010000:00010000:3.0:1746143778.597694:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.597701:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143778.597721:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143778.597848:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a9184 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af8a expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.597863:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af8a expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.597868:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.597871:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143778.597873:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25200, rc 0) 00000100:00100000:2.0:1746143778.597968:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622533248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 745us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.597973:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5576 00000100:00100000:3.0:1746143778.598032:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32172:x1830963622532992:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 12308us (13939us total) trans 8589943628 rc 0/0 00000100:00100000:3.0:1746143778.598038:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12872 00000100:00100000:1.0:1746143778.599443:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.599510:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622533376 00000100:00100000:3.0:1746143778.599516:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622533376 00000100:00100000:3.0:1746143778.599556:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11831 00000100:00100000:3.0:1746143778.599564:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32171:x1830963622533376:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.599579:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.599594:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a9199 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af91 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.599616:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.599618:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.599626:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a9199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af91 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.599638:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a9199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af91 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.599646:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087000, rc 0) 00000100:00100000:3.0:1746143778.599673:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32171:x1830963622533376:12345-192.168.202.3@tcp:101:cat.0 Request processed in 110us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.599679:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11831 00000100:00100000:1.0:1746143778.606753:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622532736:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18663us (19872us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143778.606767:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3415 00002000:00100000:1.0:1746143778.606779:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880095c32680 x1830963622532736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143778.606796:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32680 with x1830963622532736 ext(0->1048575) 00002000:00010000:1.0:1746143778.606802:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c32680 00000100:00100000:1.0:1746143778.613256:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.613317:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.615429:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622533504 00000100:00100000:3.0:1746143778.615444:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622533504 00000100:00100000:3.0:1746143778.615498:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622533760 00000100:00100000:3.0:1746143778.615502:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622533760 00000100:00100000:3.0:1746143778.615528:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12873 00000100:00100000:3.0:1746143778.615538:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32171:x1830963622533504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.615570:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.615592:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a91a0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af98 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.615659:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a91a0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af98 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.615675:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a91a0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af98 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.615693:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.615696:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143778.615699:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25800, rc 0) 00000100:00100000:3.0:1746143778.615751:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32171:x1830963622533504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 216us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.615757:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12873 00000100:00100000:3.0:1746143778.615772:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12874 00000100:00100000:3.0:1746143778.615776:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:32170:x1830963622533760:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143778.615785:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.615787:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143778.615801:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73a916f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af7c expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.616327:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.616331:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143778.616338:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73a91a7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840af9f expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.616374:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.616385:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73a9114 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af60 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.616395:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a91a0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af98 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.616401:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 5/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.616435:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a91a0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af98 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.616446:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a91a0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af98 expref: 10 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.616458:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626746880:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.616522:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73a9114 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af60 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.616529:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73a9114 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af60 expref: 7 pid: 14991 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.616536:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626747008:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.616550:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.625449:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.625514:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.625613:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622533888 00000100:00100000:2.0:1746143778.625623:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622533888 00000100:00100000:2.0:1746143778.625690:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11832 00000100:00100000:2.0:1746143778.625704:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:32173:x1830963622533888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143778.625725:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.625746:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73a91b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afa6 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.625772:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.625774:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.625782:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73a91b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afa6 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.625796:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73a91b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afa6 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.625807:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1a00, rc 0) 00000100:00100000:2.0:1746143778.625860:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:32173:x1830963622533888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 158us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.625868:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11832 00000100:00100000:2.0:1746143778.625906:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622534144 00000100:00100000:2.0:1746143778.625955:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622534144 00002000:00100000:2.0:1746143778.625984:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b7e0380 x1830963622534144/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.625992:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e0380 with x1830963622534144 ext(1048576->2097151) 00002000:00010000:2.0:1746143778.625997:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e0380 00000100:00100000:2.0:1746143778.626010:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3416 00000100:00100000:2.0:1746143778.626015:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622534144:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143778.626406:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.626440:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.626526:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622534400 00000100:00100000:3.0:1746143778.626530:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622534400 00010000:00010000:3.0:1746143778.626549:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73a9114 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af60 expref: 8 pid: 14991 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.626566:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622534272 00000100:00100000:3.0:1746143778.626568:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622534272 00010000:00010000:3.0:1746143778.626577:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a91a0 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af98 expref: 11 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.626589:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5578 00000100:00100000:3.0:1746143778.626594:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622534400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.626604:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.626609:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73a9114 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af60 expref: 8 pid: 14991 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.626618:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73a9114 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af60 expref: 8 pid: 14991 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.626638:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.626643:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.626649:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.626654:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.626676:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622534400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 83us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.626682:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5578 00000100:00100000:3.0:1746143778.626693:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5579 00000100:00100000:3.0:1746143778.626697:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622534272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.626703:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143778.626706:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a91a0 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af98 expref: 11 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.626714:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a91a0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af98 expref: 11 pid: 6587 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.626724:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.626726:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.626732:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.626738:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.626752:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.626763:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622534272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 65us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.626768:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5579 00010000:00010000:3.0:1746143778.626807:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73a91a0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af98 expref: 10 pid: 6587 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.626831:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626746880:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.626841:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73a9114 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af60 expref: 7 pid: 14991 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.626850:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626747008:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.626868:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.626879:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143778.626884:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:02000000:3.0:1746143778.626963:0:6587:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:3.0:1746143778.632567:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2654, 88 off221272 00000004:00080000:3.0:1746143778.632577:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837856664065ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.632614:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2617, 88 off218360 00000004:00080000:3.0:1746143778.632617:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837856704447ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.632640:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2618, 88 off218448 00000004:00080000:3.0:1746143778.632642:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837856730164ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.632650:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2655, 88 off221360 00000004:00080000:3.0:1746143778.632652:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837856740294ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.632658:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2656, 88 off221448 00000004:00080000:3.0:1746143778.632660:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837856748022ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.632666:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2619, 88 off218536 00000004:00080000:3.0:1746143778.632668:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837856755924ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.632674:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2620, 88 off218624 00000004:00080000:3.0:1746143778.632676:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837856763752ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.632682:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2621, 88 off218712 00000004:00080000:3.0:1746143778.632684:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837856771993ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.632691:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2657, 88 off221536 00000004:00080000:3.0:1746143778.632693:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837856781300ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.632701:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2622, 88 off218800 00000004:00080000:3.0:1746143778.632703:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837856790645ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.632710:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2658, 88 off221624 00000004:00080000:3.0:1746143778.632712:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837856799570ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.632718:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2623, 88 off218888 00000004:00080000:3.0:1746143778.632720:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837856807907ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143778.632726:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2659, 88 off221712 00000004:00080000:3.0:1746143778.632728:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837856815815ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.632734:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2660, 88 off221800 00000004:00080000:3.0:1746143778.632736:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837856823850ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.632742:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2661, 88 off221888 00000004:00080000:3.0:1746143778.632744:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837856831805ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.632750:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2662, 88 off221976 00000004:00080000:3.0:1746143778.632752:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837856840107ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143778.632758:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2624, 88 off218976 00000004:00080000:3.0:1746143778.632760:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837856848280ns, next at 770855090093ns, rc = 0 00000100:00100000:1.0:1746143778.634377:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.634875:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622534528 00000100:00100000:2.0:1746143778.634886:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622534528 00000100:00100000:2.0:1746143778.634960:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12875 00000100:00100000:2.0:1746143778.634968:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+265:32173:x1830963622534528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143778.634991:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.635009:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afad expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.636827:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.636843:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 266 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.636863:0:14991:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143778.636879:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 266 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.636894:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.636897:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143778.636900:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 266 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.636907:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76a00, rc 0) 00000100:00100000:2.0:1746143778.636989:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+266:32173:x1830963622534528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2021us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.636996:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12875 00000100:00100000:3.0:1746143778.638483:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622534144:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12457us (12958us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143778.638494:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3416 00002000:00100000:3.0:1746143778.638506:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b7e0380 x1830963622534144/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.638516:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e0380 with x1830963622534144 ext(1048576->2097151) 00002000:00010000:3.0:1746143778.638523:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e0380 00000001:00080000:2.0:1746143778.641351:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943629 is committed 00000004:00080000:2.0:1746143778.641361:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1854 committed 00000004:00080000:2.0:1746143778.641378:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1889 committed 00000004:00080000:2.0:1746143778.641384:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1888 committed 00000004:00080000:2.0:1746143778.641386:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1887 committed 00000004:00080000:2.0:1746143778.641388:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1886 committed 00000004:00080000:2.0:1746143778.641389:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1853 committed 00000004:00080000:2.0:1746143778.641391:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1885 committed 00000004:00080000:2.0:1746143778.641393:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1852 committed 00000004:00080000:2.0:1746143778.641394:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1884 committed 00000004:00080000:2.0:1746143778.641396:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1851 committed 00000004:00080000:2.0:1746143778.641397:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1850 committed 00000004:00080000:2.0:1746143778.641398:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1849 committed 00000004:00080000:2.0:1746143778.641400:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1883 committed 00000004:00080000:2.0:1746143778.641401:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1882 committed 00000004:00080000:2.0:1746143778.641402:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1848 committed 00000004:00080000:2.0:1746143778.641404:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1847 committed 00000004:00080000:2.0:1746143778.641405:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1881 committed 00000001:00080000:2.0:1746143778.641411:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943628 is committed 00000001:00080000:2.0:1746143778.641422:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943624 is committed 00000100:00100000:2.0:1746143778.641532:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626747264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.641533:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626747136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143778.641590:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.641600:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626747520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.641616:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626747648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143778.641621:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143778.641639:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626747136 00000100:00100000:3.0:1746143778.641646:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626747136 00000100:00100000:2.0:1746143778.641648:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626748032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143778.641663:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.641674:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626748544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143778.641678:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626747520 00000100:00100000:3.0:1746143778.641680:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626747520 00000100:00100000:2.0:1746143778.641685:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143778.641694:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626748032 00000100:00100000:3.0:1746143778.641696:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626748032 00000100:00100000:2.0:1746143778.641698:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626749056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.641709:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626748544 00000100:00100000:2.0:1746143778.641710:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143778.641711:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626748544 00000100:00100000:3.0:1746143778.641720:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626749056 00000100:00100000:3.0:1746143778.641722:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626749056 00000100:00100000:2.0:1746143778.641727:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746143778.641732:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626747392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143778.641735:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11833 00000100:00100000:3.0:1746143778.641740:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963626747136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143778.641744:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.641754:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626747904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143778.641766:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.641777:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626748416:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143778.641787:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.641794:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626748928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143778.641805:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.641825:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626747392 00000100:00100000:2.0:1746143778.641830:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626747392 00002000:00010000:3.0:1746143778.641847:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143778.641850:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.641852:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00000100:00100000:2.0:1746143778.641852:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626747904 00002000:00010000:3.0:1746143778.641853:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00000100:00100000:2.0:1746143778.641853:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626747904 00002000:00010000:3.0:1746143778.641855:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143778.641861:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626748416 00000100:00100000:2.0:1746143778.641863:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626748416 00000100:00100000:2.0:1746143778.641869:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626748928 00000100:00100000:2.0:1746143778.641870:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626748928 00000100:00100000:3.0:1746143778.641877:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3773:x1830963626747136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (287us total) trans 17179873001 rc 0/0 00000100:00100000:2.0:1746143778.641879:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11834 00000100:00100000:3.0:1746143778.641884:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11833 00000100:00100000:2.0:1746143778.641886:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3772:x1830963626747520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.641898:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11835 00000100:00100000:3.0:1746143778.641902:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3772:x1830963626748032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143778.641963:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143778.641965:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143778.641967:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:3.0:1746143778.641969:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143778.641970:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143778.641990:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3772:x1830963626748032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (327us total) trans 17179873002 rc 0/0 00000100:00100000:3.0:1746143778.641997:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11835 00000100:00100000:3.0:1746143778.642006:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11836 00000100:00100000:3.0:1746143778.642009:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3772:x1830963626748544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143778.642049:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3772:x1830963626748544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (363us total) trans 17179873003 rc 0/0 00000100:00100000:1.0:1746143778.642051:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11837 00000100:00100000:3.0:1746143778.642055:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11836 00000100:00100000:1.0:1746143778.642059:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963626749056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.642062:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11838 00000100:00100000:3.0:1746143778.642065:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3772:x1830963626747392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143778.642091:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143778.642093:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.642094:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.642096:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.642097:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746143778.642109:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3772:x1830963626747392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (365us total) trans 17179873004 rc 0/0 00000100:00100000:3.0:1746143778.642113:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11838 00000100:00100000:3.0:1746143778.642121:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11839 00000100:00100000:3.0:1746143778.642125:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963626747904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143778.642139:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963626749056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (427us total) trans 21474840325 rc 0/0 00000100:00100000:1.0:1746143778.642145:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11837 00000100:00100000:1.0:1746143778.642156:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11840 00000100:00100000:1.0:1746143778.642160:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963626748416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.642166:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963626747904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (398us total) trans 21474840326 rc 0/0 00000100:00100000:3.0:1746143778.642170:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11839 00000100:00100000:3.0:1746143778.642177:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11841 00000100:00100000:3.0:1746143778.642181:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3772:x1830963626748928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143778.642207:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963626748416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (418us total) trans 21474840327 rc 0/0 00000100:00100000:1.0:1746143778.642211:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11840 00000100:00100000:3.0:1746143778.642214:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3772:x1830963626748928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 33us (409us total) trans 17179873005 rc 0/0 00000100:00100000:3.0:1746143778.642219:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11841 00000100:00100000:3.0:1746143778.642241:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143778.642254:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626748160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.642270:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143778.642279:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626748672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143778.642292:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143778.642316:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ebce00/2, rc 0, transno 17179873001 00000100:00100000:3.0:1746143778.642320:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626747136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143778.642331:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626747648 00000100:00100000:3.0:1746143778.642334:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626747648 00000100:00100000:3.0:1746143778.642344:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626748160 00000100:00100000:3.0:1746143778.642345:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626748160 00000100:00100000:3.0:1746143778.642351:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626748672 00000100:00100000:3.0:1746143778.642352:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626748672 00000100:00100000:3.0:1746143778.642359:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11842 00000100:00100000:3.0:1746143778.642362:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3773:x1830963626747648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143778.642395:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143778.642397:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.642398:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.642400:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:3.0:1746143778.642401:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746143778.642418:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3773:x1830963626747648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (176us total) trans 17179873006 rc 0/0 00000100:00100000:3.0:1746143778.642422:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11842 00000100:00100000:3.0:1746143778.642429:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11843 00000100:00100000:3.0:1746143778.642432:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3773:x1830963626748160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.642468:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3773:x1830963626748160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 35us (197us total) trans 21474840328 rc 0/0 00000100:00100000:3.0:1746143778.642472:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11843 00000100:00100000:3.0:1746143778.642478:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11844 00000100:00100000:3.0:1746143778.642481:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3773:x1830963626748672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143778.642512:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3773:x1830963626748672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 31us (219us total) trans 17179873007 rc 0/0 00000100:00100000:3.0:1746143778.642516:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11844 00000004:00080000:3.0:1746143778.642532:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ebd180/2, rc 0, transno 17179873006 00000100:00100000:3.0:1746143778.642535:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626747648:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143778.642542:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093911c00/2, rc 0, transno 21474840328 00000100:00100000:3.0:1746143778.642547:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626748160:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143778.642551:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ebea00/2, rc 0, transno 17179873007 00000100:00100000:3.0:1746143778.642553:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626748672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143778.642587:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626749184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.642599:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143778.642611:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626749184 00000100:00100000:3.0:1746143778.642613:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626749184 00000100:00100000:3.0:1746143778.642623:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11845 00000100:00100000:3.0:1746143778.642626:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3773:x1830963626749184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.642666:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3773:x1830963626749184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (66us total) trans 21474840329 rc 0/0 00000100:00100000:3.0:1746143778.642670:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11845 00000004:00080000:3.0:1746143778.642684:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ebd880/2, rc 0, transno 21474840329 00000100:00100000:3.0:1746143778.642686:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626749184:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143778.642726:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af9f expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.642735:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143778.642738:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143778.642742:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.642751:0:6587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.642757:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.642777:0:6587:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.642785:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626749312:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143778.642825:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00002000:00010000:2.0:1746143778.646879:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143778.646887:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:2.0:1746143778.646889:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:2.0:1746143778.646891:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:2.0:1746143778.646893:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143778.646994:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963626747520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5103us (5367us total) trans 21474840324 rc 0/0 00000100:00100000:2.0:1746143778.647007:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11834 00000100:00100000:3.0:1746143778.647610:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.647644:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626747264 00000100:00100000:2.0:1746143778.647653:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626747264 00000100:00100000:3.0:1746143778.647659:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626747776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143778.647689:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11846 00000100:00100000:2.0:1746143778.647696:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963626747264:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.647723:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ebd500/2, rc 0, transno 17179873004 00000100:00100000:0.0:1746143778.647729:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626747392:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143778.647816:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:3.0:1746143778.647818:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746143778.647819:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:2.0:1746143778.647821:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00002000:00010000:2.0:1746143778.647823:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:2.0:1746143778.647825:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:3.0:1746143778.647835:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626748288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143778.647849:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963626747264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (245us total) trans 21474840330 rc 0/0 00000100:00100000:3.0:1746143778.647855:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.647856:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11846 00000100:00100000:2.0:1746143778.647866:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626747776 00000100:00100000:3.0:1746143778.647867:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626748800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143778.647869:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626747776 00000100:00100000:3.0:1746143778.647882:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143778.647882:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626748288 00000100:00100000:2.0:1746143778.647884:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626748288 00000100:00100000:2.0:1746143778.647897:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626748800 00000100:00100000:2.0:1746143778.647899:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626748800 00000100:00100000:2.0:1746143778.647940:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11847 00000100:00100000:2.0:1746143778.647945:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963626747776:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143778.647948:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093912300/2, rc 0, transno 21474840330 00000100:00100000:3.0:1746143778.647953:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626747264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143778.647977:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11848 00002000:00010000:2.0:1746143778.647983:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:2.0:1746143778.647985:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143778 -> 1746143778 00002000:00010000:2.0:1746143778.647987:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143778 -> 1746143778 00000100:00100000:3.0:1746143778.647988:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963626748288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143778.647989:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143778 -> 1746143778 00002000:00010000:2.0:1746143778.647991:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00000004:00080000:0.0:1746143778.648010:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093910380/2, rc 0, transno 21474840326 00000100:00100000:0.0:1746143778.648014:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626747904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143778.648015:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963626747776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (197us total) trans 21474840331 rc 0/0 00000100:00100000:2.0:1746143778.648021:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11847 00000004:00080000:0.0:1746143778.648025:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093912a00/2, rc 0, transno 21474840327 00000100:00100000:0.0:1746143778.648028:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626748416:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143778.648030:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11849 00000100:00100000:2.0:1746143778.648034:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963626748800:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.648039:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ebed80/2, rc 0, transno 17179873005 00000100:00100000:0.0:1746143778.648041:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626748928:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143778.648048:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093910e00/2, rc 0, transno 21474840324 00000100:00100000:0.0:1746143778.648051:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626747520:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143778.648058:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ebdf80/2, rc 0, transno 17179873002 00000100:00100000:0.0:1746143778.648060:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626748032:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143778.648066:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143778.648068:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143778.648070:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:0.0:1746143778.648070:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ebe680/2, rc 0, transno 17179873003 00002000:00010000:2.0:1746143778.648072:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00000100:00100000:0.0:1746143778.648072:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626748544:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143778.648074:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000004:00080000:0.0:1746143778.648079:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093913800/2, rc 0, transno 21474840325 00000100:00100000:0.0:1746143778.648081:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626749056:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143778.648090:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1746143778.648090:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963626748800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (207us total) trans 21474840332 rc 0/0 00002000:00010000:3.0:1746143778.648092:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143778.648094:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746143778.648094:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11849 00002000:00010000:3.0:1746143778.648095:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143778.648097:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746143778.648132:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963626748288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (275us total) trans 17179873008 rc 0/0 00000100:00100000:3.0:1746143778.648139:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11848 00000100:00100000:0.0:1746143778.648166:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626749312:192.168.202.3@tcp:105: 00000004:00080000:3.0:1746143778.648178:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093911880/2, rc 0, transno 21474840331 00000100:00100000:3.0:1746143778.648182:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626747776:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143778.648189:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ebe300/2, rc 0, transno 17179873008 00000100:00100000:3.0:1746143778.648192:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626748288:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143778.648199:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093910000/2, rc 0, transno 21474840332 00000100:00100000:3.0:1746143778.648202:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626748800:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143778.648202:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73a91a7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af9f expref: 263 pid: 6587 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143778.648219:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af9f expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.648243:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24600, rc 0) 00000100:00100000:0.0:1746143778.648289:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32170:x1830963622533760:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 32512us (34971us total) trans 8589943629 rc 0/0 00000100:00100000:0.0:1746143778.648296:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12874 00000100:00100000:0.0:1746143778.649697:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.649862:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622534656 00000100:00100000:2.0:1746143778.649869:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622534656 00000100:00100000:2.0:1746143778.649942:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4715 00000100:00100000:2.0:1746143778.649949:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32173:x1830963622534656:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:2.0:1746143778.650043:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32173:x1830963622534656:12345-192.168.202.3@tcp:49:cat.0 Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.650049:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4715 00000100:00100000:0.0:1746143778.652396:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.652449:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.652635:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622534912 00000100:00100000:2.0:1746143778.652643:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622534912 00000100:00100000:2.0:1746143778.652687:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4716 00000100:00100000:2.0:1746143778.652695:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32170:x1830963622534912:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:3.0:1746143778.652781:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622534784 00000100:00100000:3.0:1746143778.652791:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622534784 00000100:00100000:3.0:1746143778.652835:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11850 00000100:00100000:3.0:1746143778.652843:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32171:x1830963622534784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.652858:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.652873:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137a00/0x87925e4cb73a91c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afb4 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.652897:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.652898:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.652904:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137a00/0x87925e4cb73a91c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afb4 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.652941:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137a00/0x87925e4cb73a91c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afb4 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.652949:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137a00, rc 0) 00000100:00100000:2.0:1746143778.654223:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32170:x1830963622534912:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 1525us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.654232:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4716 00000100:00100000:3.0:1746143778.654581:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32171:x1830963622534784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1364us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.654590:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11850 00000100:00100000:0.0:1746143778.659801:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.659870:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622535168 00000100:00100000:3.0:1746143778.659881:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622535168 00002000:00100000:3.0:1746143778.659961:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88007f649500 x1830963622535168/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.659971:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649500 with x1830963622535168 ext(1048576->2097151) 00002000:00010000:3.0:1746143778.659976:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f649500 00000100:00100000:3.0:1746143778.660005:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3417 00000100:00100000:3.0:1746143778.660013:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622535168:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143778.662946:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.663080:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.663134:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622535424 00000100:00100000:0.0:1746143778.663143:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622535424 00000100:00100000:3.0:1746143778.663192:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622535296 00000100:00100000:3.0:1746143778.663200:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622535296 00000100:00100000:0.0:1746143778.663207:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12876 00000100:00100000:0.0:1746143778.663216:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32171:x1830963622535424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143778.663238:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143778.663242:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11851 00000100:00100000:3.0:1746143778.663249:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:32170:x1830963622535296:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143778.663260:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a91ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afc2 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.663264:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.663278:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afbb expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.663301:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a90c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af44 expref: 13 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.663309:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137a00/0x87925e4cb73a91c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afb4 expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.663316:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.663317:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.663318:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a91ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc2 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.663320:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1941504->2097151] (req 1941504->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.663332:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a91ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc2 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.663346:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092137a00/0x87925e4cb73a91c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afb4 expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.663349:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143778.663352:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143778.663355:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96a00, rc 0) 00010000:00010000:3.0:1746143778.663357:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092137a00/0x87925e4cb73a91c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afb4 expref: 10 pid: 9585 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.663366:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626749440:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.663393:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32171:x1830963622535424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 179us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.663399:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12876 00010000:00010000:3.0:1746143778.664446:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a90c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af44 expref: 13 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.664455:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a90c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af44 expref: 13 pid: 13436 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.664468:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626749568:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.665484:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.673003:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622535168:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 12983us (13204us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143778.673013:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3417 00002000:00100000:3.0:1746143778.673023:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88007f649500 x1830963622535168/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.673031:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649500 with x1830963622535168 ext(1048576->2097151) 00002000:00010000:3.0:1746143778.673035:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f649500 00000100:00100000:0.0:1746143778.674316:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.674395:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622535552 00000100:00100000:1.0:1746143778.674489:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622535552 00010000:00010000:1.0:1746143778.674518:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092137a00/0x87925e4cb73a91c3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afb4 expref: 11 pid: 9585 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.674559:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5580 00000100:00100000:1.0:1746143778.674566:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622535552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.674580:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.674598:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092137a00/0x87925e4cb73a91c3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afb4 expref: 11 pid: 9585 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143778.674609:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092137a00/0x87925e4cb73a91c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afb4 expref: 11 pid: 9585 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143778.674632:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.674657:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622535552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 92us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.674664:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5580 00010000:00010000:3.0:1746143778.675303:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137a00/0x87925e4cb73a91c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afb4 expref: 10 pid: 9585 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.675324:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626749440:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.680102:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.680222:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626749568:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.680260:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1941504->2097151] (req 1941504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.680277:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096011000, rc 0) 00000100:00100000:3.0:1746143778.680327:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:32170:x1830963622535296:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 17078us (17426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.680335:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11851 00000100:00100000:0.0:1746143778.680483:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.680803:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622535680 00000100:00100000:3.0:1746143778.680811:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622535680 00000100:00100000:3.0:1746143778.680845:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11852 00000100:00100000:3.0:1746143778.680852:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32171:x1830963622535680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.680868:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.680884:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afc9 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.680903:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.680941:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1941504->2097151] (req 1941504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.680950:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143778.680953:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.680981:0:9585:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1941504->2097151] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.680989:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.680996:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ea00, rc 0) 00000100:00100000:3.0:1746143778.681024:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32171:x1830963622535680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 172us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.681031:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11852 00000100:00100000:2.0:1746143778.681072:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622535808 00000100:00100000:2.0:1746143778.681087:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622535808 00010000:00010000:2.0:1746143778.681128:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a90c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af44 expref: 14 pid: 13436 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143778.681173:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5581 00000100:00100000:2.0:1746143778.681181:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622535808:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.681202:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.681221:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a90c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af44 expref: 14 pid: 13436 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143778.681233:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a90c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af44 expref: 14 pid: 13436 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143778.681253:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a90c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af44 expref: 14 pid: 13436 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143778.681281:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.681284:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.681289:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.681296:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.681327:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.681336:0:7229:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 28 pid: 9585 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.681347:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626749824:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143778.681436:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.683012:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.683015:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626749824:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143778.683031:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.683071:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622535936 00000100:00100000:2.0:1746143778.683072:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622535808:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1891us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.683077:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622535936 00000100:00100000:2.0:1746143778.683080:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5581 00000100:00100000:1.0:1746143778.683108:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11853 00000100:00100000:1.0:1746143778.683115:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:32173:x1830963622535936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143778.683129:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.683143:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afd0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.683162:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143778.683172:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 30 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.683182:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 30 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.683191:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428000, rc 0) 00000100:00100000:1.0:1746143778.683220:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:32173:x1830963622535936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 106us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.683225:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11853 00000100:00100000:0.0:1746143778.684402:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.684636:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622536192 00000100:00100000:3.0:1746143778.684644:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622536192 00002000:00100000:3.0:1746143778.684680:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1941504->1945599) req@ffff880091bc8000 x1830963622536192/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.684690:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc8000 with x1830963622536192 ext(1941504->1945599) 00010000:00010000:3.0:1746143778.684697:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 30 pid: 9585 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.684710:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 30 pid: 9585 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.684716:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bc8000 00000100:00100000:3.0:1746143778.686768:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1431 00000100:00100000:3.0:1746143778.686784:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622536192:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143778.687112:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622536192:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 333us (2710us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143778.687118:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1431 00002000:00100000:3.0:1746143778.687124:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1941504->1945599) req@ffff880091bc8000 x1830963622536192/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/4536 e 0 to 0 dl 1746143789 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.687132:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc8000 with x1830963622536192 ext(1941504->1945599) 00010000:00010000:3.0:1746143778.687140:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 30 pid: 9585 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.687151:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 30 pid: 9585 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.687156:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bc8000 00000100:00100000:0.0:1746143778.694431:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.694480:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.694879:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622536448 00000100:00100000:2.0:1746143778.694889:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622536448 00000100:00100000:2.0:1746143778.694983:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11854 00000100:00100000:2.0:1746143778.694990:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+23:32170:x1830963622536448:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143778.695010:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.695025:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afd7 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.695050:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a90c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af4b expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143778.695057:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.695058:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.695061:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.695085:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a90c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af4b expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143778.695094:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a90c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af4b expref: 12 pid: 9587 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143778.695104:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626749952:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143778.695176:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.695481:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622536576 00000100:00100000:3.0:1746143778.695490:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622536576 00002000:00100000:3.0:1746143778.695529:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1941504->2097151) req@ffff880091bc8e00 x1830963622536576/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.695539:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc8e00 with x1830963622536576 ext(1941504->2097151) 00010000:00010000:3.0:1746143778.695549:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 30 pid: 9585 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.695561:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 30 pid: 9585 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.695567:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bc8e00 00000100:00100000:3.0:1746143778.695587:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1432 00000100:00100000:3.0:1746143778.695594:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622536576:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143778.699735:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626749952:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143778.699763:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.699778:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0a800, rc 0) 00000100:00100000:2.0:1746143778.699837:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+24:32170:x1830963622536448:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4848us (5415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.699845:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11854 00000100:00100000:0.0:1746143778.700822:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.701271:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622536704 00000100:00100000:3.0:1746143778.701281:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622536704 00010000:00010000:3.0:1746143778.701315:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a90c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af4b expref: 13 pid: 9587 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143778.701357:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5582 00000100:00100000:3.0:1746143778.701366:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622536704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.701380:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143778.701564:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622536576:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5969us (7082us total) trans 17179873009 rc 0/0 00000100:00100000:0.0:1746143778.701573:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1432 00002000:00100000:0.0:1746143778.701582:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1941504->2097151) req@ffff880091bc8e00 x1830963622536576/t17179873009(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/448 e 0 to 0 dl 1746143789 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143778.701598:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc8e00 with x1830963622536576 ext(1941504->2097151) 00010000:00010000:0.0:1746143778.701606:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 32 pid: 9585 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143778.701616:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 32 pid: 9585 timeout: 937 lvb_type: 0 00002000:00010000:0.0:1746143778.701621:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bc8e00 00010000:00010000:3.0:1746143778.702715:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a90c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af4b expref: 13 pid: 9587 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143778.702731:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a90c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af4b expref: 13 pid: 9587 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143778.702763:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a90c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af4b expref: 13 pid: 9587 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143778.702793:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.702795:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.702803:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.702811:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.702850:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.702863:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626750080:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143778.702960:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.707862:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.707879:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626750080:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143778.707901:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.707986:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622536704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6620us (7167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.707998:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5582 00000100:00100000:3.0:1746143778.708031:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622536832 00000100:00100000:3.0:1746143778.708036:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622536832 00010000:00010000:3.0:1746143778.708061:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 32 pid: 9585 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.708097:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5583 00000100:00100000:3.0:1746143778.708103:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963622536832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143778.708117:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143778.708133:0:7229:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143778 -> 1746143779 00002000:00010000:3.0:1746143778.708136:0:7229:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143778 -> 1746143779 00010000:00010000:3.0:1746143778.708141:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 32 pid: 9585 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.708947:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 32 pid: 9585 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.708973:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096011000/0x87925e4cb73a91d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afbb expref: 32 pid: 9585 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143778.709450:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.709473:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622537088 00010000:00010000:3.0:1746143778.709478:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143778.709479:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622537088 00010000:00010000:3.0:1746143778.709481:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.709489:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.709498:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.709507:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.709508:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.709511:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746143778.709515:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1314816->1318911) req@ffff880136acb800 x1830963622537088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746143778.709523:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746143778.709526:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb800 with x1830963622537088 ext(1314816->1318911) 00002000:00010000:0.0:1746143778.709530:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136acb800 00010000:00010000:3.0:1746143778.709552:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.709560:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3418 00000100:00100000:3.0:1746143778.709565:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626750208:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143778.709566:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622537088:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143778.711221:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622537088:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 1648us (1766us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143778.711231:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3418 00002000:00100000:0.0:1746143778.711239:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1314816->1318911) req@ffff880136acb800 x1830963622537088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/4536 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143778.711248:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb800 with x1830963622537088 ext(1314816->1318911) 00002000:00010000:0.0:1746143778.711253:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136acb800 00010000:00010000:3.0:1746143778.711481:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.711496:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626750336:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143778.711529:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.716061:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.716141:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622537344 00000100:00100000:2.0:1746143778.716153:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622537344 00000100:00100000:2.0:1746143778.716212:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4717 00000100:00100000:2.0:1746143778.716220:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32170:x1830963622537344:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143778.716270:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626750208:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143778.716283:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626750336:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143778.716303:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143778.716351:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622536832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8248us (8502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.716361:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5583 00000100:00100000:2.0:1746143778.716420:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:32170:x1830963622537344:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 201us (370us total) trans 8589943630 rc 0/0 00000100:00100000:2.0:1746143778.716427:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4717 00000100:00100000:0.0:1746143778.720399:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.720468:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622537600 00000100:00100000:2.0:1746143778.720478:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622537600 00002000:00100000:2.0:1746143778.720522:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095e30380 x1830963622537600/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.720531:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30380 with x1830963622537600 ext(1048576->2097151) 00002000:00010000:2.0:1746143778.720535:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e30380 00000100:00100000:0.0:1746143778.720539:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.720570:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622537856 00000100:00100000:2.0:1746143778.720573:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622537856 00000100:00100000:0.0:1746143778.720579:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143778.720584:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095e31180 x1830963622537856/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.720591:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963622537856 ext(1048576->2097151) 00002000:00010000:2.0:1746143778.720594:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31180 00000100:00100000:2.0:1746143778.720611:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622538112 00000100:00100000:2.0:1746143778.720613:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622538112 00000100:00100000:3.0:1746143778.720623:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3419 00002000:00100000:2.0:1746143778.720624:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1318912->2097151) req@ffff880095e30700 x1830963622538112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.720630:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30700 with x1830963622538112 ext(1318912->2097151) 00002000:00010000:2.0:1746143778.720633:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e30700 00000100:00100000:0.0:1746143778.720633:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3420 00000100:00100000:3.0:1746143778.720635:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622537600:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143778.720641:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622537856:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143778.720652:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3421 00000100:00100000:2.0:1746143778.720659:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622538112:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143778.732110:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622538112:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 11443us (11522us total) trans 0 rc 778240/778240 00000100:00100000:2.0:1746143778.732121:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3421 00000100:00100000:1.0:1746143778.732123:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622537856:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 11476us (11577us total) trans 0 rc 1048576/1048576 00002000:00100000:2.0:1746143778.732130:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1318912->2097151) req@ffff880095e30700 x1830963622538112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 778240/778240 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143778.732133:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3420 00002000:00100000:2.0:1746143778.732138:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30700 with x1830963622538112 ext(1318912->2097151) 00002000:00100000:1.0:1746143778.732142:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095e31180 x1830963622537856/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00010000:2.0:1746143778.732143:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e30700 00002000:00100000:1.0:1746143778.732150:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963622537856 ext(1048576->2097151) 00002000:00010000:1.0:1746143778.732155:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31180 00000100:00100000:3.0:1746143778.736429:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622537600:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15785us (16029us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143778.736446:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3419 00002000:00100000:3.0:1746143778.736459:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095e30380 x1830963622537600/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.736468:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30380 with x1830963622537600 ext(1048576->2097151) 00002000:00010000:3.0:1746143778.736475:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e30380 00000100:00100000:0.0:1746143778.750809:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.750847:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.750889:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.752879:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622538240 00000100:00100000:3.0:1746143778.752893:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622538240 00000100:00100000:1.0:1746143778.752893:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622538368 00000100:00100000:1.0:1746143778.752905:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622538368 00000100:00100000:1.0:1746143778.753546:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622538496 00000100:00100000:1.0:1746143778.753550:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622538496 00000100:00100000:3.0:1746143778.753561:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11855 00000100:00100000:3.0:1746143778.753614:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622538240:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.753637:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.753659:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7e000/0x87925e4cb73a91ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afde expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.753684:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.753686:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.753695:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e000/0x87925e4cb73a91ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afde expref: 25 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.753712:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e000/0x87925e4cb73a91ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afde expref: 25 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.753723:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e000, rc 0) 00000100:00100000:3.0:1746143778.753786:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622538240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 217us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.753860:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11856 00000100:00100000:0.0:1746143778.753869:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32171:x1830963622538368:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143778.753872:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11857 00010000:00010000:0.0:1746143778.753878:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143778.753881:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622538496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143778.753887:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afe5 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.753897:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143778.753905:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.753948:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a91fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840afec expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.753948:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143778.753950:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143778.753953:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.753968:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.753970:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.753977:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a91fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afec expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.753981:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.753990:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a91fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afec expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.753998:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 25 pid: 13436 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143778.754003:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:0.0:1746143778.754010:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626750464:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.754046:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622538496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 167us (3156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.754052:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11857 00000100:00100000:0.0:1746143778.754056:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.754299:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11855 00000100:00100000:0.0:1746143778.759970:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.759989:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626750464:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143778.760019:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.760033:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97200, rc 0) 00000100:00100000:3.0:1746143778.760066:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622538624 00000100:00100000:3.0:1746143778.760076:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622538624 00000100:00100000:2.0:1746143778.760084:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32171:x1830963622538368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6216us (9234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.760093:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11856 00002000:00100000:3.0:1746143778.760124:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1318911) req@ffff8800972eaa00 x1830963622538624/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.760134:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eaa00 with x1830963622538624 ext(1048576->1318911) 00010000:00010000:3.0:1746143778.760142:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 25 pid: 13436 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.760155:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 25 pid: 13436 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.760162:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800972eaa00 00000100:00100000:3.0:1746143778.760182:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1433 00000100:00100000:3.0:1746143778.760190:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622538624:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143778.762038:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.762197:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622538752 00000100:00100000:2.0:1746143778.762205:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622538752 00000100:00100000:2.0:1746143778.762251:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11858 00000100:00100000:2.0:1746143778.762258:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32172:x1830963622538752:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143778.762273:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.762287:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840aff3 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.762309:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.762316:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.762321:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.762323:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.762326:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1843200->2097151] (req 1843200->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 12 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.762351:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.762360:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 31 pid: 13430 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.762370:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626750592:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143778.762472:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.762479:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 12 pid: 9585 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.762485:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626750720:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143778.762502:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.764615:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.764666:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.764756:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622539136 00000100:00100000:2.0:1746143778.764758:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622539264 00000100:00100000:1.0:1746143778.764766:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622539136 00000100:00100000:2.0:1746143778.764768:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622539264 00002000:00100000:1.0:1746143778.764807:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800972e9c00 x1830963622539136/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.764808:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800972e9f80 x1830963622539264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.764816:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9f80 with x1830963622539264 ext(2097152->4194303) 00002000:00100000:1.0:1746143778.764816:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9c00 with x1830963622539136 ext(2097152->4194303) 00002000:00010000:2.0:1746143778.764820:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9f80 00002000:00010000:1.0:1746143778.764821:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e9c00 00000100:00100000:2.0:1746143778.764844:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3422 00000100:00100000:2.0:1746143778.764850:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622539264:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143778.765890:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3423 00000100:00100000:1.0:1746143778.765902:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622539136:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143778.767666:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.767690:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.767710:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622539392 00000100:00100000:1.0:1746143778.767717:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622539392 00010000:00010000:1.0:1746143778.767750:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 34 pid: 13430 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.767785:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622539520 00000100:00100000:1.0:1746143778.767788:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622539520 00010000:00010000:1.0:1746143778.767798:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 13 pid: 9585 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143778.767817:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5584 00000100:00100000:1.0:1746143778.767824:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622539392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.767837:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.767856:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 34 pid: 13430 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143778.767866:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 34 pid: 13430 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.767876:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5585 00000100:00100000:2.0:1746143778.767890:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622539520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.767892:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143778.767941:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143778.767945:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622539392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 120us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.767951:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5584 00010000:00010000:2.0:1746143778.767965:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 13 pid: 9585 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.767977:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 13 pid: 9585 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.768000:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.768002:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.768008:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 13 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.768016:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 13 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.768050:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 13 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.768061:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626750848:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143778.768107:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73a91df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd0 expref: 33 pid: 13430 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.768123:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.768124:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626750592:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.768135:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ea00/0x87925e4cb73a91d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc9 expref: 13 pid: 9585 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143778.768144:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626750720:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.768168:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 12 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.768177:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0a000, rc 0) 00000100:00100000:3.0:1746143778.768201:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32172:x1830963622538752:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5944us (6169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.768208:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11858 00000100:00100000:3.0:1746143778.774773:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622538624:12345-192.168.202.3@tcp:4:cat.0 Request processed in 14564us (14795us total) trans 21474840333 rc 0/0 00000100:00100000:3.0:1746143778.774787:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1433 00002000:00100000:3.0:1746143778.774801:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1318911) req@ffff8800972eaa00 x1830963622538624/t21474840333(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/448 e 0 to 0 dl 1746143789 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.774812:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eaa00 with x1830963622538624 ext(1048576->1318911) 00010000:00010000:3.0:1746143778.774823:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 29 pid: 13436 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143778.774998:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 29 pid: 13436 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143778.775006:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800972eaa00 00000100:00100000:2.0:1746143778.784509:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626750848:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143778.784537:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.784591:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622539520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 16703us (16897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.784603:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5585 00000100:00100000:1.0:1746143778.787173:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.787332:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622539776 00000100:00100000:3.0:1746143778.787343:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622539776 00002000:00100000:3.0:1746143778.787391:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1843200->1847295) req@ffff88009e490700 x1830963622539776/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.787402:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490700 with x1830963622539776 ext(1843200->1847295) 00002000:00010000:3.0:1746143778.787407:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e490700 00000100:00100000:3.0:1746143778.787434:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3424 00000100:00100000:3.0:1746143778.787442:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622539776:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143778.787585:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622539776:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 144us (422us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143778.787593:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3424 00002000:00100000:3.0:1746143778.787598:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1843200->1847295) req@ffff88009e490700 x1830963622539776/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/4536 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.787605:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490700 with x1830963622539776 ext(1843200->1847295) 00002000:00010000:3.0:1746143778.787607:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e490700 00000100:00100000:2.0:1746143778.787642:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622539264:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22790us (22974us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143778.787650:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3422 00002000:00100000:2.0:1746143778.787655:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800972e9f80 x1830963622539264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.787661:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9f80 with x1830963622539264 ext(2097152->4194303) 00002000:00010000:2.0:1746143778.787664:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9f80 00000100:00100000:0.0:1746143778.791080:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.791725:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622539904 00000100:00100000:2.0:1746143778.791736:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622539904 00010000:00010000:2.0:1746143778.791782:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 29 pid: 13436 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143778.791827:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5586 00000100:00100000:2.0:1746143778.791835:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622539904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.791852:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143778.791869:0:12362:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143778 -> 1746143779 00002000:00010000:2.0:1746143778.791872:0:12362:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143778 -> 1746143779 00002000:00010000:2.0:1746143778.791874:0:12362:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143778 -> 1746143779 00010000:00010000:2.0:1746143778.791879:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 29 pid: 13436 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.791893:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 29 pid: 13436 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.791963:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a91e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afd7 expref: 29 pid: 13436 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143778.791995:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.791998:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.792005:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.792014:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.792049:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.792062:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626750976:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143778.792880:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143778.793063:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622539136:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27162us (28454us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143778.793073:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3423 00002000:00100000:2.0:1746143778.793084:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800972e9c00 x1830963622539136/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.793093:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9c00 with x1830963622539136 ext(2097152->4194303) 00002000:00010000:2.0:1746143778.793097:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e9c00 00000100:00100000:2.0:1746143778.797402:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626750976:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143778.797429:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.797635:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622539904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5798us (6564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.797648:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5586 00000100:00100000:0.0:1746143778.799816:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.801454:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622540032 00000100:00100000:3.0:1746143778.801465:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622540032 00000100:00100000:3.0:1746143778.801518:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11859 00000100:00100000:3.0:1746143778.801526:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32172:x1830963622540032:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143778.801541:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.801557:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840affa expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.801582:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 12 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.801587:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.801589:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.801592:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->1724415] (req 1048576->1724415) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 12 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.801617:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 12 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.801626:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 12 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143778.801641:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626751104:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.801721:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.807401:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.807512:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626751104:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.807538:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->1724415] (req 1048576->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 12 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.807553:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7fc00, rc 0) 00000100:00100000:3.0:1746143778.807593:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32172:x1830963622540032:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6068us (7784us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143778.807601:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11859 00000100:00100000:2.0:1746143778.808032:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622540288 00000100:00100000:2.0:1746143778.808038:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622540288 00002000:00100000:2.0:1746143778.808069:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88009391fb80 x1830963622540288/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.808078:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391fb80 with x1830963622540288 ext(1048576->2097151) 00010000:00010000:2.0:1746143778.808084:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 12 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143778.808095:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 12 pid: 9839 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143778.808101:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391fb80 00000100:00100000:2.0:1746143778.808113:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1434 00000100:00100000:2.0:1746143778.808119:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622540288:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143778.811979:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.812014:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.812505:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622540416 00000100:00100000:3.0:1746143778.812512:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622540416 00000100:00100000:3.0:1746143778.812550:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622540544 00000100:00100000:3.0:1746143778.812552:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622540544 00000100:00100000:3.0:1746143778.812570:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11860 00000100:00100000:3.0:1746143778.812576:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622540416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.812590:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.812603:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0b800/0x87925e4cb73a9210 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b001 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.812641:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626751232:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143778.812695:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.812707:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11861 00000100:00100000:3.0:1746143778.812711:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622540544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.812718:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.812726:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0b600/0x87925e4cb73a9217 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b008 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.812737:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.812744:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0b600/0x87925e4cb73a9217 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b008 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.812752:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0b600/0x87925e4cb73a9217 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b008 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.812761:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b600, rc 0) 00000100:00100000:3.0:1746143778.812776:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622540544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 64us (762us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143778.812780:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11861 00002000:00010000:3.0:1746143778.815607:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143778 -> 1746143779 00000100:00100000:3.0:1746143778.815630:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626751232:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143778.815655:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d0b800/0x87925e4cb73a9210 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b001 expref: 32 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.815666:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0b800/0x87925e4cb73a9210 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b001 expref: 32 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.815688:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b800, rc 0) 00000100:00100000:3.0:1746143778.815730:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622540416:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3153us (3757us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143778.815741:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11860 00000100:00100000:2.0:1746143778.819627:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622540288:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 11499us (12224us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143778.819637:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1434 00002000:00100000:2.0:1746143778.819646:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88009391fb80 x1830963622540288/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.819655:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391fb80 with x1830963622540288 ext(1048576->2097151) 00010000:00010000:2.0:1746143778.819664:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 12 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143778.819676:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 12 pid: 9839 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143778.819682:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391fb80 00000100:00100000:0.0:1746143778.828147:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.828792:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622540672 00000100:00100000:3.0:1746143778.828803:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622540672 00000100:00100000:1.0:1746143778.828818:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.828860:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.829142:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622540800 00000100:00100000:3.0:1746143778.829146:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622540800 00000100:00100000:3.0:1746143778.829162:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622540928 00000100:00100000:3.0:1746143778.829164:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622540928 00000100:00100000:3.0:1746143778.829180:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11862 00000100:00100000:3.0:1746143778.829187:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622540672:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143778.829202:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11863 00010000:00010000:3.0:1746143778.829206:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143778.829212:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622540800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.829224:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0b400/0x87925e4cb73a921e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b00f expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.829384:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11864 00000100:00100000:0.0:1746143778.829391:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622540928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143778.829399:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143778.829409:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73a9225 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b01d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.829424:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.829426:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.829434:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73a9225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b01d expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.829452:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73a9225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b01d expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143778.829463:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96600, rc 0) 00000100:00100000:0.0:1746143778.829513:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622540928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 122us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143778.829518:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11864 00000100:00100000:0.0:1746143778.829563:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.829671:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143778.829710:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.829721:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0b400/0x87925e4cb73a921e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b00f expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.829729:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0b400/0x87925e4cb73a921e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b00f expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.829741:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b400, rc 0) 00000100:00100000:3.0:1746143778.829763:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622540672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 578us (1630us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143778.829769:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11862 00010000:00010000:3.0:1746143778.829787:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143778.829864:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622541312 00000100:00100000:2.0:1746143778.829870:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622541312 00002000:00100000:2.0:1746143778.829903:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092146a00 x1830963622541312/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.829937:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146a00 with x1830963622541312 ext(4194304->4968447) 00002000:00010000:2.0:1746143778.829942:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092146a00 00000100:00100000:2.0:1746143778.829956:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3425 00000100:00100000:2.0:1746143778.829961:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622541312:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:1.0:1746143778.830322:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.830340:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73a922c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b016 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.830358:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.830360:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.830368:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73a922c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b016 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.830380:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73a922c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b016 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.830390:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d7ea00, rc 0) 00000100:00100000:1.0:1746143778.830424:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622540800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1213us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.830429:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11863 00000100:00100000:0.0:1746143778.831756:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622541184 00000100:00100000:0.0:1746143778.831769:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622541184 00010000:00010000:0.0:1746143778.831806:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 13 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143778.831831:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5587 00000100:00100000:0.0:1746143778.831838:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622541184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143778.831851:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143778.834074:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 13 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143778.834106:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 13 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143778.834134:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97200/0x87925e4cb73a91f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afe5 expref: 13 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143778.834177:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.834180:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143778.834187:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 12 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.834196:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 12 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143778.834243:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 12 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.834258:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626751360:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143778.834352:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143778.842556:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626751360:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143778.842590:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.842671:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622541184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10831us (13105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.842685:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5587 00000100:00100000:3.0:1746143778.842889:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622541312:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12926us (13217us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143778.842901:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3425 00002000:00100000:3.0:1746143778.843028:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092146a00 x1830963622541312/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.843037:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146a00 with x1830963622541312 ext(4194304->4968447) 00002000:00010000:3.0:1746143778.843044:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092146a00 00000100:00100000:0.0:1746143778.846294:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.846335:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.846378:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.846459:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622541696 00000100:00100000:3.0:1746143778.846467:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622541696 00000100:00100000:3.0:1746143778.846505:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622541824 00000100:00100000:3.0:1746143778.846507:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622541824 00000100:00100000:3.0:1746143778.846524:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11865 00000100:00100000:3.0:1746143778.846530:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622541696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.846547:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.846562:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73a9233 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b024 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.846606:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626751488:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143778.846670:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.846689:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11866 00000100:00100000:3.0:1746143778.846694:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622541824:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.846702:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.846711:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0b200/0x87925e4cb73a923a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b02b expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143778.846733:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626751616:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143778.846750:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143778.847141:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622541568 00000100:00100000:2.0:1746143778.847598:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622541568 00002000:00100000:2.0:1746143778.847626:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1720320->1724415) req@ffff880092147800 x1830963622541568/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.847633:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092147800 with x1830963622541568 ext(1720320->1724415) 00002000:00010000:2.0:1746143778.847637:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092147800 00000100:00100000:3.0:1746143778.848846:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626751488:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143778.848873:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73a9233 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b024 expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.848885:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73a9233 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b024 expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.848898:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0ac00, rc 0) 00000100:00100000:3.0:1746143778.848961:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622541696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2429us (2673us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143778.848979:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11865 00000100:00100000:3.0:1746143778.849023:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626751616:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143778.849038:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0b200/0x87925e4cb73a923a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b02b expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.849047:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0b200/0x87925e4cb73a923a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b02b expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.849054:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b200, rc 0) 00000100:00100000:3.0:1746143778.849070:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622541824:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2376us (2692us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143778.849075:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11866 00000100:00100000:2.0:1746143778.849096:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3426 00000100:00100000:2.0:1746143778.849443:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622541568:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143778.849981:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622541568:12345-192.168.202.3@tcp:3:cat.0 Request processed in 878us (3644us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143778.849988:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3426 00002000:00100000:2.0:1746143778.849995:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1720320->1724415) req@ffff880092147800 x1830963622541568/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/4536 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.850002:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092147800 with x1830963622541568 ext(1720320->1724415) 00002000:00010000:2.0:1746143778.850007:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092147800 00000100:00100000:1.0:1746143778.851115:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.851164:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.851201:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.851213:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622542080 00000100:00100000:3.0:1746143778.851221:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622542080 00002000:00100000:3.0:1746143778.851248:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880095c30a80 x1830963622542080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143778.851260:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622542336 00002000:00100000:3.0:1746143778.851261:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30a80 with x1830963622542080 ext(2097152->4194303) 00000100:00100000:0.0:1746143778.851263:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622542336 00002000:00010000:3.0:1746143778.851264:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c30a80 00000100:00100000:3.0:1746143778.851278:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3427 00002000:00100000:0.0:1746143778.851278:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095c32300 x1830963622542336/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143778.851284:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622542080:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:0.0:1746143778.851285:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32300 with x1830963622542336 ext(2097152->4194303) 00002000:00010000:0.0:1746143778.851287:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c32300 00000100:00100000:0.0:1746143778.851298:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3428 00000100:00100000:0.0:1746143778.851302:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622542336:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143778.852390:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622542592 00000100:00100000:2.0:1746143778.852397:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622542592 00000100:00100000:2.0:1746143778.852445:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12877 00000100:00100000:2.0:1746143778.852451:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:32177:x1830963622542592:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143778.852465:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.852481:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73a9241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b032 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.852539:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852549:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852557:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852567:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a924f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852571:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a924f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852575:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a924f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852647:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852654:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852658:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143778.852665:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143778.852720:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852725:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852732:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852736:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852740:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143778.852742:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852747:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852756:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143778.852758:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143778.852761:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852765:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9248 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852779:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a924f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852784:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a924f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852788:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a924f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852792:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143778.852793:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a924f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852800:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a924f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852805:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008219e600) 00010000:00010000:2.0:1746143778.852807:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143778.852808:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a924f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852812:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a924f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.852840:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73a9241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b032 expref: 266 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.852850:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b032 expref: 265 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.852855:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.852857:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143778.852859:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30400, rc 0) 00000100:00100000:2.0:1746143778.853673:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:32177:x1830963622542592:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1220us (2563us total) trans 8589943631 rc 0/0 00000100:00100000:2.0:1746143778.853679:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12877 00000100:00100000:3.0:1746143778.875030:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622542080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23733us (23853us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143778.875043:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3427 00002000:00100000:3.0:1746143778.875056:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880095c30a80 x1830963622542080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.875065:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30a80 with x1830963622542080 ext(2097152->4194303) 00002000:00010000:3.0:1746143778.875070:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c30a80 00000100:00100000:0.0:1746143778.876802:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.876842:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.876951:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622542720 00000100:00100000:2.0:1746143778.876959:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622542720 00000100:00100000:3.0:1746143778.876972:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622542848 00000100:00100000:3.0:1746143778.876976:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622542848 00000100:00100000:2.0:1746143778.877010:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11867 00000100:00100000:3.0:1746143778.877016:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11868 00000100:00100000:2.0:1746143778.877017:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622542720:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143778.877022:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622542848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143778.877032:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.877032:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.877046:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0a600/0x87925e4cb73a926b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b040 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.877046:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9264 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b039 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.877089:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626751744:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143778.877146:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b4900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143778.877198:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626751872:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143778.877285:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143778.885676:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626751744:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143778.885710:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9264 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b039 expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143778.885724:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9264 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b039 expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143778.885737:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31e00, rc 0) 00000100:00100000:2.0:1746143778.885784:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622542720:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8767us (8986us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143778.885791:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11867 00000100:00100000:3.0:1746143778.886029:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626751872:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143778.886046:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0a600/0x87925e4cb73a926b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b040 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.886057:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a600/0x87925e4cb73a926b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b040 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.886069:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0a600, rc 0) 00000100:00100000:3.0:1746143778.886091:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622542848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9069us (9248us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143778.886098:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11868 00000100:00100000:2.0:1746143778.889527:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622542336:12345-192.168.202.3@tcp:3:cat.0 Request processed in 38215us (38317us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143778.889537:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3428 00002000:00100000:2.0:1746143778.889547:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095c32300 x1830963622542336/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.889555:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32300 with x1830963622542336 ext(2097152->4194303) 00002000:00010000:2.0:1746143778.889560:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c32300 00000100:00100000:0.0:1746143778.897950:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.898073:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622543104 00000100:00100000:2.0:1746143778.898081:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622543104 00000100:00100000:2.0:1746143778.898118:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4718 00000100:00100000:2.0:1746143778.898125:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e249050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:32173:x1830963622543104:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143778.898298:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e249050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:32173:x1830963622543104:12345-192.168.202.3@tcp:35:cat.0 Request processed in 173us (392us total) trans 8589943632 rc 0/0 00000100:00100000:2.0:1746143778.898304:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4718 00000100:00100000:0.0:1746143778.904012:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.904275:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622543360 00000100:00100000:2.0:1746143778.904283:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622543360 00002000:00100000:2.0:1746143778.904318:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092147100 x1830963622543360/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.904325:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092147100 with x1830963622543360 ext(4194304->4968447) 00002000:00010000:2.0:1746143778.904329:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092147100 00000100:00100000:2.0:1746143778.904356:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3429 00000100:00100000:2.0:1746143778.904363:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622543360:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143778.917712:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622543360:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13339us (13697us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143778.917725:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3429 00002000:00100000:2.0:1746143778.917735:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092147100 x1830963622543360/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:174/0 lens 488/440 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.917743:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092147100 with x1830963622543360 ext(4194304->4968447) 00002000:00010000:2.0:1746143778.917748:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092147100 00000100:00100000:0.0:1746143778.926109:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.927765:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622543488 00000100:00100000:3.0:1746143778.927777:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622543488 00000100:00100000:3.0:1746143778.927837:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11869 00000100:00100000:3.0:1746143778.927845:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:32177:x1830963622543488:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143778.927859:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143778.927875:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b047 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.927902:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73a90b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af52 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.927932:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73a922c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b016 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.927939:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e000/0x87925e4cb73a91ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afde expref: 27 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.927945:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.927948:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143778.927951:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143778.927977:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7e000/0x87925e4cb73a91ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afde expref: 27 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.927988:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e000/0x87925e4cb73a91ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afde expref: 27 pid: 9587 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143778.927998:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626752000:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.928087:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73a922c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b016 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.928095:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73a922c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b016 expref: 11 pid: 9586 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143778.928104:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626752128:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143778.928131:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73a90b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af52 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143778.928140:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73a90b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af52 expref: 11 pid: 9586 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143778.928147:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626752256:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.928163:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143778.928346:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.928462:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622543744 00000100:00100000:2.0:1746143778.928466:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622543744 00000100:00100000:2.0:1746143778.928491:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4719 00000100:00100000:2.0:1746143778.928496:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32171:x1830963622543744:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143778.928634:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32171:x1830963622543744:12345-192.168.202.3@tcp:35:cat.0 Request processed in 136us (288us total) trans 8589943633 rc 0/0 00000100:00100000:2.0:1746143778.928641:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4719 00000100:00100000:0.0:1746143778.938496:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.938522:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626752000:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.938533:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626752128:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143778.938540:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626752256:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143778.938543:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143778.938567:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143778.938568:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143778.938583:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0a800, rc 0) 00000100:00100000:2.0:1746143778.938659:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622543872 00000100:00100000:2.0:1746143778.938665:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622543872 00010000:00010000:2.0:1746143778.938690:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73a922c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b016 expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143778.938724:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622544000 00000100:00100000:2.0:1746143778.938726:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622544000 00010000:00010000:2.0:1746143778.938735:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73a90b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af52 expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143778.938747:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622544128 00000100:00100000:2.0:1746143778.938749:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622544128 00010000:00010000:2.0:1746143778.938755:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e000/0x87925e4cb73a91ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afde expref: 28 pid: 9587 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143778.938766:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5588 00000100:00100000:2.0:1746143778.939532:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622543872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.939544:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.939561:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73a922c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b016 expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143778.939570:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73a922c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b016 expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143778.939590:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73a922c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b016 expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143778.939611:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.939645:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622543872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 117us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.939684:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5589 00000100:00100000:1.0:1746143778.939693:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622544000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.939700:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.939711:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73a90b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af52 expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.939718:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73a90b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af52 expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.939730:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73a90b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af52 expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.939742:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.939759:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622544000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 67us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.939764:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5589 00000100:00100000:1.0:1746143778.939781:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5590 00000100:00100000:1.0:1746143778.939786:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622544128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.939792:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.939799:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7e000/0x87925e4cb73a91ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afde expref: 28 pid: 9587 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.939808:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7e000/0x87925e4cb73a91ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afde expref: 28 pid: 9587 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.939818:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e000/0x87925e4cb73a91ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afde expref: 28 pid: 9587 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.939827:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.939829:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.939833:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.939841:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.939869:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143778.939878:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626752384:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143778.939939:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143778.940080:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:32177:x1830963622543488:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 12236us (13978us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.940086:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11869 00000100:00100000:2.0:1746143778.940269:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5588 00000100:00100000:0.0:1746143778.946821:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.946934:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626752384:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143778.946949:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.946987:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622544128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7199us (8417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.946996:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5590 00000100:00100000:2.0:1746143778.947139:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622544384 00000100:00100000:2.0:1746143778.947145:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622544384 00002000:00100000:2.0:1746143778.947174:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2617344->2621439) req@ffff8800820d8700 x1830963622544384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.947182:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820d8700 with x1830963622544384 ext(2617344->2621439) 00002000:00010000:2.0:1746143778.947186:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800820d8700 00000100:00100000:2.0:1746143778.947492:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3430 00000100:00100000:2.0:1746143778.947500:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622544384:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143778.947611:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622544384:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 112us (797us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143778.947616:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3430 00002000:00100000:2.0:1746143778.947621:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2617344->2621439) req@ffff8800820d8700 x1830963622544384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/4536 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143778.947627:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820d8700 with x1830963622544384 ext(2617344->2621439) 00002000:00010000:2.0:1746143778.947630:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800820d8700 00000100:00100000:0.0:1746143778.955361:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143778.955439:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622544512 00000100:00100000:1.0:1746143778.955447:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622544512 00000100:00100000:1.0:1746143778.955492:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11870 00000100:00100000:1.0:1746143778.955500:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:32177:x1830963622544512:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143778.955515:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143778.955530:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b04e expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.955556:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a90ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af59 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.955565:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73a9225 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b01d expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.955572:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a91fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afec expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.955578:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.955580:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143778.955583:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->2121727] (req 2097152->2121727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 32 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.955606:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a91fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afec expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.955616:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a91fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afec expref: 32 pid: 13430 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746143778.955626:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626752512:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143778.955713:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73a9225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b01d expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.955720:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73a9225 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b01d expref: 11 pid: 13436 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746143778.955728:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626752640:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143778.955750:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a90ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af59 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143778.955758:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a90ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af59 expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746143778.955765:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626752768:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.955779:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143778.958112:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626752512:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.958122:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626752640:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143778.958128:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626752768:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143778.958154:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->2121727] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 32 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143778.958166:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74e00, rc 0) 00000100:00100000:1.0:1746143778.958194:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:32177:x1830963622544512:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2696us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.958201:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11870 00000100:00100000:0.0:1746143778.960017:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.960080:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.960231:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622544640 00000100:00100000:2.0:1746143778.960239:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622544640 00010000:00010000:2.0:1746143778.960266:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a90ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af59 expref: 13 pid: 9586 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143778.960438:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622544768 00000100:00100000:2.0:1746143778.960441:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622544768 00010000:00010000:2.0:1746143778.960452:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a91fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afec expref: 32 pid: 13430 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746143778.960544:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5591 00000100:00100000:1.0:1746143778.960552:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622544640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.960565:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.960582:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a90ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af59 expref: 13 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.960591:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a90ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af59 expref: 13 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.960610:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a90ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af59 expref: 13 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.960634:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.961051:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622544640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 499us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.961057:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5591 00000100:00100000:1.0:1746143778.961073:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5592 00000100:00100000:1.0:1746143778.961078:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622544768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143778.961087:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143778.961094:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a91fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afec expref: 32 pid: 13430 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.961101:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a91fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afec expref: 32 pid: 13430 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.961111:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73a91fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afec expref: 32 pid: 13430 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143778.961120:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143778.961135:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622544768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 57us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143778.961141:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5592 00000100:00100000:2.0:1746143778.961855:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143778.961936:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622544896 00000100:00100000:0.0:1746143778.961939:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622544896 00010000:00010000:0.0:1746143778.961954:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73a9225 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b01d expref: 12 pid: 13436 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143778.961995:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5593 00000100:00100000:2.0:1746143778.962002:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622544896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143778.962008:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143778.962016:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73a9225 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b01d expref: 12 pid: 13436 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143778.962024:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73a9225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b01d expref: 12 pid: 13436 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143778.962034:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73a9225 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b01d expref: 12 pid: 13436 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143778.962107:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.962109:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143778.962115:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.962122:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.962151:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143778.962161:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626752896:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143778.962219:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143778.964160:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626752896:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143778.964181:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143778.964219:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622544896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2216us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143778.964228:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5593 00000100:00100000:2.0:1746143778.964355:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.964510:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622545152 00000100:00100000:3.0:1746143778.964516:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622545152 00002000:00100000:3.0:1746143778.964543:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x397:0x0] (2117632->2121727) req@ffff88012d840e00 x1830963622545152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/0 e 0 to 0 dl 1746143789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.964551:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840e00 with x1830963622545152 ext(2117632->2121727) 00002000:00010000:3.0:1746143778.964555:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840e00 00000100:00100000:3.0:1746143778.964579:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3431 00000100:00100000:3.0:1746143778.964585:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622545152:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143778.964690:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622545152:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 105us (335us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143778.964696:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3431 00002000:00100000:3.0:1746143778.964701:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x397:0x0] (2117632->2121727) req@ffff88012d840e00 x1830963622545152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:174/0 lens 488/4536 e 0 to 0 dl 1746143789 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143778.964708:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840e00 with x1830963622545152 ext(2117632->2121727) 00002000:00010000:3.0:1746143778.964710:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840e00 00000100:00100000:0.0:1746143778.966254:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143778.966351:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622545408 00000100:00100000:3.0:1746143778.966357:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622545408 00000100:00100000:3.0:1746143778.966396:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4720 00000100:00100000:3.0:1746143778.966402:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:32177:x1830963622545408:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143778.966603:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+267:32177:x1830963622545408:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 201us (352us total) trans 8589943634 rc 0/0 00000100:00100000:3.0:1746143778.966609:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4720 00000100:00100000:0.0:1746143778.995664:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143778.996116:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622545664 00000100:00100000:2.0:1746143778.996125:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622545664 00000100:00100000:2.0:1746143778.996179:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12878 00000100:00100000:2.0:1746143778.996186:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32183:x1830963622545664:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143778.996207:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143778.996222:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b055 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.996283:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996293:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996302:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996313:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a928e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996318:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a928e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996322:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a928e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996398:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996406:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996411:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143778.996418:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143778.996468:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996473:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996478:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996494:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996499:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143778.996501:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996507:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996515:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143778.996518:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143778.996521:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996525:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996549:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a928e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996554:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a928e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996558:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a928e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996561:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143778.996562:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a928e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996566:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a928e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996570:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008219e800) 00010000:00010000:2.0:1746143778.996572:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143778.996573:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a928e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996577:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a928e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143778.996601:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b055 expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.996611:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b055 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143778.996616:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143778.996618:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143778.996620:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30600, rc 0) 00000100:00100000:2.0:1746143778.996657:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32183:x1830963622545664:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 472us (1002us total) trans 8589943635 rc 0/0 00000100:00100000:2.0:1746143778.996662:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12878 00000100:00100000:0.0:1746143779.001409:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.002102:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622545920 00000100:00100000:3.0:1746143779.002111:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622545920 00000100:00100000:3.0:1746143779.002580:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4721 00000100:00100000:3.0:1746143779.002588:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32183:x1830963622545920:12345-192.168.202.3@tcp:35:multiop.0 00000100:00080000:0.0:1746143779.002967:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143779.003185:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32183:x1830963622545920:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 596us (1780us total) trans 8589943636 rc 0/0 00000100:00100000:3.0:1746143779.003192:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4721 00000100:00100000:0.0:1746143779.086244:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.086850:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622546176 00000100:00100000:1.0:1746143779.086859:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622546176 00000100:00100000:1.0:1746143779.086955:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12879 00000100:00100000:1.0:1746143779.086963:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32186:x1830963622546176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.086987:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.087000:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75200/0x87925e4cb73a92a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b05c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.087059:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087070:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087078:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087089:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a92b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087094:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a92b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087099:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a92b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087175:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a92b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087183:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a92b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087188:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a92b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143779.087195:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143779.087251:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087256:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087262:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087267:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087272:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143779.087275:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087281:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087290:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143779.087292:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143779.087295:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.087300:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75000/0x87925e4cb73a92aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.095773:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a92b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.095785:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a92b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.095791:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a92b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.095795:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143779.095798:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a92b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.095804:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a92b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.095818:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e030300) 00010000:00010000:1.0:1746143779.095821:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143779.095823:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a92b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.095827:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73a92b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.095886:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75200/0x87925e4cb73a92a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b05c expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.095896:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a92b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b05c expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.095902:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143779.095904:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143779.095945:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:1.0:1746143779.096008:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32186:x1830963622546176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9045us (9771us total) trans 8589943637 rc 0/0 00000100:00100000:1.0:1746143779.096016:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12879 00000100:00100000:0.0:1746143779.101566:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.101666:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622546432 00000100:00100000:2.0:1746143779.101674:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622546432 00000100:00100000:0.0:1746143779.103381:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.104428:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 758 00000100:00100000:1.0:1746143779.104442:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622546432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.104459:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.104482:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73a92b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b05c expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.105652:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143779.105658:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.105705:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622546432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1266us (4145us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.105712:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 758 00000100:00100000:1.0:1746143779.107759:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622546304 00000100:00100000:1.0:1746143779.107767:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622546304 00000100:00080000:2.0:1746143779.108351:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143779.109004:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11871 00000100:00100000:3.0:1746143779.109015:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622546304:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.109031:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.109047:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a92c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b063 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.109091:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626753024:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143779.109162:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.109219:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.109308:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622546560 00000100:00100000:3.0:1746143779.109312:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622546560 00000100:00100000:3.0:1746143779.109336:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11872 00000100:00100000:3.0:1746143779.109341:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622546560:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.109350:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.109359:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0b800/0x87925e4cb73a92cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b06a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.109380:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626753152:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143779.109403:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746143779.109489:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1746143779.114266:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143778 -> 1746143779 00002000:00010000:3.0:1746143779.114273:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143778 -> 1746143779 00002000:00010000:3.0:1746143779.114274:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143778 -> 1746143779 00000100:00100000:3.0:1746143779.114292:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626753024:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143779.114317:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a92c6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b063 expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.114328:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0aa00/0x87925e4cb73a92c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b063 expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.114354:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0aa00, rc 0) 00000100:00100000:3.0:1746143779.114391:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622546304:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5378us (11011us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143779.114400:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11871 00002000:00010000:2.0:1746143779.115738:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143778 -> 1746143779 00002000:00010000:2.0:1746143779.115743:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143778 -> 1746143779 00002000:00010000:2.0:1746143779.115745:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143778 -> 1746143779 00000100:00100000:2.0:1746143779.115758:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626753152:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.115777:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d0b800/0x87925e4cb73a92cd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b06a expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.115786:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0b800/0x87925e4cb73a92cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b06a expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.115807:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b800, rc 0) 00000100:00100000:2.0:1746143779.115842:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622546560:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6499us (6622us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.115848:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11872 00000100:00100000:0.0:1746143779.131070:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.131099:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.131121:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.131146:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.131175:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622546816 00000100:00100000:0.0:1746143779.131182:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622546816 00002000:00100000:0.0:1746143779.131216:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800820da680 x1830963622546816/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.131225:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820da680 with x1830963622546816 ext(0->1048575) 00002000:00010000:0.0:1746143779.131229:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800820da680 00000100:00100000:0.0:1746143779.131246:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622547072 00000100:00100000:0.0:1746143779.131248:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622547072 00002000:00100000:0.0:1746143779.131258:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8800820daa00 x1830963622547072/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.131264:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820daa00 with x1830963622547072 ext(1048576->2097151) 00002000:00010000:0.0:1746143779.131267:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800820daa00 00000100:00100000:0.0:1746143779.131274:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622547584 00000100:00100000:0.0:1746143779.131275:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622547584 00002000:00100000:0.0:1746143779.131283:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b5:0x0] (1724416->2097151) req@ffff8800820dad80 x1830963622547584/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.131289:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820dad80 with x1830963622547584 ext(1724416->2097151) 00002000:00010000:0.0:1746143779.131292:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800820dad80 00000100:00100000:0.0:1746143779.131297:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622547456 00000100:00100000:0.0:1746143779.131299:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622547456 00002000:00100000:0.0:1746143779.131306:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1843199) req@ffff8800820db100 x1830963622547456/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.131312:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820db100 with x1830963622547456 ext(1048576->1843199) 00002000:00010000:0.0:1746143779.131314:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800820db100 00000100:00100000:0.0:1746143779.131328:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3432 00000100:00100000:0.0:1746143779.131334:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622546816:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143779.131804:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3433 00000100:00100000:1.0:1746143779.131812:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622547072:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143779.131946:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3434 00000100:00100000:2.0:1746143779.131954:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622547584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143779.132216:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3435 00000100:00100000:2.0:1746143779.132221:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622547456:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143779.143779:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.145365:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622547456:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13142us (14216us total) trans 0 rc 794624/794624 00000100:00100000:2.0:1746143779.145380:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3435 00002000:00100000:2.0:1746143779.145391:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1843199) req@ffff8800820db100 x1830963622547456/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 794624/794624 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.145401:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820db100 with x1830963622547456 ext(1048576->1843199) 00002000:00010000:2.0:1746143779.145406:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800820db100 00000100:00100000:1.0:1746143779.145550:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622547840 00000100:00100000:1.0:1746143779.145557:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622547840 00000100:00100000:3.0:1746143779.145821:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622547584:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13316us (14147us total) trans 0 rc 372736/372736 00000100:00100000:3.0:1746143779.145829:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3434 00002000:00100000:3.0:1746143779.145838:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1724416->2097151) req@ffff8800820dad80 x1830963622547584/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 372736/372736 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.145851:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820dad80 with x1830963622547584 ext(1724416->2097151) 00002000:00010000:3.0:1746143779.145853:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800820dad80 00000100:00080000:3.0:1746143779.145873:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143779.146523:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12880 00000100:00100000:1.0:1746143779.146531:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+267:32189:x1830963622547840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.146549:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.146565:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522400/0x87925e4cb73a92d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b071 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.146624:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146635:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146643:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146655:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522a00/0x87925e4cb73a92e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146660:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522a00/0x87925e4cb73a92e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146666:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522a00/0x87925e4cb73a92e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146745:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522000/0x87925e4cb73a92e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146754:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522000/0x87925e4cb73a92e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146764:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522000/0x87925e4cb73a92e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143779.146771:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143779.146832:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146837:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146841:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146846:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146850:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e523c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143779.146853:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146859:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146868:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143779.146871:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143779.146874:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146878:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523c00/0x87925e4cb73a92db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146928:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522a00/0x87925e4cb73a92e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146937:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522a00/0x87925e4cb73a92e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146941:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522a00/0x87925e4cb73a92e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146945:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e522a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143779.146947:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522a00/0x87925e4cb73a92e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146951:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522a00/0x87925e4cb73a92e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146957:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e030700) 00010000:00010000:1.0:1746143779.146958:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143779.146960:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522a00/0x87925e4cb73a92e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146964:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522a00/0x87925e4cb73a92e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.146995:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522400/0x87925e4cb73a92d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b071 expref: 270 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.147005:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522000/0x87925e4cb73a92e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b071 expref: 269 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.147010:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143779.147011:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143779.147013:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e522000, rc 0) 00000100:00100000:1.0:1746143779.147041:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+269:32189:x1830963622547840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 511us (3267us total) trans 8589943638 rc 0/0 00000100:00100000:1.0:1746143779.147048:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12880 00000100:00100000:1.0:1746143779.152343:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622547072:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20524us (21234us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143779.152353:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3433 00002000:00100000:1.0:1746143779.152363:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8800820daa00 x1830963622547072/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.152371:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820daa00 with x1830963622547072 ext(1048576->2097151) 00002000:00010000:1.0:1746143779.152376:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800820daa00 00000100:00100000:0.0:1746143779.157556:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.157615:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622547968 00000100:00100000:2.0:1746143779.157624:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622547968 00000100:00100000:0.0:1746143779.157648:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.157674:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622548096 00000100:00100000:2.0:1746143779.157676:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622548096 00000100:00100000:0.0:1746143779.157685:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11873 00000100:00100000:0.0:1746143779.157693:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622547968:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143779.157695:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11874 00000100:00100000:2.0:1746143779.157699:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622548096:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.157708:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.157708:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.157723:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a92fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b07f expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.157723:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a92f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b078 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.157761:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626753280:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143779.157761:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800820dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626753408:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.157825:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00080000:3.0:1746143779.158169:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143779.158173:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143779.160188:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.160238:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.160514:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622548224 00000100:00100000:3.0:1746143779.160521:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622548224 00000100:00100000:3.0:1746143779.160562:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 759 00000100:00100000:3.0:1746143779.160569:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+269:2009:x1830963622548224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.160582:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.160602:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522000/0x87925e4cb73a92e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b071 expref: 269 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.160624:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.160627:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.160644:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+268:2009:x1830963622548224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.160649:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 759 00000100:00100000:1.0:1746143779.160928:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622546816:12345-192.168.202.3@tcp:3:cat.0 Request processed in 29593us (29864us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143779.160936:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3432 00002000:00100000:1.0:1746143779.160944:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800820da680 x1830963622546816/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.160953:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820da680 with x1830963622546816 ext(0->1048575) 00002000:00010000:1.0:1746143779.160956:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800820da680 00000100:00100000:0.0:1746143779.161308:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626753280:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143779.161331:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a92fe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b07f expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.161342:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a92fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b07f expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.161360:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30200, rc 0) 00000100:00100000:0.0:1746143779.161391:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622548096:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3690us (3742us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143779.161396:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11874 00000100:00100000:2.0:1746143779.164272:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800820dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626753408:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.164299:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a92f7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b078 expref: 32 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.164310:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73a92f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b078 expref: 32 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.164332:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369e00, rc 0) 00000100:00100000:2.0:1746143779.164369:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622547968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6676us (6822us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.164375:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11873 00000100:00100000:0.0:1746143779.178997:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.179042:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.179101:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622548352 00000100:00100000:2.0:1746143779.179106:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622548480 00000100:00100000:2.0:1746143779.179109:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622548480 00000100:00100000:1.0:1746143779.179109:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622548352 00000100:00100000:2.0:1746143779.179159:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11875 00000100:00100000:1.0:1746143779.179163:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11876 00000100:00100000:2.0:1746143779.179168:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622548480:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143779.179168:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622548352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.179182:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.179182:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.179196:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30200/0x87925e4cb73a9305 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b08d expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.179196:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e522400/0x87925e4cb73a930c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b086 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.179233:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626753664:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143779.179233:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626753536:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.179294:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.179300:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.180111:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.180145:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.180150:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622548864 00000100:00100000:1.0:1746143779.180154:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622548864 00002000:00100000:1.0:1746143779.180177:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800820d9180 x1830963622548864/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.180186:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820d9180 with x1830963622548864 ext(0->1048575) 00002000:00010000:1.0:1746143779.180190:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800820d9180 00000100:00100000:2.0:1746143779.180201:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622548608 00000100:00100000:1.0:1746143779.180202:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3436 00000100:00100000:2.0:1746143779.180204:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622548608 00000100:00100000:1.0:1746143779.180206:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622548864:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143779.180224:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12881 00000100:00100000:2.0:1746143779.180229:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:32190:x1830963622548608:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143779.180239:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.180249:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b094 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.180286:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.180295:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.180302:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.180310:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b24c00/0x87925e4cb73a9321 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.180315:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b24c00/0x87925e4cb73a9321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.180318:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b24c00/0x87925e4cb73a9321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.180379:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.180387:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af8a expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.180393:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.180417:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af8a expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.180427:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af8a expref: 13 pid: 6587 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.180435:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626753792:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.180716:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.189262:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.189287:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622548992 00000100:00100000:0.0:1746143779.189294:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622548992 00010000:00010000:0.0:1746143779.189325:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af8a expref: 14 pid: 6587 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.189352:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5594 00000100:00100000:0.0:1746143779.189358:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622548992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143779.189370:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143779.189375:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af8a expref: 14 pid: 6587 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.189385:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af8a expref: 14 pid: 6587 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.189404:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143779.189409:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143779.189418:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143779.189425:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143779.189440:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.189477:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622548992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 118us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.189483:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5594 00000100:00100000:2.0:1746143779.189744:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626753664:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.189769:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30200/0x87925e4cb73a9305 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b08d expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.189778:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30200/0x87925e4cb73a9305 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b08d expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.189790:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30200, rc 0) 00000100:00100000:2.0:1746143779.189834:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622548480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 10668us (10791us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.189840:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11875 00000100:00100000:1.0:1746143779.190799:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626753536:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143779.190816:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e522400/0x87925e4cb73a930c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b086 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.190825:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e522400/0x87925e4cb73a930c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b086 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.190850:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e522400, rc 0) 00000100:00100000:1.0:1746143779.190883:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622548352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11714us (11893us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143779.190888:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11876 00010000:00010000:3.0:1746143779.191808:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a918b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af8a expref: 13 pid: 6587 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.191835:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626753792:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.191850:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.191857:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.191862:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143779.191900:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:3.0:1746143779.191927:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143779.191944:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.191954:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.191963:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.191968:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.191973:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.191978:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.191982:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.191986:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.191991:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.192003:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143779.192006:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.192008:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.192013:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a931a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.192022:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b24c00/0x87925e4cb73a9321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.192028:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b24c00/0x87925e4cb73a9321 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.192032:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b24c00/0x87925e4cb73a9321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.192035:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b24c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.192037:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b24c00/0x87925e4cb73a9321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.192041:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b24c00/0x87925e4cb73a9321 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.192046:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008219eb00) 00010000:00010000:3.0:1746143779.192048:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.192050:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b24c00/0x87925e4cb73a9321 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.192053:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b24c00/0x87925e4cb73a9321 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.192076:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b094 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.192086:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b094 expref: 7 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.192096:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.192098:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143779.192099:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b25a00, rc 0) 00000100:00100000:3.0:1746143779.192135:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32190:x1830963622548608:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 11904us (11988us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.192141:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12881 00000100:00100000:1.0:1746143779.193942:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963622548864:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13729us (13826us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143779.193951:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3436 00002000:00100000:1.0:1746143779.193961:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff8800820d9180 x1830963622548864/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.193974:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820d9180 with x1830963622548864 ext(0->1048575) 00002000:00010000:1.0:1746143779.193979:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800820d9180 00000100:00100000:2.0:1746143779.196495:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.196531:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.196558:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.196571:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.196588:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622549120 00000100:00100000:2.0:1746143779.196595:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622549120 00000100:00100000:2.0:1746143779.196625:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622549376 00000100:00100000:2.0:1746143779.196627:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622549376 00000100:00100000:2.0:1746143779.196658:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622549632 00000100:00100000:2.0:1746143779.196660:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622549632 00000100:00100000:2.0:1746143779.196672:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622549248 00000100:00100000:2.0:1746143779.196673:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622549248 00000100:00100000:2.0:1746143779.196684:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11877 00000100:00100000:2.0:1746143779.196690:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32186:x1830963622549120:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.196703:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.196718:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b09b expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.196741:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.196748:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.196749:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.196752:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.196774:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.196784:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 25 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.196794:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626753920:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.196854:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ed80 going to sleep for 11 seconds 00000100:00080000:2.0:1746143779.196869:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746143779.196872:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143779.196884:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11878 00000100:00100000:2.0:1746143779.196891:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622549376:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143779.196897:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.196941:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9336 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0a9 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.196968:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626754048:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.197001:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.197014:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11879 00000100:00100000:2.0:1746143779.197020:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622549632:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143779.197028:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.197035:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a933d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0b7 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.197055:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626754176:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.197074:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.197102:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.197117:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622549504 00000100:00100000:2.0:1746143779.197120:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622549504 00000100:00100000:2.0:1746143779.197137:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11880 00000100:00100000:2.0:1746143779.197141:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622549248:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143779.197147:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.197153:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a9344 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0a2 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.197173:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626754304:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.197192:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.197464:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11881 00000100:00100000:0.0:1746143779.197472:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622549504:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143779.197479:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.197485:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a934b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0b0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.197504:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626754432:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143779.197524:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.200082:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.200209:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626753920:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.200239:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.200253:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28000, rc 0) 00000100:00100000:2.0:1746143779.200284:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32186:x1830963622549120:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3593us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.200291:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11877 00000100:00100000:2.0:1746143779.200313:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622549760 00000100:00100000:2.0:1746143779.200317:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622549760 00000100:00100000:2.0:1746143779.200337:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11882 00000100:00100000:2.0:1746143779.200342:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32183:x1830963622549760:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143779.200351:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.200362:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0be expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.200380:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a90ab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af36 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.200388:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a917d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af83 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.200394:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a9161 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af75 expref: 13 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.200403:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.200405:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.200407:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [65536->1048575] (req 65536->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.200428:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a9161 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af75 expref: 13 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.200437:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a9161 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af75 expref: 13 pid: 9586 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.200446:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626754560:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.200493:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a917d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af83 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.200500:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a917d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af83 expref: 25 pid: 9586 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.200507:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626754688:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.200531:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a90ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af36 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.200539:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a90ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af36 expref: 14 pid: 9587 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143779.200551:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626754816:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.200566:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.201245:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.202442:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622549888 00000100:00100000:1.0:1746143779.202449:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622549888 00002000:00100000:1.0:1746143779.202483:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2617344->3145727) req@ffff880096fd9880 x1830963622549888/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.202493:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd9880 with x1830963622549888 ext(2617344->3145727) 00010000:00010000:1.0:1746143779.202499:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 26 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.202509:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 26 pid: 9839 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143779.202515:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd9880 00000100:00100000:1.0:1746143779.202530:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1435 00000100:00100000:1.0:1746143779.202537:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622549888:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143779.203073:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626754176:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.203096:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a933d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0b7 expref: 15 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.203106:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a933d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0b7 expref: 15 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.203119:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31200, rc 0) 00000100:00100000:2.0:1746143779.203146:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622549632:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 6125us (6587us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.203153:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11879 00000100:00100000:3.0:1746143779.203329:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626754048:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143779.203351:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9336 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0a9 expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.203359:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9336 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0a9 expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.203369:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:3.0:1746143779.203395:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622549376:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 6504us (6863us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143779.203400:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11878 00000100:00100000:3.0:1746143779.205021:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.205040:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622550016 00000100:00100000:3.0:1746143779.205046:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622550016 00010000:00010000:3.0:1746143779.205068:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a90ab lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af36 expref: 13 pid: 9587 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143779.205090:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5595 00000100:00100000:3.0:1746143779.205096:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622550016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.205106:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.205119:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a90ab lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af36 expref: 13 pid: 9587 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143779.205127:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a90ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af36 expref: 13 pid: 9587 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143779.205146:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.205165:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622550016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 70us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.205171:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5595 00010000:00010000:2.0:1746143779.205281:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73a90ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af36 expref: 12 pid: 9587 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143779.205291:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626754816:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143779.205471:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626754304:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143779.205494:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a9344 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0a2 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.205503:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5a00/0x87925e4cb73a9344 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0a2 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.205525:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb5a00, rc 0) 00000100:00100000:1.0:1746143779.205557:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622549248:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 8414us (8984us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143779.205563:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11880 00000100:00100000:2.0:1746143779.206228:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626754560:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143779.206302:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626754432:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143779.206318:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a934b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0b0 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.206326:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a934b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0b0 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.206337:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369800, rc 0) 00000100:00100000:0.0:1746143779.206356:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622549504:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 8885us (9253us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143779.206361:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11881 00000100:00100000:0.0:1746143779.208982:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.209002:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622550144 00000100:00100000:0.0:1746143779.209008:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622550144 00010000:00010000:0.0:1746143779.209032:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a9161 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af75 expref: 14 pid: 9586 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.209054:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5596 00000100:00100000:0.0:1746143779.209060:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622550144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143779.209071:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143779.209087:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a9161 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af75 expref: 14 pid: 9586 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.209095:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a9161 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af75 expref: 14 pid: 9586 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.209110:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73a9161 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af75 expref: 14 pid: 9586 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.209122:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.209146:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622550144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.209152:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5596 00000100:00100000:3.0:1746143779.209871:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626754688:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.209898:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [65536->1048575] (req 65536->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.209934:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4800, rc 0) 00000100:00100000:3.0:1746143779.209959:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32183:x1830963622549760:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9616us (9884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.209964:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11882 00000100:00100000:0.0:1746143779.212051:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.212290:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622550400 00000100:00100000:3.0:1746143779.212297:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622550400 00000100:00100000:3.0:1746143779.212378:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12882 00000100:00100000:3.0:1746143779.212384:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+268:32192:x1830963622550400:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143779.212403:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.212418:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73a9359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0c5 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.212477:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00000100:00100000:2.0:1746143779.212486:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622549888:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9949us (11241us total) trans 21474840334 rc 0/0 00010000:00010000:3.0:1746143779.212487:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00000100:00100000:2.0:1746143779.212494:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1435 00010000:00010000:3.0:1746143779.212495:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00002000:00100000:2.0:1746143779.212501:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2617344->3145727) req@ffff880096fd9880 x1830963622549888/t21474840334(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143779.212505:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a9367 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212510:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a9367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00002000:00100000:2.0:1746143779.212510:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd9880 with x1830963622549888 ext(2617344->3145727) 00010000:00010000:3.0:1746143779.212514:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a9367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.212517:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 28 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.212525:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 28 pid: 9839 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143779.212531:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd9880 00010000:00010000:3.0:1746143779.212676:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212684:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212690:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143779.212696:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143779.212749:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212754:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212762:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212767:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212772:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.212775:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212780:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212788:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143779.212791:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.212794:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212798:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73a9360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212812:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a9367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212816:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a9367 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212820:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a9367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212823:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.212826:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a9367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212833:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a9367 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212838:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22000) 00010000:00010000:3.0:1746143779.212840:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.212841:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a9367 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212845:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73a9367 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.212873:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73a9359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0c5 expref: 271 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.212883:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0c5 expref: 270 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.212888:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.212890:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143779.212892:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32000, rc 0) 00000100:00100000:3.0:1746143779.212935:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+270:32192:x1830963622550400:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 551us (889us total) trans 8589943639 rc 0/0 00000100:00100000:3.0:1746143779.212941:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12882 00000100:00100000:0.0:1746143779.213144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.213961:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622550528 00000100:00100000:3.0:1746143779.213967:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622550528 00010000:00010000:3.0:1746143779.213984:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a917d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af83 expref: 28 pid: 9586 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.214414:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.214617:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622550784 00000100:00100000:2.0:1746143779.214621:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622550784 00000100:00100000:3.0:1746143779.214630:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5597 00000100:00100000:3.0:1746143779.214637:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622550528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143779.214642:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12883 00000100:00100000:2.0:1746143779.214646:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32190:x1830963622550784:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143779.214648:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143779.214662:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.214663:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a917d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af83 expref: 28 pid: 9586 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.214671:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a917d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af83 expref: 28 pid: 9586 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.214671:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7e00/0x87925e4cb73a937c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0cc expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.214684:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a917d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af83 expref: 28 pid: 9586 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.214695:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.214697:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.214702:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.214708:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.214731:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.214735:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00000100:00100000:3.0:1746143779.214741:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626754944:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143779.214743:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b094 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.214749:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0c5 expref: 269 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.214754:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.214771:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0c5 expref: 269 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.214779:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0c5 expref: 269 pid: 10936 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.214783:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.214786:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626755072:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.214811:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b094 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.214818:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b094 expref: 8 pid: 10936 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.214825:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626755200:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.214839:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.215216:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.216001:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622550912 00000100:00100000:1.0:1746143779.216005:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622550912 00010000:00010000:1.0:1746143779.216020:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 28 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143779.216045:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5598 00000100:00100000:1.0:1746143779.216050:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622550912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.216058:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.216069:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 28 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.216076:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 28 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.216088:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73a9272 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b047 expref: 28 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.216109:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.216110:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.216115:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.216121:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.216143:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143779.216151:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626755328:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143779.216195:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.216377:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.216443:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622551040 00000100:00100000:2.0:1746143779.216447:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622551040 00000100:00100000:2.0:1746143779.216469:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11883 00000100:00100000:2.0:1746143779.216474:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:32189:x1830963622551040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.216484:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.216493:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0d3 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.216507:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.216516:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.216517:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.216519:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.216533:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.216541:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 10 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.216549:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626755456:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.216572:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.231125:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.231159:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.231200:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.231394:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622551168 00000100:00100000:3.0:1746143779.231402:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622551168 00000100:00100000:2.0:1746143779.231415:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626755072:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.231424:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626755200:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.231427:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0c5 expref: 270 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.231441:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:2.0:1746143779.231458:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622551552 00000100:00100000:2.0:1746143779.231461:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622551552 00000100:00100000:3.0:1746143779.231462:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622551296 00000100:00100000:3.0:1746143779.231463:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622551296 00010000:00010000:3.0:1746143779.231471:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b094 expref: 9 pid: 10936 timeout: 938 lvb_type: 0 00002000:00100000:2.0:1746143779.231484:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b3:0x0] (65536->69631) req@ffff880135b09880 x1830963622551552/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.231492:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09880 with x1830963622551552 ext(65536->69631) 00000100:00100000:3.0:1746143779.231494:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5599 00002000:00010000:2.0:1746143779.231496:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b09880 00000100:00100000:3.0:1746143779.231500:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+270:2009:x1830963622551168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143779.231507:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3437 00000100:00100000:2.0:1746143779.231512:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622551552:12345-192.168.202.3@tcp:3:multiop.0 00010000:00010000:3.0:1746143779.231513:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.231517:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0c5 expref: 270 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.231525:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0c5 expref: 270 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.231542:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a936e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0c5 expref: 270 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.231563:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.231567:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.231573:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.231577:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143779.231631:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622551552:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 117us (430us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143779.231637:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3437 00002000:00100000:2.0:1746143779.231642:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b3:0x0] (65536->69631) req@ffff880135b09880 x1830963622551552/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/4536 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143779.231718:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5600 00000100:00100000:1.0:1746143779.231725:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622551296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.231732:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.231736:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b094 expref: 9 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.231745:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b094 expref: 9 pid: 10936 timeout: 938 lvb_type: 0 00002000:00100000:2.0:1746143779.231752:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09880 with x1830963622551552 ext(65536->69631) 00002000:00010000:2.0:1746143779.231755:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b09880 00010000:00010000:1.0:1746143779.231755:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73a9328 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b094 expref: 9 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.231778:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143779.231781:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143779.231787:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143779.231793:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143779.231811:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.231829:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622551296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.231834:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5600 00000100:00100000:0.0:1746143779.231974:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626754944:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143779.231985:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.232080:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963622550528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 17442us (18935us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.232086:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5597 00010000:00010000:2.0:1746143779.232135:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.232140:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143779.232156:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143779.232253:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7e00/0x87925e4cb73a937c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0cc expref: 9 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.232268:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0cc expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.232274:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143779.232276:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143779.232278:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6a00, rc 0) 00000100:00100000:2.0:1746143779.232298:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32190:x1830963622550784:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 17651us (17884us total) trans 8589943640 rc 0/0 00000100:00100000:2.0:1746143779.232303:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12883 00000100:00100000:2.0:1746143779.232343:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.232356:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622551808 00000100:00100000:2.0:1746143779.232360:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622551808 00002000:00100000:2.0:1746143779.232373:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880096fd9f80 x1830963622551808/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.232547:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd9f80 with x1830963622551808 ext(2097152->3145727) 00002000:00010000:2.0:1746143779.232552:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd9f80 00000100:00100000:2.0:1746143779.232970:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3438 00000100:00100000:2.0:1746143779.232977:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622551808:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143779.233124:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+269:2009:x1830963622551168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1623us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.233129:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5599 00000100:00100000:1.0:1746143779.239102:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.239225:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626755328:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143779.239240:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.239275:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622550912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 23224us (24058us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.239285:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5598 00000100:00100000:0.0:1746143779.239338:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622551936 00000100:00100000:0.0:1746143779.239342:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622551936 00002000:00100000:0.0:1746143779.239366:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1843200->2097151) req@ffff88009e490a80 x1830963622551936/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.239375:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490a80 with x1830963622551936 ext(1843200->2097151) 00010000:00010000:0.0:1746143779.239382:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 11 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.239393:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 11 pid: 9839 timeout: 938 lvb_type: 0 00002000:00010000:0.0:1746143779.239398:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e490a80 00000100:00100000:0.0:1746143779.239410:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1436 00000100:00100000:0.0:1746143779.239416:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622551936:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143779.239795:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626755456:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.239826:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.239837:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6800, rc 0) 00000100:00100000:3.0:1746143779.239871:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:32189:x1830963622551040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 23396us (23494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.239877:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11883 00000100:00100000:3.0:1746143779.241131:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622551808:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8152us (8785us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143779.241138:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3438 00002000:00100000:3.0:1746143779.241144:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880096fd9f80 x1830963622551808/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.241152:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd9f80 with x1830963622551808 ext(2097152->3145727) 00002000:00010000:3.0:1746143779.241155:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd9f80 00000100:00100000:1.0:1746143779.241646:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.242005:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622552192 00000100:00100000:2.0:1746143779.242011:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622552192 00000100:00100000:2.0:1746143779.242044:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12884 00000100:00100000:2.0:1746143779.242049:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32190:x1830963622552192:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143779.242064:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.242066:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143779.242085:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a9383 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0cc expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.242097:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143779.242100:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143779.242108:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73a9398 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0da expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.242176:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a939f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.242186:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a939f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.242193:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a939f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.242202:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a939f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.242206:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a939f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.242212:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a939f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.242217:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143779.242220:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a939f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.242226:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a939f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.242231:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143779.242233:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143779.242235:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a939f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.242238:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a939f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.242252:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73a9398 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0da expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.242258:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73a9398 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0da expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.242268:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849a00, rc 0) 00000100:00100000:2.0:1746143779.242304:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32190:x1830963622552192:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 255us (659us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.242309:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12884 00000100:00100000:2.0:1746143779.249853:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622551936:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 10424us (10746us total) trans 17179873010 rc 0/0 00000100:00100000:2.0:1746143779.249867:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1436 00002000:00100000:2.0:1746143779.249880:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1843200->2097151) req@ffff88009e490a80 x1830963622551936/t17179873010(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.249889:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490a80 with x1830963622551936 ext(1843200->2097151) 00010000:00010000:2.0:1746143779.249899:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 13 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.249951:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 13 pid: 9839 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143779.249958:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e490a80 00000100:00100000:0.0:1746143779.251010:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.251058:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.251182:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622552576 00000100:00100000:2.0:1746143779.251191:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622552576 00000100:00100000:2.0:1746143779.251235:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11884 00000100:00100000:2.0:1746143779.251243:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32183:x1830963622552576:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143779.251262:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.251280:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0e1 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.251316:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a90b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af3d expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.251324:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73a91b5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afa6 expref: 31 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.251330:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a9199 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af91 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.251335:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.251336:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.251339:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.251366:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a9199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af91 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.251375:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a9199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af91 expref: 14 pid: 9586 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.251385:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626755584:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.251467:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73a91b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afa6 expref: 31 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.251475:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73a91b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afa6 expref: 31 pid: 12327 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.251483:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626755712:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.251509:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a90b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af3d expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.251516:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a90b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af3d expref: 11 pid: 9586 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143779.251523:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626755840:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.251540:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.251615:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622552448 00000100:00100000:3.0:1746143779.251619:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622552448 00000100:00100000:3.0:1746143779.251646:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4722 00000100:00100000:3.0:1746143779.251651:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32190:x1830963622552448:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143779.251820:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32190:x1830963622552448:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 169us (813us total) trans 8589943641 rc 0/0 00000100:00100000:3.0:1746143779.251827:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4722 00000100:00100000:0.0:1746143779.254970:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.255019:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.255117:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622552704 00000100:00100000:3.0:1746143779.255126:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622552704 00010000:00010000:3.0:1746143779.255168:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 15 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.255194:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622552832 00000100:00100000:3.0:1746143779.255196:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622552832 00010000:00010000:3.0:1746143779.255205:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a9199 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af91 expref: 16 pid: 9586 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.255401:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5601 00000100:00100000:0.0:1746143779.255411:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622552704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143779.255427:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143779.255451:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 16 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.255468:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 16 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.255493:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73a9202 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840aff3 expref: 16 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.255512:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.255514:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.255520:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.255527:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.255556:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.255567:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626755968:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143779.255640:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.255686:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5602 00000100:00100000:3.0:1746143779.255691:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622552832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.255699:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.255707:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a9199 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af91 expref: 15 pid: 9586 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.255714:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a9199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af91 expref: 15 pid: 9586 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.255726:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.255746:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622552832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 54us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.255750:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5602 00010000:00010000:3.0:1746143779.255787:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082087000/0x87925e4cb73a9199 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af91 expref: 14 pid: 9586 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.255796:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626755584:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.255803:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626755712:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.255809:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626755840:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.255834:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.255842:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849800, rc 0) 00000100:00100000:3.0:1746143779.255857:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32183:x1830963622552576:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4616us (4799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.255863:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11884 00000100:00100000:0.0:1746143779.259150:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.259190:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.259217:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.259278:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622553088 00000100:00100000:1.0:1746143779.259289:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622553088 00000100:00100000:0.0:1746143779.259310:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626755968:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143779.259323:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622552960 00010000:00010000:1.0:1746143779.259326:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a90b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af3d expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143779.259328:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622552960 00010000:00010000:0.0:1746143779.259334:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.259362:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622553216 00000100:00100000:1.0:1746143779.259365:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622553216 00000100:00100000:3.0:1746143779.259366:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11885 00000100:00100000:3.0:1746143779.259373:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32186:x1830963622552960:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.259377:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73a91b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afa6 expref: 32 pid: 12327 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.259381:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622552704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3971us (4476us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143779.259390:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143779.259390:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5601 00000100:00100000:1.0:1746143779.259395:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5603 00000100:00100000:1.0:1746143779.259402:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622553088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.259408:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0e8 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.259413:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143779.259413:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5604 00000100:00100000:0.0:1746143779.259419:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622553216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143779.259427:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.259430:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a90b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af3d expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143779.259433:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 32 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.259440:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143779.259441:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a90b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af3d expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143779.259442:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143779.259446:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.259473:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 32 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.259483:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 32 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.259495:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626756096:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.259556:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143779.259901:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73a91b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afa6 expref: 32 pid: 12327 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.259942:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73a90b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af3d expref: 12 pid: 9586 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143779.259948:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73a91b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afa6 expref: 32 pid: 12327 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.259964:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73a91b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afa6 expref: 32 pid: 12327 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.259967:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.259968:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.259975:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.259982:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.260054:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.260073:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622553216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 653us (854us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143779.260074:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.260080:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5604 00000100:00100000:1.0:1746143779.260084:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e493b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626756224:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143779.260189:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.265733:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.265812:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622553600 00000100:00100000:2.0:1746143779.265824:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622553600 00000100:00100000:1.0:1746143779.265848:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143779.265881:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2121727) req@ffff88009e492a00 x1830963622553600/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.265891:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e492a00 with x1830963622553600 ext(2097152->2121727) 00010000:00010000:2.0:1746143779.265901:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 31 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.265948:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 31 pid: 9839 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143779.265955:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e492a00 00000100:00100000:3.0:1746143779.265971:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626756096:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.265977:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622553472 00000100:00100000:2.0:1746143779.265980:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622553472 00002000:00100000:2.0:1746143779.265993:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012e358700 x1830963622553472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143779.265997:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143779.266004:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358700 with x1830963622553472 ext(1048576->2097151) 00002000:00010000:2.0:1746143779.266007:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e358700 00010000:00010000:3.0:1746143779.266011:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32000, rc 0) 00000100:00100000:2.0:1746143779.266026:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1437 00000100:00100000:2.0:1746143779.266034:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622553600:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143779.266049:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32186:x1830963622552960:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6676us (6911us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.266057:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11885 00000100:00100000:3.0:1746143779.266094:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3439 00000100:00100000:3.0:1746143779.266101:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963622553472:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143779.266203:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e493b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626756224:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143779.266221:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.267067:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622553088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7664us (7874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.267078:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5603 00000100:00100000:0.0:1746143779.267144:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.267165:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622553856 00000100:00100000:0.0:1746143779.267169:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622553856 00002000:00100000:0.0:1746143779.267191:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1064960->1069055) req@ffff880135b09f80 x1830963622553856/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.267198:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09f80 with x1830963622553856 ext(1064960->1069055) 00002000:00010000:0.0:1746143779.267201:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b09f80 00000100:00100000:0.0:1746143779.267794:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3440 00000100:00100000:0.0:1746143779.267802:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622553856:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143779.267900:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622553856:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 99us (755us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143779.267935:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3440 00002000:00100000:0.0:1746143779.267941:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1064960->1069055) req@ffff880135b09f80 x1830963622553856/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/4536 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.267949:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09f80 with x1830963622553856 ext(1064960->1069055) 00002000:00010000:0.0:1746143779.267952:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b09f80 00000100:00100000:2.0:1746143779.273498:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622553600:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7454us (7762us total) trans 17179873011 rc 0/0 00000100:00100000:2.0:1746143779.273511:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1437 00002000:00100000:2.0:1746143779.273524:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2121727) req@ffff88009e492a00 x1830963622553600/t17179873011(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.273534:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e492a00 with x1830963622553600 ext(2097152->2121727) 00010000:00010000:2.0:1746143779.273545:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 35 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.273559:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 35 pid: 9839 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143779.273566:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e492a00 00000100:00100000:0.0:1746143779.277024:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.277160:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622554112 00000100:00100000:2.0:1746143779.277170:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622554112 00000100:00100000:2.0:1746143779.277228:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4723 00000100:00100000:2.0:1746143779.277237:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32183:x1830963622554112:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143779.277490:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32183:x1830963622554112:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 254us (478us total) trans 8589943642 rc 0/0 00000100:00100000:2.0:1746143779.277501:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4723 00000100:00100000:0.0:1746143779.278412:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.278511:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622554240 00000100:00100000:2.0:1746143779.278517:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622554240 00010000:00010000:2.0:1746143779.278549:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 35 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.278618:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5605 00000100:00100000:2.0:1746143779.278626:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622554240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143779.278638:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143779.278658:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 35 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.278670:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 35 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.278695:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73a9279 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b04e expref: 35 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.278711:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.278714:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.278721:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.278729:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.278765:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.278778:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626756352:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143779.279712:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.279850:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622553472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13747us (13999us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143779.279859:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3439 00002000:00100000:3.0:1746143779.279869:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012e358700 x1830963622553472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.279879:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358700 with x1830963622553472 ext(1048576->2097151) 00002000:00010000:3.0:1746143779.279884:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e358700 00000100:00100000:3.0:1746143779.280367:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626756352:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143779.280387:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.280446:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622554240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1820us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.280454:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5605 00000100:00100000:0.0:1746143779.287712:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.288016:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622554368 00000100:00100000:3.0:1746143779.288025:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622554368 00000100:00100000:3.0:1746143779.288069:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11886 00000100:00100000:3.0:1746143779.288076:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:32189:x1830963622554368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.288094:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.288112:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0ef expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.288144:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.288151:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143779.288153:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143779.288156:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.288187:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.288198:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 11 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.288643:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626756480:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.289388:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.292293:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626756480:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.292325:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.292341:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32600, rc 0) 00000100:00100000:3.0:1746143779.292377:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:32189:x1830963622554368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4301us (4677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.292386:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11886 00000100:00100000:0.0:1746143779.292575:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.292641:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.292710:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622554880 00000100:00100000:2.0:1746143779.292716:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622554880 00002000:00100000:2.0:1746143779.292745:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880135b0b800 x1830963622554880/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.292754:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0b800 with x1830963622554880 ext(2097152->4194303) 00002000:00010000:2.0:1746143779.292759:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b0b800 00000100:00100000:2.0:1746143779.292786:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622554752 00000100:00100000:2.0:1746143779.292788:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622554752 00002000:00100000:2.0:1746143779.292798:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880135b0bb80 x1830963622554752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.292805:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0bb80 with x1830963622554752 ext(3145728->4194303) 00002000:00010000:2.0:1746143779.292807:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b0bb80 00000100:00100000:2.0:1746143779.292818:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3441 00000100:00100000:2.0:1746143779.292823:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622554880:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143779.293955:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3442 00000100:00100000:2.0:1746143779.293962:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622554752:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143779.298736:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.298839:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622555008 00000100:00100000:3.0:1746143779.298846:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622555008 00002000:00100000:3.0:1746143779.298880:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1724415) req@ffff88009e493b80 x1830963622555008/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.298889:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493b80 with x1830963622555008 ext(1048576->1724415) 00010000:00010000:3.0:1746143779.298897:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 14 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.298941:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 14 pid: 9839 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746143779.298948:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e493b80 00000100:00100000:3.0:1746143779.298962:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1438 00000100:00100000:3.0:1746143779.298969:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622555008:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143779.309731:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622554880:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 16899us (17148us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143779.309742:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3441 00002000:00100000:3.0:1746143779.309751:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880135b0b800 x1830963622554880/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.309761:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0b800 with x1830963622554880 ext(2097152->4194303) 00002000:00010000:3.0:1746143779.309765:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b0b800 00000100:00100000:2.0:1746143779.314947:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2010:x1830963622554752:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 20977us (22296us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143779.314956:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3442 00002000:00100000:2.0:1746143779.317725:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880135b0bb80 x1830963622554752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.317743:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0bb80 with x1830963622554752 ext(3145728->4194303) 00002000:00010000:2.0:1746143779.317748:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b0bb80 00000100:00100000:3.0:1746143779.318897:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622555008:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 19925us (20163us total) trans 21474840335 rc 0/0 00000100:00100000:3.0:1746143779.318933:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1438 00002000:00100000:3.0:1746143779.318943:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1724415) req@ffff88009e493b80 x1830963622555008/t21474840335(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.318950:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493b80 with x1830963622555008 ext(1048576->1724415) 00010000:00010000:3.0:1746143779.318958:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 14 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.318970:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 14 pid: 9839 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746143779.318975:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e493b80 00000100:00100000:0.0:1746143779.325164:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.325203:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.325308:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622555264 00000100:00100000:1.0:1746143779.325316:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622555264 00000100:00100000:1.0:1746143779.325346:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622555136 00000100:00100000:1.0:1746143779.325348:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622555136 00000100:00100000:1.0:1746143779.325372:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11887 00000100:00100000:1.0:1746143779.325378:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622555264:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.325394:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.325409:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa16e00/0x87925e4cb73a93bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0fd expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.325417:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11888 00000100:00100000:2.0:1746143779.325426:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622555136:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.325434:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.325443:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad800/0x87925e4cb73a93c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b0f6 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143779.325449:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626756608:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.325456:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.325458:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.325465:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad800/0x87925e4cb73a93c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0f6 expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.325477:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad800/0x87925e4cb73a93c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0f6 expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.325486:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5ad800, rc 0) 00000100:00100000:2.0:1746143779.325507:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622555136:12345-192.168.202.3@tcp:101:cat.0 Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.325508:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.325515:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11888 00000100:00100000:2.0:1746143779.326342:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.326403:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622555392 00000100:00100000:3.0:1746143779.326408:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622555392 00010000:00010000:3.0:1746143779.326425:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 16 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.326450:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5606 00000100:00100000:3.0:1746143779.326454:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622555392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.326463:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.326476:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 16 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.326485:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 16 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.326499:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.326500:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.326504:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.326510:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.326528:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.326535:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626756736:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143779.327425:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143779.330820:0:13436:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff880092b72a00 x1830963626756608) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 16 pid: 9839 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.330850:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7fc00/0x87925e4cb73a9209 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840affa expref: 16 pid: 9839 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143779.330876:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626756608:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143779.330900:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa16e00/0x87925e4cb73a93bb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0fd expref: 15 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.330937:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa16e00/0x87925e4cb73a93bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0fd expref: 15 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.330944:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa16e00, rc 0) 00000100:00100000:1.0:1746143779.330988:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622555264:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5609us (5830us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143779.330994:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11887 00000100:00100000:0.0:1746143779.335465:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.335559:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626756736:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143779.335579:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.335615:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622555392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9160us (9274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.335625:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5606 00000100:00100000:2.0:1746143779.336031:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622555648 00000100:00100000:2.0:1746143779.336037:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622555648 00002000:00100000:2.0:1746143779.336067:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880093ebf100 x1830963622555648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.336081:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ebf100 with x1830963622555648 ext(1048576->2097151) 00002000:00010000:2.0:1746143779.336085:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ebf100 00000100:00100000:2.0:1746143779.336098:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3443 00000100:00100000:2.0:1746143779.336103:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622555648:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143779.339734:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.339854:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622555904 00000100:00100000:2.0:1746143779.339862:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622555904 00002000:00100000:2.0:1746143779.339899:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880093ebf480 x1830963622555904/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.339946:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ebf480 with x1830963622555904 ext(4194304->4968447) 00002000:00010000:2.0:1746143779.339950:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ebf480 00000100:00100000:2.0:1746143779.339977:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3444 00000100:00100000:2.0:1746143779.339985:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622555904:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.345787:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622555904:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5795us (6053us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143779.345798:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3444 00002000:00100000:3.0:1746143779.345808:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880093ebf480 x1830963622555904/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.345816:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ebf480 with x1830963622555904 ext(4194304->4968447) 00002000:00010000:3.0:1746143779.345821:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ebf480 00000100:00100000:2.0:1746143779.345960:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622555648:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9855us (10501us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143779.345966:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3443 00002000:00100000:2.0:1746143779.345971:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880093ebf100 x1830963622555648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.345977:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ebf100 with x1830963622555648 ext(1048576->2097151) 00002000:00010000:2.0:1746143779.345980:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ebf100 00000100:00100000:0.0:1746143779.352811:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.352930:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622556032 00000100:00100000:1.0:1746143779.352939:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622556032 00000100:00100000:1.0:1746143779.352970:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11889 00000100:00100000:1.0:1746143779.352976:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622556032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.352991:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.353005:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a93c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b104 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.353027:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.353029:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.353035:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a93c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b104 expref: 14 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.353048:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a93c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b104 expref: 14 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.353057:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512a00, rc 0) 00000100:00100000:1.0:1746143779.353106:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622556032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 129us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.353112:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11889 00000100:00100000:0.0:1746143779.361628:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.361739:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622556288 00000100:00100000:3.0:1746143779.361748:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622556288 00000100:00100000:3.0:1746143779.361799:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4724 00000100:00100000:3.0:1746143779.361806:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e248c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32186:x1830963622556288:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143779.362217:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e248c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32186:x1830963622556288:12345-192.168.202.3@tcp:35:cat.0 Request processed in 411us (597us total) trans 8589943643 rc 0/0 00000100:00100000:3.0:1746143779.362224:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4724 00000100:00100000:0.0:1746143779.368570:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.368609:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.368637:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.368674:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.368749:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622556416 00000100:00100000:1.0:1746143779.368757:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622556416 00000100:00100000:1.0:1746143779.368793:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622556672 00000100:00100000:1.0:1746143779.368795:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622556672 00000100:00100000:1.0:1746143779.368803:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622556544 00000100:00100000:1.0:1746143779.368805:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622556544 00000100:00100000:1.0:1746143779.368814:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622556800 00000100:00100000:1.0:1746143779.368816:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622556800 00000100:00100000:1.0:1746143779.368828:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11890 00000100:00100000:1.0:1746143779.368834:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622556416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.368849:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.368866:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097384e00/0x87925e4cb73a93d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b10b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143779.368937:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626756864:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143779.368995:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.369010:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11891 00000100:00100000:1.0:1746143779.369015:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622556672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.369021:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.369026:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73a93d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b119 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.369035:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.369037:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.369043:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73a93d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b119 expref: 30 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.369055:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73a93d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b119 expref: 30 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.369063:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521a00, rc 0) 00000100:00100000:1.0:1746143779.370800:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622556672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1777us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.370809:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11891 00000100:00100000:1.0:1746143779.370829:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11892 00000100:00100000:1.0:1746143779.370837:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622556544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.370849:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.370862:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e521600/0x87925e4cb73a93de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b112 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143779.370894:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626756992:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143779.370959:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.370977:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11893 00000100:00100000:1.0:1746143779.370982:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622556800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.370989:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.370995:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73a93e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b120 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.371004:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.371006:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.371011:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73a93e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b120 expref: 35 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.371021:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73a93e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b120 expref: 35 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.371028:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e520e00, rc 0) 00000100:00100000:1.0:1746143779.371045:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622556800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 62us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.371049:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11893 00002000:00010000:1.0:1746143779.375038:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime: 1746143778 -> 1746143779 00002000:00010000:1.0:1746143779.375045:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime: 1746143778 -> 1746143779 00002000:00010000:1.0:1746143779.375047:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime: 1746143778 -> 1746143779 00000100:00100000:1.0:1746143779.375064:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626756864:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143779.375091:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097384e00/0x87925e4cb73a93d0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b10b expref: 29 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.375110:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097384e00/0x87925e4cb73a93d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b10b expref: 29 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.375124:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097384e00, rc 0) 00000100:00100000:1.0:1746143779.375161:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622556416:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6326us (6597us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143779.375169:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11890 00002000:00010000:2.0:1746143779.375334:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime: 1746143778 -> 1746143779 00002000:00010000:2.0:1746143779.375337:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143778 -> 1746143779 00002000:00010000:2.0:1746143779.375339:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime: 1746143778 -> 1746143779 00000100:00100000:2.0:1746143779.375349:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626756992:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.375365:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e521600/0x87925e4cb73a93de lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b112 expref: 34 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.375372:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e521600/0x87925e4cb73a93de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b112 expref: 34 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.375384:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521600, rc 0) 00000100:00100000:2.0:1746143779.375403:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622556544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4569us (6766us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.375408:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11892 00000100:00100000:0.0:1746143779.394739:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.394871:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.394959:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622557056 00000100:00100000:2.0:1746143779.394967:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622557056 00002000:00100000:2.0:1746143779.395005:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880093ebc380 x1830963622557056/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.395014:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ebc380 with x1830963622557056 ext(2097152->4194303) 00002000:00010000:2.0:1746143779.395019:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ebc380 00000100:00100000:1.0:1746143779.396323:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3445 00000100:00100000:1.0:1746143779.396332:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622557056:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.397525:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622557184 00000100:00100000:3.0:1746143779.397532:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622557184 00000100:00100000:3.0:1746143779.397573:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11894 00000100:00100000:3.0:1746143779.397579:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:32192:x1830963622557184:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143779.397588:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.397602:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b127 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.397624:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.399496:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a93c9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b104 expref: 13 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.399511:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.399513:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.399520:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.399552:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a93c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b104 expref: 13 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.399563:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a93c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b104 expref: 13 pid: 13436 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143779.399575:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626757120:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.399663:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.399671:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 31 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.399679:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626757248:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.399696:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.399756:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.399848:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622557440 00000100:00100000:3.0:1746143779.399853:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622557440 00002000:00100000:3.0:1746143779.399882:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800820d9c00 x1830963622557440/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.399890:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820d9c00 with x1830963622557440 ext(2097152->4194303) 00002000:00010000:3.0:1746143779.399894:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800820d9c00 00000100:00100000:3.0:1746143779.399945:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3446 00000100:00100000:3.0:1746143779.399952:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800820d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622557440:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143779.411703:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626757120:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.411716:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626757248:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.411743:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.411758:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7400, rc 0) 00000100:00100000:3.0:1746143779.412885:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:32192:x1830963622557184:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 15300us (18008us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.412894:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11894 00000100:00100000:0.0:1746143779.414491:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.415376:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.415480:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622557568 00000100:00100000:3.0:1746143779.415488:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622557568 00010000:00010000:3.0:1746143779.415520:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a93c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b104 expref: 14 pid: 13436 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143779.415544:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622557696 00000100:00100000:3.0:1746143779.415546:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622557696 00010000:00010000:3.0:1746143779.415555:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 31 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.415568:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5607 00000100:00100000:3.0:1746143779.415574:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622557568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.415586:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.415604:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a93c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b104 expref: 14 pid: 13436 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143779.415618:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a93c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b104 expref: 14 pid: 13436 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143779.415637:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a93c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b104 expref: 14 pid: 13436 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143779.415671:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.415706:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622557568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 131us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.415712:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5607 00000100:00100000:3.0:1746143779.415726:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5608 00000100:00100000:3.0:1746143779.415730:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622557696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.415737:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.415744:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 31 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.415752:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 31 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.415763:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a93b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0ef expref: 31 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.415772:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.415774:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.415779:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 30 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.415786:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 30 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.415812:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 30 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.415823:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626757376:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143779.415871:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.423449:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626757376:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143779.423467:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143779.423505:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622557696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7773us (8128us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.423515:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5608 00000100:00100000:3.0:1746143779.424202:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800820d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622557440:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 24248us (24445us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143779.424212:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3446 00002000:00100000:3.0:1746143779.424221:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800820d9c00 x1830963622557440/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.424230:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800820d9c00 with x1830963622557440 ext(2097152->4194303) 00002000:00010000:3.0:1746143779.424234:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800820d9c00 00000100:00100000:1.0:1746143779.429156:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963622557056:12345-192.168.202.3@tcp:3:cat.0 Request processed in 32817us (34418us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143779.429167:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3445 00002000:00100000:1.0:1746143779.429177:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880093ebc380 x1830963622557056/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.429185:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ebc380 with x1830963622557056 ext(2097152->4194303) 00002000:00010000:1.0:1746143779.429190:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ebc380 00000100:00100000:0.0:1746143779.439469:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.439864:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622557824 00000100:00100000:3.0:1746143779.439872:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622557824 00000100:00100000:0.0:1746143779.440104:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.440167:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622558080 00000100:00100000:3.0:1746143779.440169:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622558080 00000100:00100000:3.0:1746143779.440196:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11895 00000100:00100000:3.0:1746143779.440202:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:32192:x1830963622557824:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143779.440217:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.440232:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b12e expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.440259:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.440267:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73a93d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b119 expref: 29 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.440273:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.440274:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.440277:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->2854911] (req 2097152->2854911) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.440299:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73a93d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b119 expref: 29 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.440307:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73a93d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b119 expref: 29 pid: 9587 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143779.440316:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626757504:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.440380:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.440387:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 12 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.440393:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626757632:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.440408:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.440621:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11896 00000100:00100000:2.0:1746143779.440630:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622558080:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.440638:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.440647:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408fe00/0x87925e4cb73a93fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b13c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.440671:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626757760:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.440691:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.441785:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.441836:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622557952 00000100:00100000:1.0:1746143779.441840:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622557952 00000100:00100000:1.0:1746143779.441858:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11897 00000100:00100000:1.0:1746143779.441863:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622557952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.441870:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.441877:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73a9401 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b135 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143779.441928:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626757888:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143779.441972:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.450383:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626757504:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.450395:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626757632:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.450422:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->2854911] (req 2097152->2854911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.450439:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6a00, rc 0) 00000100:00100000:3.0:1746143779.450484:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:32192:x1830963622557824:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10281us (11021us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.450492:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11895 00000100:00100000:0.0:1746143779.452090:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.452131:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622558208 00000100:00100000:2.0:1746143779.452137:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622558208 00010000:00010000:2.0:1746143779.452163:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73a93d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b119 expref: 31 pid: 9587 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143779.452192:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5609 00000100:00100000:2.0:1746143779.452199:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622558208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143779.452210:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143779.452235:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73a93d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b119 expref: 31 pid: 9587 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143779.452245:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73a93d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b119 expref: 31 pid: 9587 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143779.452263:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73a93d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b119 expref: 31 pid: 9587 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143779.452307:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963626757760:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143779.452328:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408fe00/0x87925e4cb73a93fa lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b13c expref: 34 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.452337:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408fe00/0x87925e4cb73a93fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b13c expref: 34 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.452349:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408fe00, rc 0) 00000100:00100000:3.0:1746143779.452397:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622558080:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11768us (12292us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143779.452403:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11896 00000100:00100000:1.0:1746143779.453511:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626757888:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143779.453529:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73a9401 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b135 expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.453539:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73a9401 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b135 expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.453555:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521c00, rc 0) 00000100:00100000:1.0:1746143779.453595:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963622557952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11731us (11811us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143779.453601:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11897 00010000:00010000:2.0:1746143779.453697:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143779.453717:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622558208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1518us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.453723:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5609 00000100:00100000:3.0:1746143779.457275:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.457335:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622558336 00000100:00100000:2.0:1746143779.457343:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622558336 00010000:00010000:2.0:1746143779.457375:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 13 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.457411:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5610 00000100:00100000:2.0:1746143779.457419:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622558336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143779.457431:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143779.457448:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 13 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.457459:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 13 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.457476:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73a932f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b09b expref: 13 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.457489:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.457491:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.457497:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.457509:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.457538:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.457542:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.457548:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626758016:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143779.457600:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622558464 00000100:00100000:1.0:1746143779.457604:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622558464 00000100:00100000:1.0:1746143779.457626:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11898 00000100:00100000:1.0:1746143779.457630:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:32189:x1830963622558464:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.457642:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.457651:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b143 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.457666:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.457671:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143779.457673:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143779.457675:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4194304->4968447] (req 4194304->4968447) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.457692:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.457700:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 29 pid: 9587 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143779.457707:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626758144:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143779.457776:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.458580:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.460197:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626758144:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143779.460221:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4194304->4968447] (req 4194304->4968447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.460234:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e520c00, rc 0) 00000100:00100000:1.0:1746143779.460278:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+29:32189:x1830963622558464:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2647us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.460285:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11898 00000100:00100000:2.0:1746143779.460434:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626758016:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143779.460445:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143779.460463:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622558336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3046us (3195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.460470:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5610 00000100:00100000:0.0:1746143779.466250:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.466663:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622558720 00000100:00100000:1.0:1746143779.466671:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622558720 00002000:00100000:1.0:1746143779.466713:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2850816->2854911) req@ffff8800972e9180 x1830963622558720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.466722:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9180 with x1830963622558720 ext(2850816->2854911) 00010000:00010000:1.0:1746143779.466730:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 29 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.466742:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 29 pid: 9587 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143779.466749:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800972e9180 00000100:00100000:1.0:1746143779.467342:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1439 00000100:00100000:1.0:1746143779.467350:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622558720:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143779.467468:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622558720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 118us (1224us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143779.467474:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1439 00002000:00100000:1.0:1746143779.467479:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2850816->2854911) req@ffff8800972e9180 x1830963622558720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/4536 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.467486:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9180 with x1830963622558720 ext(2850816->2854911) 00010000:00010000:1.0:1746143779.467490:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 29 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.467498:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 29 pid: 9587 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143779.467503:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800972e9180 00000100:00100000:0.0:1746143779.476111:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.476205:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.476300:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622559104 00000100:00100000:3.0:1746143779.476309:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622559104 00000100:00100000:2.0:1746143779.476544:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622559232 00000100:00100000:2.0:1746143779.476548:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622559232 00002000:00100000:2.0:1746143779.476580:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->2854911) req@ffff880091bcb800 x1830963622559232/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143779.476585:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4725 00002000:00100000:2.0:1746143779.476589:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcb800 with x1830963622559232 ext(2097152->2854911) 00000100:00100000:3.0:1746143779.476594:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:32192:x1830963622559104:12345-192.168.202.3@tcp:35:multiop.0 00010000:00010000:2.0:1746143779.476596:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 29 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.476606:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 29 pid: 9587 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143779.476612:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bcb800 00000100:00100000:2.0:1746143779.476710:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1440 00000100:00100000:2.0:1746143779.476716:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622559232:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143779.476815:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:32192:x1830963622559104:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 222us (711us total) trans 8589943644 rc 0/0 00000100:00100000:3.0:1746143779.476821:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4725 00000100:00100000:0.0:1746143779.493528:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.493659:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622559360 00000100:00100000:1.0:1746143779.493669:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622559360 00000100:00100000:1.0:1746143779.493737:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12885 00000100:00100000:1.0:1746143779.493746:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32197:x1830963622559360:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143779.493778:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.493799:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a940f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b14a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.493871:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.493890:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.493955:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.493970:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a941d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.493976:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a941d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.493982:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a941d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494062:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494076:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494082:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143779.494124:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:1.0:1746143779.494128:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143779.494144:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494158:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494168:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494173:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494179:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494185:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494190:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e521200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143779.494197:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494203:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494213:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143779.494215:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143779.494219:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494223:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9416 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494240:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a941d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494245:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a941d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494250:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a941d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494255:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e521000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143779.494257:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a941d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494262:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a941d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494267:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e030200) 00010000:00010000:1.0:1746143779.494268:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143779.494274:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a941d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494278:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a941d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.494300:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a940f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b14a expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.494311:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b14a expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.494321:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143779.494323:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143779.494326:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521800, rc 0) 00000100:00100000:1.0:1746143779.494379:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32197:x1830963622559360:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 635us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.494386:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12885 00000100:00100000:2.0:1746143779.495416:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963622559232:12345-192.168.202.3@tcp:4:cat.0 Request processed in 18689us (19200us total) trans 21474840336 rc 0/0 00000100:00100000:2.0:1746143779.495428:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1440 00002000:00100000:2.0:1746143779.495439:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->2854911) req@ffff880091bcb800 x1830963622559232/t21474840336(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.495454:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bcb800 with x1830963622559232 ext(2097152->2854911) 00010000:00010000:2.0:1746143779.495464:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 31 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.495480:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 31 pid: 9587 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143779.495487:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bcb800 00000100:00100000:0.0:1746143779.497726:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.497763:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.497783:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.497809:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.497830:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622559488 00000100:00100000:0.0:1746143779.497843:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622559488 00000100:00100000:0.0:1746143779.497883:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622559616 00000100:00100000:0.0:1746143779.497884:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622559616 00000100:00100000:0.0:1746143779.497896:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622559744 00000100:00100000:0.0:1746143779.497897:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622559744 00000100:00100000:0.0:1746143779.497947:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622559872 00000100:00100000:0.0:1746143779.497949:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622559872 00000100:00100000:2.0:1746143779.497967:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11899 00000100:00100000:2.0:1746143779.498101:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622559488:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143779.498117:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.498133:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a942b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b151 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.498176:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626758272:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.498242:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.498246:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11900 00000100:00100000:0.0:1746143779.498262:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622559616:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143779.498264:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11901 00000100:00100000:2.0:1746143779.498270:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622559744:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143779.498277:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.498277:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.498292:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9432 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b158 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.498345:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626758400:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143779.498394:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.498428:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.498446:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622560000 00000100:00100000:0.0:1746143779.498449:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622560000 00000100:00100000:0.0:1746143779.498475:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11902 00010000:00010000:2.0:1746143779.498478:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a9439 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b15f expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.498481:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622559872:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143779.498488:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.498491:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.498493:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.498497:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b7800/0x87925e4cb73a9440 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b166 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.498499:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a9439 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b15f expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.498513:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a9439 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b15f expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.498522:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512200, rc 0) 00000100:00100000:0.0:1746143779.498530:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626758528:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.498542:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622559744:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 273us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.498547:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11901 00000100:00100000:0.0:1746143779.498559:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.498564:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11903 00000100:00100000:2.0:1746143779.498568:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622560000:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:0.0:1746143779.498630:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.498643:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622560128 00000100:00100000:0.0:1746143779.498646:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622560128 00000100:00100000:0.0:1746143779.498669:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11904 00000100:00100000:0.0:1746143779.498673:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622560128:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143779.498679:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.498686:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73a9447 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b174 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.498700:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.498702:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.498708:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73a9447 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b174 expref: 15 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.498720:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73a9447 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b174 expref: 15 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.498727:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5acc00, rc 0) 00000100:00100000:0.0:1746143779.498749:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622560128:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 76us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.498755:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11904 00010000:00010000:2.0:1746143779.498875:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.498882:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73a944e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b16d expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.499056:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626758656:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.499107:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.502463:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626758400:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143779.502493:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9432 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b158 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.502506:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9432 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b158 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.502524:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b400, rc 0) 00000100:00100000:1.0:1746143779.502570:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622559616:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 4309us (4805us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143779.502577:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11900 00000100:00100000:2.0:1746143779.502776:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626758272:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.502794:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a942b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b151 expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.502803:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a942b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b151 expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.502813:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ee00, rc 0) 00000100:00100000:2.0:1746143779.502833:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622559488:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 4742us (5116us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.502839:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11899 00000100:00100000:2.0:1746143779.504213:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626758528:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.504232:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7800/0x87925e4cb73a9440 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b166 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.504243:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7800/0x87925e4cb73a9440 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b166 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.504253:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7800, rc 0) 00000100:00100000:2.0:1746143779.504277:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622559872:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 5796us (6466us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.504283:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11902 00000100:00100000:2.0:1746143779.504365:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.504476:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622560256 00000100:00100000:3.0:1746143779.504483:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622560256 00010000:00010000:3.0:1746143779.504508:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 31 pid: 9587 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.504527:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5611 00000100:00100000:3.0:1746143779.504533:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622560256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.504544:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.504552:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 31 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.504562:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 31 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.504579:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.504581:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.504586:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.504593:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.504619:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.504629:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626758784:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143779.504687:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1180 going to sleep for 11 seconds 00010000:00010000:2.0:1746143779.506086:0:9585:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff880096fdbb80 x1830963626758656) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 31 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.506110:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73a93f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2854911) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b12e expref: 31 pid: 9587 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.506122:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626758656:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.506145:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73a944e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b16d expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.506159:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73a944e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b16d expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.506167:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512e00, rc 0) 00000100:00100000:2.0:1746143779.506199:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622560000:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 7629us (7770us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.506205:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11903 00000100:00100000:3.0:1746143779.508986:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626758784:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143779.509005:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.509050:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963622560256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4516us (4683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.509060:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5611 00000100:00100000:0.0:1746143779.511782:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.512049:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622560512 00000100:00100000:3.0:1746143779.512057:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622560512 00000100:00100000:3.0:1746143779.512310:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12886 00000100:00100000:3.0:1746143779.512318:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32197:x1830963622560512:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143779.512334:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.512350:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73a9455 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b17b expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.512430:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a945c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.512441:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b14a expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.512448:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a945c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.512472:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b14a expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.512486:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b14a expref: 10 pid: 6587 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.512496:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626758912:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.514385:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.514815:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626758912:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.514836:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a945c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143779.515033:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.515094:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622560640 00000100:00100000:3.0:1746143779.515099:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622560640 00010000:00010000:3.0:1746143779.515123:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b14a expref: 11 pid: 6587 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.515161:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5612 00000100:00100000:3.0:1746143779.515167:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622560640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.515179:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.515184:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b14a expref: 11 pid: 6587 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.515192:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b14a expref: 11 pid: 6587 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.515210:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9424 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b14a expref: 11 pid: 6587 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.515227:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.515231:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a945c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.515238:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a945c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.515243:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a945c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.515259:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143779.515272:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a945c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.515277:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a945c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143779.515290:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143779.515383:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73a9455 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b17b expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.515396:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a945c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b17b expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.515401:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.515405:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143779.515407:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30a00, rc 0) 00000100:00100000:3.0:1746143779.517045:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32197:x1830963622560512:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 4722us (5262us total) trans 8589943645 rc 0/0 00000100:00100000:3.0:1746143779.517053:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12886 00000100:00100000:3.0:1746143779.517108:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622560640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1941us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.517115:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5612 00000100:00100000:0.0:1746143779.522667:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.522709:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.522780:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622561024 00000100:00100000:3.0:1746143779.522788:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622561024 00000100:00100000:3.0:1746143779.522833:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12887 00000100:00100000:3.0:1746143779.522840:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32197:x1830963622561024:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143779.522859:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.522862:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:2.0:1746143779.522950:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622561152 00000100:00100000:2.0:1746143779.522954:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622561152 00002000:00100000:2.0:1746143779.522979:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8800919e4380 x1830963622561152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.522987:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e4380 with x1830963622561152 ext(4194304->4968447) 00002000:00010000:2.0:1746143779.522991:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919e4380 00000100:00100000:2.0:1746143779.523014:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3447 00000100:00100000:2.0:1746143779.523019:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622561152:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143779.523182:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a945c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b17b expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.523207:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.523210:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143779.523220:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a946a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b182 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.523810:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.523820:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.523827:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143779.523836:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143779.523908:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a946a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b182 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.523936:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b182 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.523941:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.523943:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143779.523945:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31200, rc 0) 00000100:00100000:3.0:1746143779.523966:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32197:x1830963622561024:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 1127us (1306us total) trans 8589943646 rc 0/0 00000100:00100000:3.0:1746143779.523971:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12887 00000100:00100000:0.0:1746143779.530202:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.530831:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622561280 00000100:00100000:3.0:1746143779.530840:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622561280 00000100:00100000:3.0:1746143779.530887:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12888 00000100:00100000:3.0:1746143779.530895:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32197:x1830963622561280:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143779.530946:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.530962:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a947f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b189 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.531009:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a947f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b189 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.531022:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a947f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b189 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.531038:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.531041:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143779.531043:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00000100:00100000:3.0:1746143779.531081:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32197:x1830963622561280:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 187us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.531087:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12888 00000100:00100000:2.0:1746143779.531788:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622561152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8766us (9076us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143779.531797:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3447 00002000:00100000:2.0:1746143779.531805:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8800919e4380 x1830963622561152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.531814:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e4380 with x1830963622561152 ext(4194304->4968447) 00002000:00010000:2.0:1746143779.531819:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919e4380 00000100:00100000:0.0:1746143779.539363:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.539402:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.539431:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.539444:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.539472:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.539499:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.539507:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622561536 00000100:00100000:1.0:1746143779.539516:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622561536 00000100:00100000:1.0:1746143779.539549:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622561408 00000100:00100000:1.0:1746143779.539551:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622561408 00000100:00100000:1.0:1746143779.539564:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622561792 00000100:00100000:1.0:1746143779.539565:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622561792 00000100:00100000:1.0:1746143779.539573:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622562048 00000100:00100000:1.0:1746143779.539574:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622562048 00000100:00100000:1.0:1746143779.539582:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622561664 00000100:00100000:1.0:1746143779.539583:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622561664 00000100:00100000:1.0:1746143779.539590:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622561920 00000100:00100000:1.0:1746143779.539592:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622561920 00000100:00100000:3.0:1746143779.539603:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11905 00000100:00100000:1.0:1746143779.539778:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11906 00000100:00100000:3.0:1746143779.539783:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622561536:12345-192.168.202.3@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143779.539785:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622561408:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143779.539818:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.539818:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.539832:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.539833:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.539839:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143779.539841:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143779.539843:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.539843:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143779.539844:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143779.539846:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.539868:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.539868:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.539878:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 13 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.539879:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 11 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.539889:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626759040:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143779.539889:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626759168:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.539984:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11907 00000100:00100000:2.0:1746143779.539992:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622561792:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143779.540009:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.540019:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.540025:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.540026:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.540029:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.540044:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.540053:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 29 pid: 9587 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.540061:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626759296:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143779.540176:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11908 00000100:00100000:0.0:1746143779.540183:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622562048:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143779.540201:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.540211:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.540218:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73a9447 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b174 expref: 15 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.540225:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73a93e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b120 expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.540230:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.540232:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.540234:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.540249:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73a93e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b120 expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.540256:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73a93e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b120 expref: 32 pid: 13430 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746143779.540264:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626759424:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.540718:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.540737:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11909 00000100:00100000:3.0:1746143779.540743:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2011:x1830963622561664:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143779.540760:0:12328:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.540769:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.540775:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a9439 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b15f expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.540780:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad800/0x87925e4cb73a93c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0f6 expref: 13 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.540785:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.540786:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.540788:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.540802:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad800/0x87925e4cb73a93c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0f6 expref: 13 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.540810:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad800/0x87925e4cb73a93c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0f6 expref: 13 pid: 1947 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143779.540817:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626759552:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.540843:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a9439 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b15f expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.540854:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a9439 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b15f expref: 15 pid: 9585 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143779.540862:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626759680:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.540881:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.540888:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 32 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.540895:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626759808:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.540940:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800960b43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.540955:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11910 00000100:00100000:3.0:1746143779.540961:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622561920:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143779.540979:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.540988:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.540993:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.540994:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.540996:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.541013:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.541020:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 29 pid: 13436 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.541027:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626759936:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.541043:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.543035:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.543433:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746143779.543438:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73a9447 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b174 expref: 15 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.543452:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73a9447 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b174 expref: 15 pid: 3134 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746143779.543468:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626760064:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143779.543499:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.543507:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 13 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.543515:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626760192:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143779.543529:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.544462:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.545064:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.545103:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.545120:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622562432 00000100:00100000:2.0:1746143779.545127:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622562432 00000100:00100000:2.0:1746143779.545156:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622562560 00000100:00100000:2.0:1746143779.545158:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622562560 00000100:00100000:2.0:1746143779.545171:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11911 00000100:00100000:2.0:1746143779.545177:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622562432:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.545191:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.545205:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73a94b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b197 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.545243:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626760320:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.545301:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.545337:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11912 00000100:00100000:2.0:1746143779.545342:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622562560:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.545350:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.545358:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e512a00/0x87925e4cb73a94b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b19e expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.545381:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626760448:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.545403:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.545504:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622562304 00000100:00100000:3.0:1746143779.545508:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622562304 00000100:00100000:3.0:1746143779.545541:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12889 00000100:00100000:3.0:1746143779.545546:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32200:x1830963622562304:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143779.545559:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.545569:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73a94be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b190 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.545619:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.545629:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.545637:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.545646:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a94cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.545655:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a94cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.545659:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a94cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.545724:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.545731:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b182 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.545736:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.545751:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b182 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.545759:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b182 expref: 11 pid: 10936 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.545766:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626760576:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.545785:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.551083:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626759552:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.551093:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626759680:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.551099:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626759808:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.551120:0:12328:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.551618:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626759424:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143779.551653:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626760064:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143779.551671:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626760192:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143779.551685:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.551691:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fdbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626759296:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.551708:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.551726:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800820d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626759040:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.551736:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.551748:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626760320:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.551762:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626760448:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143779.551767:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73a94b0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b197 expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.551776:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e512a00/0x87925e4cb73a94b7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b19e expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.551778:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73a94b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b197 expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.551785:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e512a00/0x87925e4cb73a94b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b19e expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.551795:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513200, rc 0) 00010000:00010000:2.0:1746143779.551797:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512a00, rc 0) 00000100:00100000:2.0:1746143779.551831:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622562560:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6487us (6727us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143779.551835:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622562432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6657us (6771us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.551838:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11912 00000100:00100000:0.0:1746143779.551841:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11911 00000100:00100000:0.0:1746143779.551879:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.552004:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622562688 00000100:00100000:2.0:1746143779.552010:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622562688 00010000:00010000:2.0:1746143779.552032:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad800/0x87925e4cb73a93c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0f6 expref: 14 pid: 1947 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143779.552058:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5613 00000100:00100000:2.0:1746143779.552064:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2010:x1830963622562688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143779.552073:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626759168:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.552076:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143779.552085:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad800/0x87925e4cb73a93c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0f6 expref: 14 pid: 1947 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143779.552087:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.552093:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad800/0x87925e4cb73a93c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0f6 expref: 14 pid: 1947 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143779.552109:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad800/0x87925e4cb73a93c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0f6 expref: 14 pid: 1947 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143779.552120:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143779.552138:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622562688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.552143:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5613 00000100:00100000:3.0:1746143779.552819:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626759936:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.552831:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.552848:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626760576:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.552856:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143779.553195:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.555122:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622563072 00000100:00100000:3.0:1746143779.555131:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622563072 00010000:00010000:3.0:1746143779.555158:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 30 pid: 13436 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.555188:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5614 00000100:00100000:3.0:1746143779.555194:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963622563072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.555205:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.555218:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 30 pid: 13436 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.555226:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 30 pid: 13436 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.555243:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9408 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b143 expref: 30 pid: 13436 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.555261:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.555263:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.555266:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.555273:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.555291:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.555319:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963622563072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 124us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.555323:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5614 00010000:00010000:3.0:1746143779.555341:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.555347:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.555359:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.555365:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.555370:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.555379:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143779.555383:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.555389:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.555396:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.555400:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73a94a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.555428:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622561920:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 14469us (15929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.555435:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11910 00000100:00100000:0.0:1746143779.555687:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.555811:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622563584 00000100:00100000:2.0:1746143779.555815:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622563584 00010000:00010000:2.0:1746143779.555829:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73a93e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b120 expref: 33 pid: 13430 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143779.555841:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5615 00000100:00100000:2.0:1746143779.555845:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622563584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143779.555851:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143779.555860:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73a93e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b120 expref: 33 pid: 13430 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143779.555867:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73a93e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b120 expref: 33 pid: 13430 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143779.555877:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73a93e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b120 expref: 33 pid: 13430 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143779.555885:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143779.555897:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963622563584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.555925:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5615 00000100:00100000:0.0:1746143779.556018:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.557064:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622563712 00000100:00100000:2.0:1746143779.557068:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622563712 00010000:00010000:2.0:1746143779.557086:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b182 expref: 12 pid: 10936 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.557102:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5616 00000100:00100000:2.0:1746143779.557107:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622563712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143779.557116:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143779.557120:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b182 expref: 12 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.557127:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b182 expref: 12 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.557139:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73a9471 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b182 expref: 12 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.557150:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143779.557153:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.557161:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.557166:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.557182:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143779.557202:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622563712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 94us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.557207:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5616 00010000:00010000:3.0:1746143779.557259:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557265:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143779.557278:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143779.557349:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557354:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557362:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557366:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082087600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.557368:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557373:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557380:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.557382:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143779.557384:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557387:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73a94d3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557400:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557404:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557408:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557412:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557415:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082086c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.557417:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557424:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557429:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143779.557430:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.557432:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557435:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082086c00/0x87925e4cb73a94c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557441:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a94cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557445:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a94cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557449:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a94cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557452:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082087000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.557454:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a94cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557458:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a94cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557462:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22000) 00010000:00010000:3.0:1746143779.557463:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.557465:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a94cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557469:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087000/0x87925e4cb73a94cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.557503:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73a94be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b190 expref: 17 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.557509:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73a94be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b190 expref: 17 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.557515:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1200, rc 0) 00000100:00100000:3.0:1746143779.557535:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32200:x1830963622562304:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11989us (13077us total) trans 8589943647 rc 301/301 00000100:00100000:3.0:1746143779.557541:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12889 00000100:00100000:0.0:1746143779.557604:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.557665:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.557681:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.557691:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.557701:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.557713:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.557727:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622563840 00000100:00100000:0.0:1746143779.557730:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622563840 00010000:00010000:0.0:1746143779.557743:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 32 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.557757:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622562816 00000100:00100000:0.0:1746143779.557759:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622562816 00010000:00010000:0.0:1746143779.557767:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a9439 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b15f expref: 16 pid: 9585 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746143779.557887:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622563456 00000100:00100000:1.0:1746143779.557890:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622563456 00010000:00010000:1.0:1746143779.557930:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73a9447 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b174 expref: 17 pid: 3134 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746143779.557946:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5617 00000100:00100000:1.0:1746143779.557952:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622563840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.557960:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.557973:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 32 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.557981:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 32 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.557992:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6800/0x87925e4cb73a938a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0d3 expref: 32 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.558005:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.558020:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622563840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 69us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.558024:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5617 00000100:00100000:1.0:1746143779.558033:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5618 00000100:00100000:1.0:1746143779.558036:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622563456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.558041:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.558047:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73a9447 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b174 expref: 17 pid: 3134 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143779.558054:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73a9447 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b174 expref: 17 pid: 3134 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143779.558062:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73a9447 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b174 expref: 17 pid: 3134 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143779.558069:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.558078:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2008:x1830963622563456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.558083:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5618 00000100:00100000:1.0:1746143779.558103:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622562944 00000100:00100000:1.0:1746143779.558105:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622562944 00002000:00100000:1.0:1746143779.558122:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (65536->1048575) req@ffff8800919e6a00 x1830963622562944/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.558130:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e6a00 with x1830963622562944 ext(65536->1048575) 00010000:00010000:1.0:1746143779.558136:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 12 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.558143:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 12 pid: 9585 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143779.558148:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919e6a00 00000100:00100000:1.0:1746143779.558160:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622563328 00000100:00100000:1.0:1746143779.558162:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622563328 00002000:00100000:1.0:1746143779.558172:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1957888->2097151) req@ffff8800919e6d80 x1830963622563328/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.558177:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e6d80 with x1830963622563328 ext(1957888->2097151) 00010000:00010000:1.0:1746143779.558181:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 29 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.558187:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 29 pid: 9587 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143779.558191:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919e6d80 00000100:00100000:1.0:1746143779.558197:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622563200 00000100:00100000:1.0:1746143779.558199:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622563200 00002000:00100000:1.0:1746143779.558206:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1069055) req@ffff8800919e7800 x1830963622563200/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.558211:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e7800 with x1830963622563200 ext(1048576->1069055) 00010000:00010000:1.0:1746143779.558215:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 13 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.558220:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 13 pid: 9585 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143779.558224:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919e7800 00000100:00100000:1.0:1746143779.558231:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1441 00000100:00100000:1.0:1746143779.558234:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622562944:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143779.558350:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1442 00000100:00100000:1.0:1746143779.558354:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622563328:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143779.558422:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.558433:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622563968 00000100:00100000:1.0:1746143779.558435:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622563968 00010000:00010000:1.0:1746143779.558444:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143779.558455:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5619 00000100:00100000:1.0:1746143779.558459:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622563968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.558464:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.558470:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.558478:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.558487:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73a93ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e8 expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.558495:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.558497:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.558499:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.558505:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.558519:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.558533:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622563968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.558537:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5619 00010000:00010000:1.0:1746143779.558552:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.558559:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.558571:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.558582:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.558587:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.558591:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5ad600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143779.558594:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.558600:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.558607:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.558612:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73a949b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143779.558644:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622562048:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 18462us (19197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.558650:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11908 00000100:00100000:0.0:1746143779.558841:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5620 00000100:00100000:0.0:1746143779.558846:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622562816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143779.558855:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143779.558862:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a9439 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b15f expref: 14 pid: 9585 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143779.558869:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a9439 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b15f expref: 14 pid: 9585 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143779.558878:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73a9439 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b15f expref: 14 pid: 9585 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143779.558885:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.558886:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.558889:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.558894:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.558928:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.558944:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622562816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 98us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.558948:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5620 00000100:00100000:0.0:1746143779.558980:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1443 00000100:00100000:0.0:1746143779.558986:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622563200:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:3.0:1746143779.559067:0:12328:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.559074:0:12328:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.559084:0:12328:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.559089:0:12328:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.559094:0:12328:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.559099:0:12328:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143779.559101:0:12328:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.559107:0:12328:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.559116:0:12328:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.559121:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a94a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.559147:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622561664:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 18405us (19674us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.559152:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11909 00000100:00100000:0.0:1746143779.562128:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.562198:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622564096 00000100:00100000:3.0:1746143779.562206:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622564096 00000100:00100000:3.0:1746143779.562237:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11913 00000100:00100000:3.0:1746143779.562243:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+31:32189:x1830963622564096:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.562256:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.562273:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a94e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1a5 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143779.562290:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4964768, mtime: 0x68140a23, atime: 0x68140a23, ctime: 0x68140a23, blocks: 0x15f0 00010000:00010000:3.0:1746143779.562306:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.562308:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.562314:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a94e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1a5 expref: 32 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.562338:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a94e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1a5 expref: 32 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.562347:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087200, rc 0) 00000100:00100000:3.0:1746143779.562370:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+32:32189:x1830963622564096:12345-192.168.202.3@tcp:101:cat.0 Request processed in 127us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.562375:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11913 00000100:00100000:1.0:1746143779.574969:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.574992:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.575055:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622564352 00000100:00100000:3.0:1746143779.575062:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622564352 00000100:00100000:3.0:1746143779.575089:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622564224 00000100:00100000:3.0:1746143779.575090:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622564224 00000100:00100000:3.0:1746143779.575106:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11914 00000100:00100000:3.0:1746143779.575112:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622564352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.575127:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.575140:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a94e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1b3 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.575182:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626760704:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143779.575235:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.575249:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11915 00000100:00100000:3.0:1746143779.575253:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622564224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.575259:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.575266:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73a94ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1ac expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.575289:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626760832:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143779.575302:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.577018:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622563328:12345-192.168.202.3@tcp:4:cat.0 Request processed in 18658us (19347us total) trans 21474840337 rc 0/0 00000100:00100000:0.0:1746143779.577029:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1442 00002000:00100000:0.0:1746143779.577038:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1957888->2097151) req@ffff8800919e6d80 x1830963622563328/t21474840337(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.577045:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e6d80 with x1830963622563328 ext(1957888->2097151) 00010000:00010000:0.0:1746143779.577052:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 34 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.577061:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 34 pid: 9587 timeout: 938 lvb_type: 0 00002000:00010000:0.0:1746143779.577067:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919e6d80 00000100:00100000:2.0:1746143779.578267:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622563200:12345-192.168.202.3@tcp:4:cat.0 Request processed in 19278us (20561us total) trans 17179873012 rc 0/0 00000100:00100000:2.0:1746143779.578275:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1443 00002000:00100000:2.0:1746143779.578282:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1069055) req@ffff8800919e7800 x1830963622563200/t17179873012(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.578295:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e7800 with x1830963622563200 ext(1048576->1069055) 00010000:00010000:2.0:1746143779.578301:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.578311:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143779.578316:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919e7800 00000100:00100000:1.0:1746143779.578520:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622562944:12345-192.168.202.3@tcp:4:cat.0 Request processed in 20283us (20915us total) trans 21474840338 rc 0/0 00000100:00100000:1.0:1746143779.578529:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1441 00002000:00100000:1.0:1746143779.578534:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (65536->1048575) req@ffff8800919e6a00 x1830963622562944/t21474840338(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.578541:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e6a00 with x1830963622562944 ext(65536->1048575) 00010000:00010000:1.0:1746143779.578546:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.578553:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143779.578558:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919e6a00 00000100:00100000:0.0:1746143779.579373:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.579404:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.579425:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.579467:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622564608 00000100:00100000:2.0:1746143779.579474:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622564608 00000100:00100000:2.0:1746143779.579645:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622564480 00000100:00100000:2.0:1746143779.579648:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622564480 00000100:00100000:2.0:1746143779.579660:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622564736 00000100:00100000:2.0:1746143779.579662:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622564736 00000100:00100000:2.0:1746143779.579673:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11916 00000100:00100000:2.0:1746143779.579678:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622564608:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.579689:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.579700:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73a94f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1c1 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.579735:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626760960:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143779.579868:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11917 00000100:00100000:3.0:1746143779.579875:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622564480:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.579882:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.579892:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a94fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1ba expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143779.579937:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a23, atime: 0x68140a23, ctime: 0x68140a23, blocks: 0x800 00010000:00010000:3.0:1746143779.579948:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.579950:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.579956:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a94fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ba expref: 35 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.579967:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a94fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ba expref: 35 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.579975:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1800, rc 0) 00000100:00100000:0.0:1746143779.580065:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11918 00000100:00100000:0.0:1746143779.580076:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622564736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143779.580092:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.580106:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a9504 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1c8 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143779.580124:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a23, atime: 0x68140a22, ctime: 0x68140a23, blocks: 0x1008 00010000:00010000:0.0:1746143779.580137:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.580139:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.580146:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a9504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c8 expref: 36 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143779.580164:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746143779.580174:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a9504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c8 expref: 36 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.580183:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521200, rc 0) 00000100:00100000:3.0:1746143779.580284:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622564480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 409us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.580291:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11917 00000100:00100000:0.0:1746143779.580573:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622564736:12345-192.168.202.3@tcp:101:cat.0 Request processed in 498us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.580579:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11918 00000100:00100000:2.0:1746143779.580682:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626760704:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.580701:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a94e8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1b3 expref: 34 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.580714:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a94e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1b3 expref: 34 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.580736:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087400, rc 0) 00000100:00100000:2.0:1746143779.580755:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622564352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5643us (5793us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.580760:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11914 00000100:00100000:2.0:1746143779.580998:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626760832:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.581012:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73a94ef lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ac expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.581020:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73a94ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ac expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.581027:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429600, rc 0) 00000100:00100000:2.0:1746143779.581050:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622564224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5796us (6056us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.581055:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11915 00000100:00100000:0.0:1746143779.581972:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.582016:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622564864 00000100:00100000:1.0:1746143779.582023:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622564864 00010000:00010000:1.0:1746143779.582047:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 34 pid: 9587 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143779.582083:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5621 00000100:00100000:1.0:1746143779.582090:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622564864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.582100:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.582110:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 34 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.582120:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 34 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.584617:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.584619:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.584623:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.584632:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.584653:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.584713:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622564864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2620us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.584722:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5621 00000100:00100000:0.0:1746143779.584787:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.585153:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143779.585180:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.585188:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.585208:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.585220:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.585227:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.585235:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e512800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143779.585238:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.585245:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.585254:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.585259:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e512800/0x87925e4cb73a9494 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.585301:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622561792:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 45310us (45868us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.585309:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11907 00010000:00010000:2.0:1746143779.585346:0:13436:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff88012457d880 x1830963626760960) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 33 pid: 9587 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.585367:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7400/0x87925e4cb73a93ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b127 expref: 33 pid: 9587 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.585375:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626760960:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.585397:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73a94f6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c1 expref: 32 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.585407:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73a94f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c1 expref: 32 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.585419:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5ad600, rc 0) 00000100:00100000:2.0:1746143779.585435:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622564608:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5757us (6069us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.585441:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11916 00000100:00100000:3.0:1746143779.585496:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622564992 00000100:00100000:3.0:1746143779.585502:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622564992 00010000:00010000:3.0:1746143779.585521:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.585539:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622565120 00000100:00100000:3.0:1746143779.585540:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622565120 00010000:00010000:3.0:1746143779.585548:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143779.585558:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5622 00000100:00100000:3.0:1746143779.585563:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622564992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.585572:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.585581:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.585588:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.585598:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d849800/0x87925e4cb73a93a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0e1 expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.585612:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.585614:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.585616:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.585621:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.585632:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.585645:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622564992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 82us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.585650:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5622 00000100:00100000:3.0:1746143779.585659:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5623 00000100:00100000:3.0:1746143779.585662:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622565120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.585668:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.585675:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.585682:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.585692:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9352 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b0be expref: 14 pid: 9585 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143779.585699:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.585700:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.585703:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.585708:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.585719:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.585731:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622565120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 68us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.585736:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5623 00010000:00010000:1.0:1746143779.585939:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.585946:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.585958:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.585963:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.585969:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.585978:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad34000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143779.585980:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.585985:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.585994:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.585999:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad34000/0x87925e4cb73a948d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143779.586034:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622561408:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 46250us (46631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.586040:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11906 00010000:00010000:2.0:1746143779.586100:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.586107:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.586119:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.586124:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.586131:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.586136:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143779.586138:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.586144:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.586153:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.586159:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73a9486 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.586193:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622561536:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 46415us (46837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.586199:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11905 00000100:00100000:0.0:1746143779.590451:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.590683:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622565376 00000100:00100000:3.0:1746143779.590692:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622565376 00000100:00100000:0.0:1746143779.591346:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.591498:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12890 00000100:00100000:3.0:1746143779.591508:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32197:x1830963622565376:12345-192.168.202.3@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143779.591546:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.591568:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a947f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b189 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.591582:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.591585:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.592246:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32197:x1830963622565376:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 738us (1799us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746143779.592253:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12890 00000100:00100000:1.0:1746143779.592296:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622565632 00000100:00100000:1.0:1746143779.592301:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622565632 00002000:00100000:1.0:1746143779.592326:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (4964352->4968447) req@ffff880133570700 x1830963622565632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.592334:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133570700 with x1830963622565632 ext(4964352->4968447) 00002000:00010000:1.0:1746143779.592338:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133570700 00000100:00100000:1.0:1746143779.592617:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3448 00000100:00100000:1.0:1746143779.592624:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622565632:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143779.592716:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963622565632:12345-192.168.202.3@tcp:3:cat.0 Request processed in 92us (1371us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143779.592723:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3448 00002000:00100000:1.0:1746143779.592727:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b6:0x0] (4964352->4968447) req@ffff880133570700 x1830963622565632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/4536 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.592734:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133570700 with x1830963622565632 ext(4964352->4968447) 00002000:00010000:1.0:1746143779.592736:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133570700 00000100:00100000:2.0:1746143779.595331:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.596627:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622565888 00000100:00100000:3.0:1746143779.596637:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622565888 00000100:00100000:3.0:1746143779.596673:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4726 00000100:00100000:3.0:1746143779.596679:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32197:x1830963622565888:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143779.596835:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32197:x1830963622565888:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 155us (1509us total) trans 8589943648 rc 0/0 00000100:00100000:3.0:1746143779.596842:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4726 00000100:00100000:2.0:1746143779.598761:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.598948:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622566144 00000100:00100000:0.0:1746143779.598955:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622566144 00000100:00100000:0.0:1746143779.598992:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4727 00000100:00100000:0.0:1746143779.598998:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+270:32189:x1830963622566144:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143779.599744:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+271:32189:x1830963622566144:12345-192.168.202.3@tcp:35:cat.0 Request processed in 744us (986us total) trans 8589943649 rc 0/0 00000100:00100000:0.0:1746143779.599751:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4727 00000100:00100000:0.0:1746143779.606293:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.606379:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622566400 00000100:00100000:2.0:1746143779.606390:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622566400 00000100:00100000:2.0:1746143779.606448:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4728 00000100:00100000:2.0:1746143779.606456:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32197:x1830963622566400:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143779.606643:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32197:x1830963622566400:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 188us (360us total) trans 8589943650 rc 0/0 00000100:00100000:2.0:1746143779.606649:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4728 00000100:00100000:0.0:1746143779.607574:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.607686:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622566656 00000100:00100000:3.0:1746143779.607692:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622566656 00000100:00100000:3.0:1746143779.607731:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12891 00000100:00100000:3.0:1746143779.607737:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32203:x1830963622566656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.607749:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.607764:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a950b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1cf expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.607819:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.607830:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.607839:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.607849:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9519 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.607855:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.607860:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.607964:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143779.610564:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143779.610704:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610725:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143779.610740:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143779.610833:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610840:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610849:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610855:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610860:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c1000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.610863:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610869:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610879:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143779.610881:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.610885:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610890:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610941:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610946:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9519 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610951:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9519 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610959:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.610962:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9519 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610970:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9519 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610976:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22100) 00010000:00010000:3.0:1746143779.610978:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.610980:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9519 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.610984:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9519 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.611031:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a950b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1cf expref: 19 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.611041:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1cf expref: 18 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.611047:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.611048:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143779.611050:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1400, rc 0) 00000100:00100000:3.0:1746143779.611102:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32203:x1830963622566656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3364us (3529us total) trans 8589943651 rc 0/0 00000100:00100000:3.0:1746143779.611110:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12891 00000100:00100000:2.0:1746143779.611323:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622566784 00000100:00100000:2.0:1746143779.611329:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622566784 00000100:00100000:2.0:1746143779.611356:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11919 00000100:00100000:2.0:1746143779.611362:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32200:x1830963622566784:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143779.611373:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.611384:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1d6 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.611403:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a94e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1a5 expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.611410:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.611411:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.611414:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4030464->4194303] (req 4030464->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.611437:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a94e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1a5 expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.611447:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a94e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1a5 expref: 30 pid: 12328 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.611457:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626761088:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.611514:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.614608:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626761088:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.614650:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [4030464->4194303] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.614668:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5acc00, rc 0) 00000100:00100000:3.0:1746143779.614716:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32200:x1830963622566784:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3353us (4163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.614725:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11919 00000100:00100000:0.0:1746143779.615373:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.615630:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.615654:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.616579:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622566912 00000100:00100000:2.0:1746143779.616588:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622566912 00010000:00010000:2.0:1746143779.616627:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a94e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1a5 expref: 31 pid: 12328 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.616724:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.616741:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.616753:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.616773:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.616839:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622567040 00000100:00100000:3.0:1746143779.616844:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622567040 00000100:00100000:3.0:1746143779.616877:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622567296 00000100:00100000:3.0:1746143779.616879:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622567296 00000100:00100000:3.0:1746143779.616892:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622567552 00000100:00100000:3.0:1746143779.616894:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622567552 00000100:00100000:2.0:1746143779.616994:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5624 00000100:00100000:2.0:1746143779.617004:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622566912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143779.617019:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143779.617024:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622567168 00000100:00100000:3.0:1746143779.617027:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622567168 00010000:00010000:2.0:1746143779.617042:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a94e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1a5 expref: 31 pid: 12328 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.617054:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a94e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1a5 expref: 31 pid: 12328 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.617058:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622567424 00000100:00100000:0.0:1746143779.617060:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622567424 00000100:00100000:0.0:1746143779.617078:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622567680 00000100:00100000:0.0:1746143779.617079:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622567680 00010000:00010000:2.0:1746143779.617080:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73a94e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4964352->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1a5 expref: 31 pid: 12328 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.617091:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11920 00010000:00010000:2.0:1746143779.617096:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143779.617096:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622567040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.617098:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.617103:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.617109:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.617111:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.617124:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9535 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1dd expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.617135:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143779.617140:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a23, atime: 0x68140a22, ctime: 0x68140a23, blocks: 0x7d8 00000100:00100000:2.0:1746143779.617146:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626761216:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143779.617151:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.617153:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.617157:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1dd expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.617169:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1dd expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.617177:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e520e00, rc 0) 00000100:00100000:0.0:1746143779.617198:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622567040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 101us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.617204:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.617204:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11920 00000100:00100000:0.0:1746143779.617221:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11921 00000100:00100000:2.0:1746143779.617226:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11922 00000100:00100000:0.0:1746143779.617227:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622567296:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143779.617232:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622567552:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143779.617234:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.617238:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.617244:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a953c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1eb expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.617245:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73a9543 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1f9 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.617254:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.617256:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.617259:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a953c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1eb expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.617268:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a953c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1eb expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.617275:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db02800, rc 0) 00000100:00100000:2.0:1746143779.617285:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626761344:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143779.617290:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622567296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 63us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.617295:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11921 00000100:00100000:0.0:1746143779.617305:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11923 00000100:00100000:2.0:1746143779.617306:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.617309:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622567168:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143779.617314:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143779.617322:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11924 00010000:00010000:0.0:1746143779.617322:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db03200/0x87925e4cb73a954a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1e4 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.617327:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622567424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.617333:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746143779.617334:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a23, atime: 0x68140a22, ctime: 0x68140a23, blocks: 0x808 00010000:00010000:2.0:1746143779.617340:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9551 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b1f2 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.617341:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.617342:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.617346:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db03200/0x87925e4cb73a954a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1e4 expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746143779.617352:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a23, atime: 0x68140a23, ctime: 0x68140a23, blocks: 0x808 00010000:00010000:0.0:1746143779.617354:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db03200/0x87925e4cb73a954a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1e4 expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.617360:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.617361:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.617361:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db03200, rc 0) 00010000:00010000:2.0:1746143779.617365:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9551 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f2 expref: 18 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.617373:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9551 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f2 expref: 18 pid: 13436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143779.617376:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622567168:12345-192.168.202.3@tcp:101:cat.0 Request processed in 66us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.617381:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11923 00010000:00010000:2.0:1746143779.617383:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31200, rc 0) 00000100:00100000:0.0:1746143779.617391:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11925 00000100:00100000:0.0:1746143779.617394:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622567680:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143779.617398:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622567424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 71us (644us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143779.617400:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143779.617402:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11924 00010000:00010000:0.0:1746143779.617407:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a9558 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b200 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.617416:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.617417:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.617421:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a9558 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b200 expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.617428:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a9558 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b200 expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.617434:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087400, rc 0) 00000100:00100000:0.0:1746143779.617448:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622567680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 53us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.617453:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11925 00000100:00100000:0.0:1746143779.620692:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.620991:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622567936 00000100:00100000:3.0:1746143779.621000:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622567936 00000100:00100000:3.0:1746143779.621061:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12892 00000100:00100000:3.0:1746143779.621070:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+271:32207:x1830963622567936:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143779.621094:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.621114:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73a955f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b207 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.621198:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00000100:00100000:2.0:1746143779.621202:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626761344:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143779.621212:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621222:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621234:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a956d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.621234:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73a9543 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f9 expref: 17 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.621239:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a956d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621246:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a956d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143779.621246:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73a9543 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f9 expref: 17 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.621257:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429600, rc 0) 00000100:00100000:2.0:1746143779.621297:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622567552:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4065us (4573us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.621304:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11922 00000100:00100000:2.0:1746143779.621332:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626761216:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143779.621340:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143779.621353:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00000100:00100000:2.0:1746143779.621355:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622566912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4354us (5984us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143779.621363:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00000100:00100000:2.0:1746143779.621363:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5624 00010000:00010000:3.0:1746143779.621369:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143779.621378:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143779.621634:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621640:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621646:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621650:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621655:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.621658:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621663:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621671:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143779.621674:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.621678:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621682:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9566 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621700:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a956d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621703:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a956d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621707:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a956d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621711:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.621713:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a956d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621717:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a956d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621721:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22000) 00010000:00010000:3.0:1746143779.621723:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.621724:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a956d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621728:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a956d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143779.621755:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73a955f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b207 expref: 274 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.621767:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b207 expref: 273 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.621773:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.621775:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143779.621776:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1000, rc 0) 00000100:00100000:3.0:1746143779.621796:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+273:32207:x1830963622567936:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 728us (1118us total) trans 8589943652 rc 0/0 00000100:00100000:3.0:1746143779.621800:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12892 00000100:00100000:2.0:1746143779.622391:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.622504:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622568192 00000100:00100000:3.0:1746143779.622509:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622568192 00002000:00100000:3.0:1746143779.622533:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (4030464->4034559) req@ffff880092146300 x1830963622568192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.622542:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146300 with x1830963622568192 ext(4030464->4034559) 00002000:00010000:3.0:1746143779.622545:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092146300 00000100:00100000:3.0:1746143779.622566:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3449 00000100:00100000:3.0:1746143779.622571:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622568192:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143779.622814:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622568192:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 243us (424us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143779.622820:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3449 00002000:00100000:3.0:1746143779.622825:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (4030464->4034559) req@ffff880092146300 x1830963622568192/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/4536 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.622832:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146300 with x1830963622568192 ext(4030464->4034559) 00002000:00010000:3.0:1746143779.622834:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092146300 00000100:00100000:0.0:1746143779.634333:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.635675:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.635790:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.635863:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622568576 00000100:00100000:0.0:1746143779.635874:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622568576 00000100:00100000:2.0:1746143779.635931:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622568320 00000100:00100000:2.0:1746143779.635937:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622568320 00002000:00100000:0.0:1746143779.635950:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012b1dbb80 x1830963622568576/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.635960:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1dbb80 with x1830963622568576 ext(0->1048575) 00000100:00100000:2.0:1746143779.635966:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11926 00002000:00010000:0.0:1746143779.635966:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1dbb80 00000100:00100000:3.0:1746143779.635968:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622568960 00000100:00100000:2.0:1746143779.635972:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32200:x1830963622568320:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:3.0:1746143779.635973:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622568960 00000100:00100000:0.0:1746143779.635983:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3450 00010000:00010000:2.0:1746143779.635987:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143779.635989:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622568576:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143779.635992:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b1d9180 x1830963622568960/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.636000:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9180 with x1830963622568960 ext(1048576->2097151) 00010000:00010000:2.0:1746143779.636001:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b20e expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143779.636004:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d9180 00000100:00100000:3.0:1746143779.636018:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3451 00000100:00100000:3.0:1746143779.636023:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622568960:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143779.636024:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a9504 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c8 expref: 32 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.636030:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a9558 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b200 expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.636034:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.636035:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.636037:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->3518463] (req 3145728->3518463) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 18 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.636076:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a9558 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b200 expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.636084:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a9558 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b200 expref: 18 pid: 9585 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143779.636093:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626761472:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.636160:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a9504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c8 expref: 32 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.636166:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a9504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c8 expref: 32 pid: 9585 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143779.636171:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626761600:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.636182:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.640021:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.640058:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.640122:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.640124:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622569088 00000100:00100000:1.0:1746143779.640136:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622569088 00000100:00100000:0.0:1746143779.640145:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:1.0:1746143779.640180:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880133573480 x1830963622569088/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.640190:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133573480 with x1830963622569088 ext(1048576->2097151) 00002000:00010000:1.0:1746143779.640195:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133573480 00000100:00100000:1.0:1746143779.640215:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622569344 00000100:00100000:1.0:1746143779.640217:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622569344 00002000:00100000:1.0:1746143779.640229:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88009afbbc50 x1830963622569344/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.640236:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009afbbc50 with x1830963622569344 ext(1048576->2097151) 00002000:00010000:1.0:1746143779.640238:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009afbbc50 00000100:00100000:1.0:1746143779.640251:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3452 00000100:00100000:1.0:1746143779.640258:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622569088:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.640976:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3453 00000100:00100000:3.0:1746143779.640992:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622569344:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143779.641010:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622569600 00000100:00100000:0.0:1746143779.641016:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622569600 00010000:00010000:0.0:1746143779.641041:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a9504 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c8 expref: 33 pid: 9585 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746143779.641064:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622569472 00000100:00100000:0.0:1746143779.641066:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622569472 00010000:00010000:0.0:1746143779.641074:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a9558 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b200 expref: 22 pid: 9585 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746143779.641088:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5625 00000100:00100000:0.0:1746143779.641092:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622569600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143779.641102:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143779.641122:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a9504 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c8 expref: 33 pid: 9585 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143779.641131:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a9504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c8 expref: 33 pid: 9585 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143779.641162:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.641191:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622569600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 97us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.641199:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5625 00000100:00100000:0.0:1746143779.641215:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5626 00000100:00100000:0.0:1746143779.641219:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622569472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143779.641226:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143779.641232:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a9558 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b200 expref: 22 pid: 9585 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143779.641241:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a9558 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b200 expref: 22 pid: 9585 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143779.641254:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.641256:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.641263:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 22 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.641271:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 22 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.641314:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 22 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.641329:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626761728:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143779.641379:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f000 going to sleep for 11 seconds 00010000:00010000:2.0:1746143779.641393:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73a9558 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b200 expref: 22 pid: 9585 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143779.641419:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626761472:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.641429:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73a9504 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1c8 expref: 32 pid: 9585 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143779.641438:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626761600:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.641463:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 21 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.641472:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30a00, rc 0) 00000100:00100000:2.0:1746143779.641494:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32200:x1830963622568320:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5521us (7173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.641501:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11926 00000100:00100000:2.0:1746143779.650809:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622568576:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14807us (15126us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143779.650822:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3450 00002000:00100000:2.0:1746143779.650834:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012b1dbb80 x1830963622568576/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.650843:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1dbb80 with x1830963622568576 ext(0->1048575) 00002000:00010000:2.0:1746143779.650850:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1dbb80 00000100:00100000:3.0:1746143779.651036:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622568960:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15011us (15245us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143779.651043:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3451 00002000:00100000:3.0:1746143779.651048:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b1d9180 x1830963622568960/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.651056:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9180 with x1830963622568960 ext(1048576->2097151) 00002000:00010000:3.0:1746143779.651059:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d9180 00000100:00100000:1.0:1746143779.651331:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626761728:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143779.651350:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.651962:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622569472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10739us (11813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.651971:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5626 00000100:00100000:2.0:1746143779.652074:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.652113:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622569856 00000100:00100000:3.0:1746143779.652119:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622569856 00002000:00100000:3.0:1746143779.652149:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x397:0x0] (3514368->3518463) req@ffff880092144700 x1830963622569856/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.652156:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144700 with x1830963622569856 ext(3514368->3518463) 00002000:00010000:3.0:1746143779.652159:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092144700 00000100:00100000:3.0:1746143779.652180:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3454 00000100:00100000:3.0:1746143779.652188:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622569856:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.652308:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622569856:12345-192.168.202.3@tcp:3:cat.0 Request processed in 120us (235us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143779.652314:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3454 00002000:00100000:3.0:1746143779.652319:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x397:0x0] (3514368->3518463) req@ffff880092144700 x1830963622569856/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/4536 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.652325:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144700 with x1830963622569856 ext(3514368->3518463) 00002000:00010000:3.0:1746143779.652328:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092144700 00000100:00100000:1.0:1746143779.652472:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622569088:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12213us (12461us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143779.652478:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3452 00002000:00100000:1.0:1746143779.652484:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880133573480 x1830963622569088/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.652491:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133573480 with x1830963622569088 ext(1048576->2097151) 00002000:00010000:1.0:1746143779.652494:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133573480 00000100:00100000:3.0:1746143779.653219:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622569344:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12229us (13158us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143779.653225:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3453 00002000:00100000:3.0:1746143779.653231:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88009afbbc50 x1830963622569344/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.653238:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009afbbc50 with x1830963622569344 ext(1048576->2097151) 00002000:00010000:3.0:1746143779.653241:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009afbbc50 00000100:00100000:0.0:1746143779.657057:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.657156:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622570112 00000100:00100000:3.0:1746143779.657167:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622570112 00000100:00100000:3.0:1746143779.657226:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4729 00000100:00100000:3.0:1746143779.657234:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32200:x1830963622570112:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143779.658205:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32200:x1830963622570112:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 968us (1157us total) trans 8589943653 rc 0/0 00000100:00100000:3.0:1746143779.658213:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4729 00000100:00100000:0.0:1746143779.672551:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.672693:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622570368 00000100:00100000:3.0:1746143779.672705:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622570368 00002000:00100000:3.0:1746143779.672755:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4030463) req@ffff88009391ca80 x1830963622570368/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.672765:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ca80 with x1830963622570368 ext(2097152->4030463) 00002000:00010000:3.0:1746143779.672771:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ca80 00000100:00100000:3.0:1746143779.672810:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3455 00000100:00100000:3.0:1746143779.672818:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622570368:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143779.673571:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.673632:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622570624 00000100:00100000:1.0:1746143779.673637:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622570624 00002000:00100000:1.0:1746143779.673660:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88009391df80 x1830963622570624/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 504/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.673668:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391df80 with x1830963622570624 ext(2097152->4194303) 00002000:00010000:1.0:1746143779.673672:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391df80 00000100:00100000:1.0:1746143779.674368:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3456 00000100:00100000:1.0:1746143779.674376:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622570624:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.685297:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622570368:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12468us (12747us total) trans 0 rc 1933312/1933312 00000100:00100000:3.0:1746143779.685312:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3455 00002000:00100000:3.0:1746143779.685326:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4030463) req@ffff88009391ca80 x1830963622570368/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1933312/1933312 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.685336:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ca80 with x1830963622570368 ext(2097152->4030463) 00002000:00010000:3.0:1746143779.685343:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ca80 00000100:00100000:1.0:1746143779.692118:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622570624:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17731us (18536us total) trans 0 rc 1724416/1724416 00000100:00100000:1.0:1746143779.692132:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3456 00002000:00100000:1.0:1746143779.692144:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88009391df80 x1830963622570624/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 504/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1724416/1724416 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.692154:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391df80 with x1830963622570624 ext(2097152->4194303) 00002000:00010000:1.0:1746143779.692161:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391df80 00000100:00100000:0.0:1746143779.704336:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.704497:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622570880 00000100:00100000:1.0:1746143779.704511:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622570880 00002000:00100000:1.0:1746143779.704572:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff88009391ea00 x1830963622570880/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.704583:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ea00 with x1830963622570880 ext(4194304->4968447) 00002000:00010000:1.0:1746143779.704589:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ea00 00000100:00100000:1.0:1746143779.704640:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3457 00000100:00100000:1.0:1746143779.704649:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622570880:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143779.710373:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622570880:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5711us (6038us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143779.710385:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3457 00002000:00100000:1.0:1746143779.710399:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff88009391ea00 x1830963622570880/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.710409:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ea00 with x1830963622570880 ext(4194304->4968447) 00002000:00010000:1.0:1746143779.710414:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ea00 00000100:00100000:0.0:1746143779.717447:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.718459:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622571136 00000100:00100000:3.0:1746143779.718474:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622571136 00000100:00100000:3.0:1746143779.718547:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4730 00000100:00100000:3.0:1746143779.718558:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e248850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32203:x1830963622571136:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143779.718817:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e248850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:32203:x1830963622571136:12345-192.168.202.3@tcp:35:cat.0 Request processed in 259us (1381us total) trans 8589943654 rc 0/0 00000100:00100000:3.0:1746143779.718823:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4730 00000100:00100000:0.0:1746143779.726798:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.728652:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622571264 00000100:00100000:1.0:1746143779.728666:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622571264 00000100:00100000:1.0:1746143779.728747:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12893 00000100:00100000:1.0:1746143779.728756:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32209:x1830963622571264:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143779.728789:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.728811:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b215 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.728877:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.728894:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.728929:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.728943:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a9597 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.728948:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a9597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.728953:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a9597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729028:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729037:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729044:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143779.729082:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:1.0:1746143779.729086:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143779.729101:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729110:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729119:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729128:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729134:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729139:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729145:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7dc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143779.729148:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729153:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729163:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143779.729165:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143779.729169:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729175:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73a9590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729202:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a9597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729207:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a9597 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729212:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a9597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729216:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7d400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143779.729219:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a9597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729224:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a9597 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729230:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5bc9b00) 00010000:00010000:1.0:1746143779.729233:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143779.729235:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a9597 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729239:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73a9597 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143779.729262:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b215 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.729272:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b215 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.729277:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143779.729279:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143779.729281:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c800, rc 0) 00000100:00100000:1.0:1746143779.729332:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:32209:x1830963622571264:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 577us (2545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.729337:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12893 00000100:00100000:0.0:1746143779.735598:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.735882:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622571392 00000100:00100000:2.0:1746143779.735893:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622571392 00000100:00100000:2.0:1746143779.735994:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11927 00000100:00100000:2.0:1746143779.736003:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+32:32207:x1830963622571392:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143779.736025:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.736045:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b21c expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.736079:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 15 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.736087:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.736089:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.736093:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2990080->3145727] (req 2990080->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 33 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.736126:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 15 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.736138:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 15 pid: 12327 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143779.736150:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626761856:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.737445:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.738748:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.738775:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.742443:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.742495:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622571520 00000100:00100000:1.0:1746143779.742506:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622571520 00000100:00100000:1.0:1746143779.742560:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622571648 00000100:00100000:1.0:1746143779.742563:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622571648 00000100:00100000:1.0:1746143779.742587:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11928 00000100:00100000:1.0:1746143779.742595:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622571520:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143779.742619:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143779.742621:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11929 00000100:00100000:3.0:1746143779.742631:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622571648:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143779.742636:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a95ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b223 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.742640:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.742651:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a95b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b22a expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.742661:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.742663:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.742664:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.742666:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.742672:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a95b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b22a expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.742672:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a95ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b223 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.742687:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a95ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b223 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.742688:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a95b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b22a expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.742698:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0a00, rc 0) 00010000:00010000:1.0:1746143779.742698:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c600, rc 0) 00000100:00100000:3.0:1746143779.742862:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622571648:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 232us (4084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.742868:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11929 00000100:00100000:1.0:1746143779.743498:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622571520:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 901us (4752us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.743505:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11928 00000100:00100000:0.0:1746143779.743816:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.744311:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622571776 00000100:00100000:1.0:1746143779.744319:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622571776 00000100:00100000:0.0:1746143779.744331:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.744354:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622571904 00000100:00100000:1.0:1746143779.744357:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622571904 00000100:00100000:0.0:1746143779.744359:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.744376:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622572032 00000100:00100000:1.0:1746143779.744378:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622572160 00000100:00100000:1.0:1746143779.744380:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622572160 00000100:00100000:0.0:1746143779.744380:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622572032 00000100:00100000:1.0:1746143779.744397:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11930 00000100:00100000:0.0:1746143779.744403:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11931 00000100:00100000:1.0:1746143779.744404:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622571776:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143779.744408:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622571904:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143779.744418:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.744418:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.744431:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7d000/0x87925e4cb73a95ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b231 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.744431:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a95c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b238 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.744449:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.744450:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.744451:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.744452:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.744457:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d000/0x87925e4cb73a95ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b231 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.744457:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a95c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b238 expref: 13 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.744469:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d000/0x87925e4cb73a95ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b231 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143779.744469:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a95c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b238 expref: 13 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.744478:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d000, rc 0) 00010000:00010000:0.0:1746143779.744478:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085000, rc 0) 00000100:00100000:2.0:1746143779.744539:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11932 00000100:00100000:2.0:1746143779.744548:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622572160:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143779.744555:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.744562:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d7dc00/0x87925e4cb73a95c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b246 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.744602:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626761984:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143779.744782:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11933 00000100:00100000:3.0:1746143779.744790:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622572032:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143779.744797:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.744804:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a95cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b23f expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.744830:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626762112:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143779.745035:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2010:x1830963622571904:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 624us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.745040:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11931 00000100:00100000:1.0:1746143779.745447:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2011:x1830963622571776:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1042us (3012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.745453:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11930 00000100:00100000:2.0:1746143779.745529:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.745605:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626761856:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.745626:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2990080->3145727] (req 2990080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 33 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.745635:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7c600, rc 0) 00000100:00100000:2.0:1746143779.745651:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+33:32207:x1830963622571392:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9650us (10064us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.745657:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11927 00000100:00100000:2.0:1746143779.745704:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.745747:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.745771:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.745782:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622572800 00000100:00100000:2.0:1746143779.745785:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622572800 00000100:00100000:2.0:1746143779.745803:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 665 00000100:00100000:1.0:1746143779.745807:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622572288 00000100:00100000:2.0:1746143779.745808:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622572800:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143779.745811:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622572288 00000100:00100000:2.0:1746143779.745833:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622572800:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (61us total) trans 0 rc 0/0 00002000:00100000:1.0:1746143779.745836:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3518463) req@ffff880092144380 x1830963622572288/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143779.745838:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 665 00002000:00100000:1.0:1746143779.745846:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144380 with x1830963622572288 ext(3145728->3518463) 00010000:00010000:1.0:1746143779.745852:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 16 pid: 12327 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.745863:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 16 pid: 12327 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143779.745869:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092144380 00000100:00100000:2.0:1746143779.745870:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.747216:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622572544 00000100:00100000:1.0:1746143779.747223:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622572544 00000100:00100000:2.0:1746143779.747254:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.747272:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622573056 00000100:00100000:1.0:1746143779.747275:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622573056 00000100:00100000:2.0:1746143779.747283:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622573312 00000100:00100000:2.0:1746143779.747287:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622573312 00000100:00100000:1.0:1746143779.747306:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1091 00000100:00100000:2.0:1746143779.747311:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1092 00000100:00100000:1.0:1746143779.747313:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+273:2009:x1830963622572544:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143779.747317:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2009:x1830963622573056:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143779.747428:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+273:2009:x1830963622572544:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 115us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.747438:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1091 00000100:00100000:1.0:1746143779.747452:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1093 00000100:00100000:1.0:1746143779.747457:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622573312:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143779.747487:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622573312:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 23us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.747492:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1093 00000100:00100000:1.0:1746143779.747514:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1444 00000100:00100000:1.0:1746143779.747521:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622572288:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143779.747704:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561600 going to sleep for 11 seconds 00000100:00080000:3.0:1746143779.747729:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746143779.747761:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.747778:0:8213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622572416 00000100:00100000:3.0:1746143779.747781:0:8213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622572416 00000100:00100000:3.0:1746143779.747813:0:8213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 190 00000100:00100000:3.0:1746143779.747818:0:8213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2009:x1830963622572416:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1746143779.747838:0:8213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2009:x1830963622572416:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 20us (77us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.747843:0:8213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 190 00000100:00100000:3.0:1746143779.747891:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.747934:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.747945:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622572672 00000100:00100000:3.0:1746143779.747947:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622572672 00000100:00100000:3.0:1746143779.747963:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622572928 00000100:00100000:3.0:1746143779.747965:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622572928 00000100:00100000:3.0:1746143779.747986:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1094 00000100:00100000:3.0:1746143779.747991:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+20:2009:x1830963622572672:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1746143779.748012:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+20:2009:x1830963622572672:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.748017:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1094 00000100:00100000:3.0:1746143779.748025:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1095 00000100:00100000:3.0:1746143779.748028:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622572928:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1746143779.748043:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622572928:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 15us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.748048:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1095 00000100:00080000:3.0:1746143779.748055:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746143779.748075:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.748158:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.748172:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622573440 00000100:00100000:3.0:1746143779.748175:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622573440 00000100:00100000:3.0:1746143779.748197:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1096 00000100:00100000:3.0:1746143779.748201:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2009:x1830963622573440:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1746143779.748231:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2009:x1830963622573440:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 29us (73us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.748236:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1096 00000100:00080000:3.0:1746143779.748247:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746143779.748289:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622573184 00000100:00100000:3.0:1746143779.748292:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622573184 00000100:00100000:3.0:1746143779.748310:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 666 00000100:00100000:3.0:1746143779.748314:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622573184:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1746143779.748337:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622573184:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.748342:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 666 00000100:00100000:2.0:1746143779.748546:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2009:x1830963622573056:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 1228us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.748552:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1092 00002000:00010000:3.0:1746143779.758857:0:9839:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143779 -> 1746143780 00002000:00010000:3.0:1746143779.758867:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143779 -> 1746143780 00002000:00010000:3.0:1746143779.758869:0:9839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143779 -> 1746143780 00000100:00100000:3.0:1746143779.758895:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626762112:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143779.758974:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a95cf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b23f expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.758990:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a95cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b23f expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.759010:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0c00, rc 0) 00000100:00100000:3.0:1746143779.759062:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622572032:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 14272us (14729us total) trans 0 rc 301/301 00002000:00010000:2.0:1746143779.759170:0:1945:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143779 -> 1746143780 00002000:00010000:2.0:1746143779.759174:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143778 -> 1746143780 00002000:00010000:2.0:1746143779.759176:0:1945:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143779 -> 1746143780 00000100:00100000:2.0:1746143779.759187:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626761984:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.759207:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d7dc00/0x87925e4cb73a95c8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b246 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.759216:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7dc00/0x87925e4cb73a95c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b246 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.759237:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7dc00, rc 0) 00000100:00100000:2.0:1746143779.759258:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622572160:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 14713us (14898us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.759267:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11932 00000100:00100000:3.0:1746143779.759374:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11933 00000100:00100000:2.0:1746143779.762982:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622572288:12345-192.168.202.3@tcp:4:cat.0 Request processed in 15449us (17264us total) trans 17179873013 rc 0/0 00000100:00100000:2.0:1746143779.762995:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1444 00002000:00100000:2.0:1746143779.763007:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3518463) req@ffff880092144380 x1830963622572288/t17179873013(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.763017:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144380 with x1830963622572288 ext(3145728->3518463) 00010000:00010000:2.0:1746143779.763028:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 18 pid: 12327 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.763043:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 18 pid: 12327 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143779.763050:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092144380 00000100:00100000:2.0:1746143779.766516:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.766663:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622573696 00000100:00100000:0.0:1746143779.766673:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622573696 00000100:00100000:0.0:1746143779.766796:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12894 00000100:00100000:0.0:1746143779.766806:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:32209:x1830963622573696:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143779.766829:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.766851:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a95d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b24d expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.767005:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143779.767021:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1cf expref: 19 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.767029:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b207 expref: 272 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.767036:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b215 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.767050:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143779.767087:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b215 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.767098:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b215 expref: 14 pid: 6587 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.767111:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626762240:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143779.767192:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b207 expref: 272 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.767201:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b207 expref: 272 pid: 10936 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.767209:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626762368:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143779.767235:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1cf expref: 19 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.767243:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1cf expref: 19 pid: 10936 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.767250:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626762496:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143779.767268:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.770850:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.770962:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626762240:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.770973:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626762368:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.770981:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626762496:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.771006:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143779.771645:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.771738:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.771843:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.771874:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622573952 00000100:00100000:0.0:1746143779.771882:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622573952 00010000:00010000:0.0:1746143779.771942:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b215 expref: 15 pid: 6587 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.771968:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622574080 00000100:00100000:0.0:1746143779.771970:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622574080 00010000:00010000:0.0:1746143779.771982:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 18 pid: 12327 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.771995:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622573824 00000100:00100000:0.0:1746143779.771997:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622573824 00010000:00010000:0.0:1746143779.772005:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b207 expref: 273 pid: 10936 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.772013:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622574208 00000100:00100000:0.0:1746143779.772014:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622574208 00010000:00010000:0.0:1746143779.772020:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1cf expref: 20 pid: 10936 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143779.772030:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5627 00000100:00100000:0.0:1746143779.772037:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622573952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143779.772051:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143779.772056:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b215 expref: 15 pid: 6587 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.772065:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b215 expref: 15 pid: 6587 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.772089:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73a959e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b215 expref: 15 pid: 6587 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.772107:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143779.772111:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143779.772119:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143779.772124:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.772163:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2010:x1830963622573952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 126us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143779.772169:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5627 00000100:00100000:0.0:1746143779.772214:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5628 00000100:00100000:0.0:1746143779.772219:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622574080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143779.772226:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143779.772249:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 18 pid: 12327 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.772257:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 18 pid: 12327 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.772271:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73a9582 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b20e expref: 18 pid: 12327 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143779.772284:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.772287:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143779.772293:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.772302:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.772333:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.772346:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626762624:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143779.772422:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5629 00000100:00100000:2.0:1746143779.772430:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+273:2008:x1830963622573824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143779.772438:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143779.772442:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b207 expref: 273 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.772449:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b207 expref: 273 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.772461:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73a9574 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b207 expref: 273 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143779.772479:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143779.772482:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143779.772487:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143779.772490:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143779.772506:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+272:2008:x1830963622573824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.772510:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5630 00000100:00100000:2.0:1746143779.772514:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5629 00000100:00100000:1.0:1746143779.772518:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622574208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.772525:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.772529:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1cf expref: 20 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.772537:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1cf expref: 20 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.772548:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73a9520 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1cf expref: 20 pid: 10936 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143779.772571:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143779.772574:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143779.772579:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143779.772585:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143779.772891:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143779.772948:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.772955:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143779.772977:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143779.773114:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73a95d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b24d expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.773130:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b24d expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.773136:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.773139:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143779.773141:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085200, rc 0) 00000100:00100000:1.0:1746143779.773529:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622574208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1010us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.773536:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5630 00000100:00100000:3.0:1746143779.773858:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32209:x1830963622573696:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7053us (7356us total) trans 8589943655 rc 0/0 00000100:00100000:3.0:1746143779.773865:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12894 00000100:00100000:3.0:1746143779.774259:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.775390:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.775420:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626762624:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143779.775438:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.775467:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.775481:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622574080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3260us (3837us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.775491:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5628 00000100:00100000:2.0:1746143779.775585:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622574464 00000100:00100000:2.0:1746143779.775593:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622574464 00002000:00100000:2.0:1746143779.775635:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2990080->2994175) req@ffff88007f648e00 x1830963622574464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.775645:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648e00 with x1830963622574464 ext(2990080->2994175) 00002000:00010000:2.0:1746143779.775649:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648e00 00000100:00100000:2.0:1746143779.775666:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3458 00000100:00100000:2.0:1746143779.775672:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622574464:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143779.775798:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622574464:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 125us (411us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143779.775803:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3458 00002000:00100000:2.0:1746143779.775808:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x397:0x0] (2990080->2994175) req@ffff88007f648e00 x1830963622574464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/4536 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.775814:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648e00 with x1830963622574464 ext(2990080->2994175) 00002000:00010000:2.0:1746143779.775818:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648e00 00000100:00100000:3.0:1746143779.775897:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622574592 00000100:00100000:3.0:1746143779.775908:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622574592 00000100:00100000:3.0:1746143779.775965:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12895 00000100:00100000:3.0:1746143779.775970:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32209:x1830963622574592:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143779.775986:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.776003:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a95eb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b254 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.776600:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.776617:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b24d expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.776624:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.776656:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b24d expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.776668:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b24d expref: 15 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143779.776679:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626762752:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.776759:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5610c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.779260:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626762752:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.779287:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143779.779553:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.779646:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622574720 00000100:00100000:3.0:1746143779.779654:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622574720 00010000:00010000:3.0:1746143779.779684:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b24d expref: 16 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143779.779715:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5631 00000100:00100000:3.0:1746143779.779723:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2008:x1830963622574720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.779739:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.779744:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b24d expref: 16 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143779.779755:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b24d expref: 16 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143779.779779:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73a95dd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b24d expref: 16 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143779.779807:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.779811:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.779821:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.779828:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.779845:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143779.780207:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.780398:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622574848 00000100:00100000:2.0:1746143779.780403:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622574848 00000100:00100000:2.0:1746143779.780441:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11934 00000100:00100000:2.0:1746143779.780446:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:32207:x1830963622574848:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143779.780464:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.780478:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b25b expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.780504:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.780512:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.780514:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.780517:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->3760127] (req 3145728->3760127) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 31 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.780540:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.780605:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 15 pid: 9586 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143779.780619:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626762880:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.780736:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2008:x1830963622574720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1012us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.780744:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5631 00000100:00100000:2.0:1746143779.780754:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746143779.780766:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.781873:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143779.781969:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:3.0:1746143779.781974:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143779.782092:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.782137:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a95eb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b254 expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.782151:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b254 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.782159:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.782162:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143779.782164:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5ad800, rc 0) 00000100:00100000:3.0:1746143779.783135:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32209:x1830963622574592:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7159us (7662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.783144:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12895 00000100:00100000:2.0:1746143779.785743:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626762880:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.785783:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->3760127] (req 3145728->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 31 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.785801:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7c000, rc 0) 00000100:00100000:2.0:1746143779.785862:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:32207:x1830963622574848:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5414us (5655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.785872:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11934 00000100:00100000:1.0:1746143779.786117:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.786140:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.786175:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622574976 00000100:00100000:2.0:1746143779.786182:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622574976 00000100:00100000:0.0:1746143779.786208:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622575104 00000100:00100000:0.0:1746143779.786213:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622575104 00000100:00100000:2.0:1746143779.786228:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11935 00000100:00100000:2.0:1746143779.786236:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622574976:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143779.786248:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11936 00010000:00010000:2.0:1746143779.786252:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143779.786254:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622575104:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143779.786262:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.786274:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082085e00/0x87925e4cb73a9607 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b269 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.786335:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7d600/0x87925e4cb73a9600 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b262 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143779.786344:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626763008:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.786359:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626763136:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143779.787191:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.787657:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.788055:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.788156:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622575232 00000100:00100000:1.0:1746143779.788163:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622575232 00002000:00100000:1.0:1746143779.788205:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4030464->4194303) req@ffff88007f649f80 x1830963622575232/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.788215:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649f80 with x1830963622575232 ext(4030464->4194303) 00010000:00010000:1.0:1746143779.788223:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 16 pid: 9586 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143779.788237:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 16 pid: 9586 timeout: 939 lvb_type: 0 00002000:00010000:1.0:1746143779.788248:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f649f80 00000100:00100000:1.0:1746143779.788279:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1445 00000100:00100000:1.0:1746143779.788287:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622575232:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143779.791105:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626763008:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143779.791145:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082085e00/0x87925e4cb73a9607 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b269 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.791160:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082085e00/0x87925e4cb73a9607 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b269 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.791176:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085e00, rc 0) 00000100:00100000:3.0:1746143779.791183:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626763136:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143779.791205:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7d600/0x87925e4cb73a9600 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b262 expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.791214:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d600/0x87925e4cb73a9600 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b262 expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143779.791218:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622575104:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4963us (5076us total) trans 0 rc 301/301 00010000:00010000:3.0:1746143779.791225:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7d600, rc 0) 00000100:00100000:1.0:1746143779.791226:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11936 00000100:00100000:3.0:1746143779.791256:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622574976:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5022us (5141us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143779.791261:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11935 00000100:00100000:0.0:1746143779.792608:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622575232:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4314us (4550us total) trans 21474840339 rc 0/0 00000100:00100000:0.0:1746143779.792621:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1445 00002000:00100000:0.0:1746143779.792631:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4030464->4194303) req@ffff88007f649f80 x1830963622575232/t21474840339(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.792639:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649f80 with x1830963622575232 ext(4030464->4194303) 00010000:00010000:0.0:1746143779.792648:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 18 pid: 9586 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143779.792662:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 18 pid: 9586 timeout: 939 lvb_type: 0 00002000:00010000:0.0:1746143779.792669:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f649f80 00000100:00100000:0.0:1746143779.795606:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.795664:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622575488 00000100:00100000:3.0:1746143779.795674:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622575488 00000100:00100000:3.0:1746143779.795734:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12896 00000100:00100000:3.0:1746143779.795742:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32209:x1830963622575488:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143779.795765:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.795785:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a960e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b270 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.795895:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73a9615 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.795955:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73a9615 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.795966:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73a9615 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.795979:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73a9615 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.795985:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73a9615 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.795991:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73a9615 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.795997:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093717e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.796001:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73a9615 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.796011:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73a9615 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.796021:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.796024:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143779.796027:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73a9615 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.796032:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73a9615 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.796065:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a960e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b270 expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.796071:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a960e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b270 expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.796079:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716600, rc 0) 00000100:00100000:3.0:1746143779.796133:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32209:x1830963622575488:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 392us (536us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143779.796139:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12896 00000100:00100000:0.0:1746143779.801622:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.801733:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.801775:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622575872 00000100:00100000:2.0:1746143779.801786:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622575872 00000100:00100000:2.0:1746143779.801837:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4731 00000100:00100000:3.0:1746143779.801942:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622575616 00000100:00100000:3.0:1746143779.801947:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622575616 00010000:00010000:3.0:1746143779.801973:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 18 pid: 9586 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143779.802010:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5632 00000100:00100000:3.0:1746143779.802018:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622575616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.802034:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.802057:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 18 pid: 9586 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143779.802070:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 18 pid: 9586 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143779.802095:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a952e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1d6 expref: 18 pid: 9586 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143779.802102:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32209:x1830963622575872:12345-192.168.202.3@tcp:35:lfs.0 00010000:00010000:3.0:1746143779.802113:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.802115:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.802122:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.802129:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.802162:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.802175:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626763264:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143779.802252:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5610c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.802282:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:32209:x1830963622575872:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 182us (672us total) trans 8589943656 rc 0/0 00000100:00100000:2.0:1746143779.802288:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4731 00000100:00100000:3.0:1746143779.804554:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626763264:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143779.804578:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143779.804629:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622575616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2610us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.804643:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5632 00000100:00100000:3.0:1746143779.809180:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.809264:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622576128 00000100:00100000:0.0:1746143779.809274:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622576128 00002000:00100000:0.0:1746143779.809328:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3756032->3760127) req@ffff880135b09880 x1830963622576128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.809891:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09880 with x1830963622576128 ext(3756032->3760127) 00002000:00010000:0.0:1746143779.809906:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b09880 00000100:00100000:0.0:1746143779.809968:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3459 00000100:00100000:0.0:1746143779.809977:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622576128:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143779.810144:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622576128:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 167us (975us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143779.810154:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3459 00002000:00100000:0.0:1746143779.810160:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3756032->3760127) req@ffff880135b09880 x1830963622576128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/4536 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143779.810167:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09880 with x1830963622576128 ext(3756032->3760127) 00002000:00010000:0.0:1746143779.810170:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b09880 00000100:00100000:1.0:1746143779.813505:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.814164:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622576384 00000100:00100000:0.0:1746143779.814175:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622576384 00000100:00100000:0.0:1746143779.814468:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4732 00000100:00100000:0.0:1746143779.814476:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:32207:x1830963622576384:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143779.815326:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:32207:x1830963622576384:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 848us (1829us total) trans 8589943657 rc 0/0 00000100:00100000:0.0:1746143779.815333:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4732 00000100:00100000:0.0:1746143779.824285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.824384:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622576640 00000100:00100000:3.0:1746143779.824395:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622576640 00000100:00100000:3.0:1746143779.824467:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12897 00000100:00100000:3.0:1746143779.824475:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+273:32215:x1830963622576640:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.824504:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.824525:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a961c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b277 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.824607:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824621:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824632:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824647:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a962a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824653:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a962a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824658:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a962a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824821:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824832:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824838:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143779.824846:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143779.824971:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824977:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824982:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824988:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.824994:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093716c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.824997:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825003:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825013:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143779.825016:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.825020:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825024:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825045:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a962a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825054:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a962a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825058:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a962a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825062:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093716200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.825065:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a962a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825069:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a962a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825074:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22c00) 00010000:00010000:3.0:1746143779.825076:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.825078:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a962a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825083:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a962a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.825118:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a961c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b277 expref: 276 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.825129:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b277 expref: 275 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.825135:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.825137:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143779.825139:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716600, rc 0) 00000100:00100000:3.0:1746143779.825198:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+275:32215:x1830963622576640:12345-192.168.202.3@tcp:101:cat.0 Request processed in 723us (926us total) trans 8589943658 rc 0/0 00000100:00100000:3.0:1746143779.825203:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12897 00000100:00100000:0.0:1746143779.828089:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.828128:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.828169:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.828297:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622576768 00000100:00100000:2.0:1746143779.828307:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622576768 00000100:00100000:3.0:1746143779.828318:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622576896 00000100:00100000:3.0:1746143779.828322:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622576896 00000100:00100000:2.0:1746143779.828355:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622577024 00000100:00100000:2.0:1746143779.828357:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622577024 00000100:00100000:2.0:1746143779.828474:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11937 00000100:00100000:2.0:1746143779.828483:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963622576768:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.828502:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.828519:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73a963f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b27e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.828535:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11938 00000100:00100000:3.0:1746143779.828541:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622576896:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.828545:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.828547:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.828550:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.828556:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73a963f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b27e expref: 33 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.828560:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a9646 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b285 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.828569:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.828571:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.828571:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73a963f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b27e expref: 33 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.828575:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a9646 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b285 expref: 34 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.828581:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7c400, rc 0) 00010000:00010000:3.0:1746143779.828586:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a9646 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b285 expref: 34 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.828591:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717800, rc 0) 00000100:00100000:2.0:1746143779.828625:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622576768:12345-192.168.202.3@tcp:101:cat.0 Request processed in 143us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.828631:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11937 00000100:00100000:2.0:1746143779.828647:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11939 00000100:00100000:2.0:1746143779.828652:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963622577024:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.828658:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.828663:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a964d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b28c expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.828672:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.828673:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.828677:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a964d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b28c expref: 33 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.828690:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a964d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b28c expref: 33 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.828697:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7d800, rc 0) 00000100:00100000:2.0:1746143779.828711:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622577024:12345-192.168.202.3@tcp:101:cat.0 Request processed in 59us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.828716:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11939 00000100:00100000:3.0:1746143779.828793:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622576896:12345-192.168.202.3@tcp:101:cat.0 Request processed in 251us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.828798:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11938 00010000:00010000:3.0:1746143779.831164:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143779.839309:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.839354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.839368:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.839396:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622577280 00000100:00100000:2.0:1746143779.839406:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622577280 00000100:00100000:1.0:1746143779.839456:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143779.839457:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012b1d9880 x1830963622577280/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.839467:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9880 with x1830963622577280 ext(0->1048575) 00002000:00010000:2.0:1746143779.839472:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d9880 00000100:00100000:2.0:1746143779.839491:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622577664 00000100:00100000:2.0:1746143779.839493:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622577664 00002000:00100000:2.0:1746143779.839504:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b1daa00 x1830963622577664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.839510:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1daa00 with x1830963622577664 ext(1048576->2097151) 00002000:00010000:2.0:1746143779.839513:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1daa00 00000100:00100000:2.0:1746143779.839521:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622577792 00000100:00100000:2.0:1746143779.839523:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622577792 00002000:00100000:2.0:1746143779.839530:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012b1da300 x1830963622577792/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.839536:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da300 with x1830963622577792 ext(1048576->2097151) 00002000:00010000:2.0:1746143779.839540:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1da300 00000100:00100000:2.0:1746143779.839554:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622578048 00000100:00100000:2.0:1746143779.839556:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622578048 00002000:00100000:2.0:1746143779.839568:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88012b1d8e00 x1830963622578048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.839574:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8e00 with x1830963622578048 ext(1048576->2097151) 00002000:00010000:2.0:1746143779.839576:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d8e00 00000100:00100000:2.0:1746143779.839588:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3460 00000100:00100000:2.0:1746143779.839596:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622577280:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143779.839637:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3461 00000100:00100000:0.0:1746143779.839646:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622577664:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.840439:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3462 00000100:00100000:2.0:1746143779.840451:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3463 00000100:00100000:3.0:1746143779.840453:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622577792:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143779.840459:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622578048:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.847934:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622577280:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8299us (8596us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143779.847952:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3460 00002000:00100000:3.0:1746143779.847965:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012b1d9880 x1830963622577280/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.847975:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9880 with x1830963622577280 ext(0->1048575) 00002000:00010000:3.0:1746143779.847981:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d9880 00000100:00100000:2.0:1746143779.851563:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622577664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11904us (12194us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143779.851577:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3461 00002000:00100000:2.0:1746143779.851590:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b1daa00 x1830963622577664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.851600:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1daa00 with x1830963622577664 ext(1048576->2097151) 00002000:00010000:2.0:1746143779.851606:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1daa00 00000100:00100000:2.0:1746143779.856882:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622578048:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16410us (17412us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143779.856896:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3463 00002000:00100000:2.0:1746143779.856948:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88012b1d8e00 x1830963622578048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.856965:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8e00 with x1830963622578048 ext(1048576->2097151) 00002000:00010000:2.0:1746143779.856971:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d8e00 00000100:00100000:3.0:1746143779.857945:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622577792:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17492us (18569us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143779.857955:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3462 00002000:00100000:3.0:1746143779.857963:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012b1da300 x1830963622577792/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.857971:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da300 with x1830963622577792 ext(1048576->2097151) 00002000:00010000:3.0:1746143779.857976:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1da300 00000100:00100000:1.0:1746143779.870199:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.870280:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.870336:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622578304 00000100:00100000:2.0:1746143779.870348:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622578304 00002000:00100000:2.0:1746143779.870399:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012b1d8a80 x1830963622578304/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 504/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.870409:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8a80 with x1830963622578304 ext(2097152->4194303) 00002000:00010000:2.0:1746143779.870415:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d8a80 00000100:00100000:2.0:1746143779.870445:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622578560 00000100:00100000:2.0:1746143779.870447:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622578560 00002000:00100000:2.0:1746143779.870460:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88012b1da680 x1830963622578560/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 504/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.870467:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da680 with x1830963622578560 ext(2097152->4194303) 00002000:00010000:2.0:1746143779.870470:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1da680 00000100:00100000:2.0:1746143779.870560:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3464 00000100:00100000:2.0:1746143779.870568:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622578304:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.870631:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3465 00000100:00100000:3.0:1746143779.870641:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622578560:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.881932:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963622578304:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11322us (11700us total) trans 0 rc 1482752/1482752 00000100:00100000:3.0:1746143779.881946:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3464 00002000:00100000:3.0:1746143779.881960:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012b1d8a80 x1830963622578304/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 504/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1482752/1482752 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.881970:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8a80 with x1830963622578304 ext(2097152->4194303) 00002000:00010000:3.0:1746143779.881976:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d8a80 00000100:00100000:3.0:1746143779.890092:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622578560:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19442us (19799us total) trans 0 rc 1941504/1941504 00000100:00100000:3.0:1746143779.890103:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3465 00002000:00100000:3.0:1746143779.890117:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88012b1da680 x1830963622578560/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 504/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1941504/1941504 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.890126:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da680 with x1830963622578560 ext(2097152->4194303) 00002000:00010000:3.0:1746143779.890133:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1da680 00000100:00100000:0.0:1746143779.894964:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.895097:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622578816 00000100:00100000:3.0:1746143779.895108:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622578816 00000100:00100000:3.0:1746143779.895172:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12898 00000100:00100000:3.0:1746143779.895180:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32218:x1830963622578816:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143779.895204:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.895225:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a9654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b293 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.895309:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895322:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895334:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895346:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9662 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895352:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895356:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895473:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895483:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895488:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143779.895497:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143779.895574:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895580:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895585:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895590:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895595:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093716200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.895598:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895604:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895614:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143779.895617:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.895621:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895629:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73a965b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895657:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895661:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9662 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895666:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895670:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093716c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143779.895671:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895675:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895680:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22f00) 00010000:00010000:3.0:1746143779.895682:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143779.895684:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9662 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895688:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a9662 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.895724:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a9654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b293 expref: 22 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.895736:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b293 expref: 21 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.895746:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.895748:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143779.895750:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ea00, rc 0) 00000100:00100000:3.0:1746143779.895822:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32218:x1830963622578816:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 642us (927us total) trans 8589943659 rc 0/0 00000100:00100000:3.0:1746143779.895833:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12898 00000100:00100000:0.0:1746143779.896816:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.896896:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622579072 00000100:00100000:3.0:1746143779.896930:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622579072 00002000:00100000:3.0:1746143779.896968:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8800919e7b80 x1830963622579072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.896978:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e7b80 with x1830963622579072 ext(4194304->4968447) 00002000:00010000:3.0:1746143779.896982:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919e7b80 00000100:00100000:3.0:1746143779.897255:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3466 00000100:00100000:3.0:1746143779.897263:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622579072:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.902875:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963622579072:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5597us (6048us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143779.902889:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3466 00002000:00100000:3.0:1746143779.902941:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8800919e7b80 x1830963622579072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.902952:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e7b80 with x1830963622579072 ext(4194304->4968447) 00002000:00010000:3.0:1746143779.902959:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919e7b80 00000100:00100000:0.0:1746143779.910366:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.910798:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622579328 00000100:00100000:2.0:1746143779.910809:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622579328 00000100:00100000:2.0:1746143779.910974:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4733 00000100:00100000:2.0:1746143779.910988:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:32215:x1830963622579328:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143779.911288:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:32215:x1830963622579328:12345-192.168.202.3@tcp:35:cat.0 Request processed in 302us (935us total) trans 8589943660 rc 0/0 00000100:00100000:2.0:1746143779.911296:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4733 00000100:00100000:0.0:1746143779.941116:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.941193:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622579584 00000100:00100000:3.0:1746143779.941205:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622579584 00000100:00100000:3.0:1746143779.941272:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12899 00000100:00100000:3.0:1746143779.941281:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32222:x1830963622579584:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.941313:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.941338:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a9677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b29a expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.941453:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.941469:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143779.941479:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143779.941489:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143779.941582:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73a9677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b29a expref: 24 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.941610:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b29a expref: 23 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.941617:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143779.941620:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143779.941623:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716c00, rc 0) 00000100:00100000:3.0:1746143779.941679:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32222:x1830963622579584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 399us (575us total) trans 8589943661 rc 0/0 00000100:00100000:3.0:1746143779.941684:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12899 00000100:00100000:2.0:1746143779.946375:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.946424:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.946483:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622579712 00000100:00100000:1.0:1746143779.946494:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622579712 00000100:00100000:1.0:1746143779.946545:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622579840 00000100:00100000:1.0:1746143779.946548:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622579840 00000100:00100000:1.0:1746143779.946566:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11940 00000100:00100000:1.0:1746143779.946574:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622579712:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143779.946584:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11941 00000100:00100000:0.0:1746143779.946591:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622579840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143779.946594:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143779.946598:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.946612:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a9693 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2a1 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143779.946612:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a968c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2a8 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143779.946664:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626763392:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143779.946664:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626763520:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143779.947062:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.947543:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.948378:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626763392:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143779.948409:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a9693 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2a1 expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.948422:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2800/0x87925e4cb73a9693 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2a1 expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143779.948641:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626763520:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143779.948658:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a968c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2a8 expref: 18 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.948666:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a968c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2a8 expref: 18 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143779.948677:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75000, rc 0) 00000100:00100000:2.0:1746143779.948712:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622579840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2121us (2287us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143779.948720:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11941 00010000:00010000:1.0:1746143779.948845:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2800, rc 0) 00000100:00100000:1.0:1746143779.948868:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622579712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2294us (2504us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143779.948873:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11940 00000100:00100000:0.0:1746143779.956393:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.956454:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622579968 00000100:00100000:1.0:1746143779.956463:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622579968 00000100:00100000:1.0:1746143779.956507:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11942 00000100:00100000:1.0:1746143779.956516:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:32218:x1830963622579968:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143779.956539:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143779.956579:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2af expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.956615:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a94fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ba expref: 33 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.956622:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d000/0x87925e4cb73a95ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b231 expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.956626:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a953c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1eb expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.956630:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.956631:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.956634:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1654784->2097151] (req 1654784->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 18 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.956660:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a953c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1eb expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.956668:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a953c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1eb expref: 18 pid: 9585 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143779.956678:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626763648:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143779.956974:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d000/0x87925e4cb73a95ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b231 expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.956984:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d000/0x87925e4cb73a95ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b231 expref: 12 pid: 3135 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143779.956993:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626763776:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143779.957025:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a94fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ba expref: 33 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143779.957034:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a94fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ba expref: 33 pid: 9839 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143779.957041:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626763904:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143779.957060:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.957288:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.957319:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.957358:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622580096 00000100:00100000:3.0:1746143779.957362:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622580096 00000100:00100000:3.0:1746143779.957391:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622580224 00000100:00100000:3.0:1746143779.957393:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622580224 00000100:00100000:3.0:1746143779.957406:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11943 00000100:00100000:3.0:1746143779.957412:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622580096:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143779.957419:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.957430:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a96a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2b6 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.957435:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11944 00000100:00100000:2.0:1746143779.957443:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622580224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.957449:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143779.957458:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d7d600/0x87925e4cb73a96a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2bd expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.957459:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626764032:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143779.957478:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626764160:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143779.957515:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c50f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143779.957515:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.961199:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626764032:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143779.961204:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.961215:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626763648:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143779.961227:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.961233:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626763776:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.961238:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a96a1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2b6 expref: 18 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.961251:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a96a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2b6 expref: 18 pid: 9839 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143779.961255:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143779.961274:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5acc00, rc 0) 00000100:00100000:2.0:1746143779.961321:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622580352 00000100:00100000:3.0:1746143779.961322:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622580096:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3909us (4033us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143779.961323:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626763904:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.961328:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622580352 00000100:00100000:3.0:1746143779.961329:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11943 00010000:00010000:1.0:1746143779.961349:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1654784->2097151] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 20 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.961356:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d000/0x87925e4cb73a95ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b231 expref: 13 pid: 3135 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143779.961361:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622580480 00000100:00100000:3.0:1746143779.961363:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622580480 00010000:00010000:1.0:1746143779.961363:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2600, rc 0) 00010000:00010000:3.0:1746143779.961371:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a953c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1eb expref: 21 pid: 9585 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143779.961374:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622580608 00000100:00100000:2.0:1746143779.961377:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622580608 00000100:00100000:1.0:1746143779.961383:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32218:x1830963622579968:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4869us (4999us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.961385:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5633 00010000:00010000:2.0:1746143779.961385:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a94fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ba expref: 34 pid: 9839 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143779.961389:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11942 00000100:00100000:3.0:1746143779.961392:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622580352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143779.961397:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5634 00000100:00100000:2.0:1746143779.961401:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622580480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.961405:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143779.961406:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143779.961413:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5635 00010000:00010000:2.0:1746143779.961416:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a953c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1eb expref: 20 pid: 9585 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143779.961417:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7d000/0x87925e4cb73a95ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b231 expref: 13 pid: 3135 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143779.961418:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622580608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143779.961425:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a953c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1eb expref: 20 pid: 9585 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143779.961426:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.961432:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7d000/0x87925e4cb73a95ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b231 expref: 13 pid: 3135 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143779.961509:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a953c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1eb expref: 20 pid: 9585 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143779.961511:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a94fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ba expref: 34 pid: 9839 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143779.961512:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d000/0x87925e4cb73a95ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b231 expref: 13 pid: 3135 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143779.961521:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a94fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ba expref: 34 pid: 9839 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143779.961527:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143779.961534:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73a94fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1ba expref: 34 pid: 9839 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143779.961542:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622580352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 151us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.961549:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5633 00010000:00010000:2.0:1746143779.961553:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.961554:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143779.961561:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.961568:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.961596:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143779.961608:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626764288:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143779.961613:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626764160:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143779.961628:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d7d600/0x87925e4cb73a96a8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2bd expref: 19 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.961635:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d600/0x87925e4cb73a96a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2bd expref: 19 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.961642:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7d600, rc 0) 00000100:00100000:3.0:1746143779.961656:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963622580224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4215us (4336us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143779.961661:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11944 00000100:00100000:2.0:1746143779.961661:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe240 going to sleep for 11 seconds 00010000:00010000:1.0:1746143779.961876:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.961893:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622580608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 474us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.961931:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5635 00000100:00100000:2.0:1746143779.963252:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626764288:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143779.963266:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143779.963292:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622580480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1889us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.963299:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5634 00000100:00100000:0.0:1746143779.964059:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.964121:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.964165:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622580992 00000100:00100000:2.0:1746143779.964172:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622580992 00000100:00100000:2.0:1746143779.964223:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11945 00000100:00100000:2.0:1746143779.964230:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:32222:x1830963622580992:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143779.964252:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143779.964264:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622580864 00000100:00100000:3.0:1746143779.964268:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622580864 00010000:00010000:2.0:1746143779.964271:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2c4 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143779.964295:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1654784->1658879) req@ffff8800919e5880 x1830963622580864/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746143779.964298:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 32 pid: 9839 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143779.964304:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e5880 with x1830963622580864 ext(1654784->1658879) 00010000:00010000:2.0:1746143779.964305:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143779.964307:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00002000:00010000:3.0:1746143779.964309:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919e5880 00010000:00010000:2.0:1746143779.964310:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.964321:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3467 00000100:00100000:3.0:1746143779.964325:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622580864:12345-192.168.202.3@tcp:3:multiop.0 00010000:00010000:2.0:1746143779.964336:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 32 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.964347:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 32 pid: 9839 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143779.964363:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626764416:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143779.964417:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143779.964435:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622580864:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 109us (378us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143779.964441:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3467 00002000:00100000:3.0:1746143779.964446:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1654784->1658879) req@ffff8800919e5880 x1830963622580864/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/4536 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.964453:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e5880 with x1830963622580864 ext(1654784->1658879) 00002000:00010000:3.0:1746143779.964455:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919e5880 00000100:00100000:0.0:1746143779.967319:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.967626:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626764416:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143779.967657:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143779.967675:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521800, rc 0) 00000100:00100000:2.0:1746143779.967723:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32222:x1830963622580992:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3493us (3601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143779.967733:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11945 00000100:00100000:1.0:1746143779.968106:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622581120 00000100:00100000:1.0:1746143779.968114:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622581120 00002000:00100000:1.0:1746143779.968156:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3760127) req@ffff8800919e4e00 x1830963622581120/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.968165:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e4e00 with x1830963622581120 ext(3145728->3760127) 00010000:00010000:1.0:1746143779.968172:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 33 pid: 9839 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143779.968183:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 33 pid: 9839 timeout: 939 lvb_type: 0 00002000:00010000:1.0:1746143779.968190:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919e4e00 00000100:00100000:1.0:1746143779.968215:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1446 00000100:00100000:1.0:1746143779.968222:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622581120:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143779.970844:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.973328:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622581248 00000100:00100000:3.0:1746143779.973344:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622581248 00000100:00100000:3.0:1746143779.973403:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11946 00000100:00100000:3.0:1746143779.973412:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32218:x1830963622581248:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143779.973433:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143779.973453:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2cb expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.973484:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9551 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f2 expref: 19 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.973498:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a964d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b28c expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.973505:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a95c1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b238 expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.973522:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.973524:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143779.973527:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->1261567] (req 1048576->1261567) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 19 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.973562:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a95c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b238 expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.973573:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a95c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b238 expref: 11 pid: 13430 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143779.973585:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626764544:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.973686:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a964d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b28c expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.973694:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a964d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b28c expref: 34 pid: 9586 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143779.973702:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626764672:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.973728:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9551 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f2 expref: 19 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143779.973734:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9551 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f2 expref: 19 pid: 13436 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143779.973741:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626764800:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143779.973756:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c50f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.975455:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622581120:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7227us (8141us total) trans 21474840340 rc 0/0 00000100:00100000:1.0:1746143779.975467:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1446 00002000:00100000:1.0:1746143779.975478:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3760127) req@ffff8800919e4e00 x1830963622581120/t21474840340(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:175/0 lens 488/448 e 0 to 0 dl 1746143790 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143779.975488:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e4e00 with x1830963622581120 ext(3145728->3760127) 00010000:00010000:1.0:1746143779.975499:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 35 pid: 9839 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143779.975509:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 35 pid: 9839 timeout: 939 lvb_type: 0 00002000:00010000:1.0:1746143779.975515:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919e4e00 00000100:00100000:0.0:1746143779.979317:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.979345:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.979380:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.979493:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622581376 00000100:00100000:3.0:1746143779.979503:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622581376 00010000:00010000:3.0:1746143779.979541:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a95c1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b238 expref: 12 pid: 13430 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143779.979560:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622581504 00000100:00100000:1.0:1746143779.979565:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622581504 00000100:00100000:3.0:1746143779.979580:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622581632 00010000:00010000:1.0:1746143779.979581:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a964d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b28c expref: 35 pid: 9586 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143779.979582:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622581632 00010000:00010000:3.0:1746143779.979592:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9551 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f2 expref: 20 pid: 13436 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143779.979602:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5636 00000100:00100000:1.0:1746143779.979613:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622581376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.979628:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.979649:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a95c1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b238 expref: 12 pid: 13430 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143779.979664:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a95c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b238 expref: 12 pid: 13430 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143779.979689:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.979731:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622581376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 123us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.979732:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5637 00000100:00100000:1.0:1746143779.979736:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5636 00000100:00100000:3.0:1746143779.979739:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622581504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143779.979747:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143779.979752:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5638 00010000:00010000:3.0:1746143779.979756:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a964d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b28c expref: 35 pid: 9586 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143779.979757:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622581632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.979762:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143779.979765:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a964d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b28c expref: 35 pid: 9586 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143779.980169:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9551 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f2 expref: 20 pid: 13436 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143779.980173:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143779.980177:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9551 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f2 expref: 20 pid: 13436 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143779.980188:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.980190:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.980197:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.980202:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622581504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 463us (854us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143779.980204:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143779.980208:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5637 00010000:00010000:1.0:1746143779.980233:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143779.980246:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626764928:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143779.980255:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a95c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b238 expref: 11 pid: 13430 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143779.980271:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626764544:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.980281:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a964d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b28c expref: 34 pid: 9586 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143779.980294:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626764672:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.980304:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9551 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1f2 expref: 20 pid: 13436 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143779.980313:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626764800:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143779.980341:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 19 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143779.980349:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30a00, rc 0) 00000100:00100000:3.0:1746143779.980370:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32218:x1830963622581248:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6959us (9537us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143779.980376:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11946 00000100:00100000:1.0:1746143779.980771:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143779.982808:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626764928:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143779.982837:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.983149:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622581632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3390us (3766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.983161:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5638 00000100:00100000:0.0:1746143779.984616:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143779.984665:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.984722:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622582016 00000100:00100000:2.0:1746143779.984735:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622582016 00000100:00100000:1.0:1746143779.984758:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622581760 00000100:00100000:1.0:1746143779.984761:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622581760 00002000:00100000:2.0:1746143779.984780:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1257472->1261567) req@ffff8800972e8380 x1830963622582016/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143779.984782:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 34 pid: 9839 timeout: 939 lvb_type: 0 00002000:00100000:2.0:1746143779.984789:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8380 with x1830963622582016 ext(1257472->1261567) 00002000:00010000:2.0:1746143779.984794:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8380 00000100:00100000:2.0:1746143779.984823:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3468 00000100:00100000:1.0:1746143779.984823:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5639 00000100:00100000:2.0:1746143779.984830:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622582016:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143779.984830:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622581760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143779.984850:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143779.984872:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 34 pid: 9839 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143779.984884:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 34 pid: 9839 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143779.984944:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c000/0x87925e4cb73a95f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b25b expref: 34 pid: 9839 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143779.984967:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.984969:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143779.984976:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.984983:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143779.985018:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143779.985033:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626765056:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143779.985211:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622582016:12345-192.168.202.3@tcp:3:cat.0 Request processed in 380us (544us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143779.985218:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3468 00002000:00100000:2.0:1746143779.985224:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b5:0x0] (1257472->1261567) req@ffff8800972e8380 x1830963622582016/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/4536 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.985237:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8380 with x1830963622582016 ext(1257472->1261567) 00002000:00010000:2.0:1746143779.985239:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8380 00000100:00100000:1.0:1746143779.985318:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143779.987341:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143779.987446:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626765056:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143779.987466:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143779.987502:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622581760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2672us (2893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143779.987512:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5639 00000100:00100000:2.0:1746143779.987677:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622582272 00000100:00100000:2.0:1746143779.987685:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622582272 00000100:00100000:2.0:1746143779.987731:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4734 00000100:00100000:2.0:1746143779.987737:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32218:x1830963622582272:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143779.987963:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32218:x1830963622582272:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 226us (628us total) trans 8589943662 rc 0/0 00000100:00100000:2.0:1746143779.987969:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4734 00000100:00100000:0.0:1746143779.988566:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143779.988627:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622582528 00000100:00100000:2.0:1746143779.988630:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622582528 00002000:00100000:2.0:1746143779.988654:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff8800972ead80 x1830963622582528/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/0 e 0 to 0 dl 1746143790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143779.988663:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ead80 with x1830963622582528 ext(2097152->3145727) 00002000:00010000:2.0:1746143779.988668:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972ead80 00000100:00100000:2.0:1746143779.988859:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3469 00000100:00100000:2.0:1746143779.988866:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622582528:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143779.995714:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622582528:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6834us (7135us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143779.995728:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3469 00002000:00100000:3.0:1746143779.995742:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff8800972ead80 x1830963622582528/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:175/0 lens 488/440 e 0 to 0 dl 1746143790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143779.995753:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ead80 with x1830963622582528 ext(2097152->3145727) 00002000:00010000:3.0:1746143779.995760:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972ead80 00000100:00100000:0.0:1746143779.999811:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143779.999948:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622582656 00000100:00100000:3.0:1746143779.999958:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622582656 00000100:00100000:3.0:1746143780.000007:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11947 00000100:00100000:3.0:1746143780.000020:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:32222:x1830963622582656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.000040:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.000063:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2d2 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.000094:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.000101:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143780.000103:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143780.000106:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.000139:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.000151:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 32 pid: 12327 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.000164:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626765184:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143780.000425:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c50f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.002227:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.002334:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626765184:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.002354:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622582784 00000100:00100000:2.0:1746143780.002361:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622582784 00010000:00010000:3.0:1746143780.002362:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.002378:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504400, rc 0) 00002000:00100000:2.0:1746143780.002405:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2990080->3145727) req@ffff8800972e9500 x1830963622582784/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.002415:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9500 with x1830963622582784 ext(2990080->3145727) 00000100:00100000:3.0:1746143780.002417:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32222:x1830963622582656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2398us (2618us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143780.002421:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 33 pid: 12327 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.002424:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11947 00010000:00010000:2.0:1746143780.002436:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 33 pid: 12327 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143780.002442:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972e9500 00000100:00100000:2.0:1746143780.002457:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1447 00000100:00100000:2.0:1746143780.002464:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963622582784:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143780.008197:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622582784:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5721us (5964us total) trans 17179873014 rc 0/0 00000100:00100000:2.0:1746143780.008211:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1447 00002000:00100000:2.0:1746143780.008224:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2990080->3145727) req@ffff8800972e9500 x1830963622582784/t17179873014(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/448 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.008235:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9500 with x1830963622582784 ext(2990080->3145727) 00010000:00010000:2.0:1746143780.008247:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 35 pid: 12327 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.008264:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 35 pid: 12327 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143780.008271:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972e9500 00000100:00100000:0.0:1746143780.012525:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.012639:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622582912 00000100:00100000:1.0:1746143780.012650:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622582912 00010000:00010000:1.0:1746143780.012692:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 35 pid: 12327 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.012736:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5640 00000100:00100000:1.0:1746143780.012744:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622582912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143780.012760:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143780.012782:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 35 pid: 12327 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.012794:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 35 pid: 12327 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.012818:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73a95a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b21c expref: 35 pid: 12327 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.012846:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.012848:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.012856:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.012864:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.012954:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.012967:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626765312:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143780.013103:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.014513:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626765312:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143780.014533:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143780.014565:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622582912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1821us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.014576:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5640 00000100:00100000:0.0:1746143780.018966:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.019051:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622583296 00000100:00100000:2.0:1746143780.019063:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622583296 00000100:00100000:1.0:1746143780.019101:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143780.019115:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800972eaa00 x1830963622583296/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.019130:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eaa00 with x1830963622583296 ext(2097152->4194303) 00002000:00010000:2.0:1746143780.019137:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972eaa00 00000100:00100000:2.0:1746143780.019172:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622583424 00000100:00100000:2.0:1746143780.019175:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622583424 00002000:00100000:2.0:1746143780.019191:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800921cc700 x1830963622583424/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.019197:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc700 with x1830963622583424 ext(3145728->4194303) 00002000:00010000:2.0:1746143780.019200:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cc700 00000100:00100000:2.0:1746143780.019223:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3470 00000100:00100000:2.0:1746143780.019231:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622583296:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143780.019244:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3471 00000100:00100000:3.0:1746143780.019252:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622583424:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143780.039511:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.039673:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622583680 00000100:00100000:2.0:1746143780.039685:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622583680 00000100:00100000:3.0:1746143780.039989:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622583424:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20736us (20886us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143780.040001:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3471 00002000:00100000:3.0:1746143780.040013:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800921cc700 x1830963622583424/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.040022:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc700 with x1830963622583424 ext(3145728->4194303) 00002000:00010000:3.0:1746143780.040028:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cc700 00000100:00100000:2.0:1746143780.040092:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12900 00000100:00100000:2.0:1746143780.040100:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+276:32226:x1830963622583680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143780.040124:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.040145:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a96c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2d9 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.040255:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.040270:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.040281:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143780.040293:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143780.040394:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73a96c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d9 expref: 279 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.041068:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d9 expref: 278 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.041077:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143780.041080:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143780.041084:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27800, rc 0) 00000100:00100000:2.0:1746143780.041338:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+278:32226:x1830963622583680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1237us (1838us total) trans 8589943663 rc 0/0 00000100:00100000:2.0:1746143780.041344:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12900 00000100:00100000:2.0:1746143780.041955:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622583296:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22723us (22999us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143780.041964:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3470 00002000:00100000:2.0:1746143780.041972:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800972eaa00 x1830963622583296/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.041980:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eaa00 with x1830963622583296 ext(2097152->4194303) 00002000:00010000:2.0:1746143780.041985:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972eaa00 00000100:00100000:0.0:1746143780.043502:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.043533:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.043558:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.043560:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622583808 00000100:00100000:3.0:1746143780.043569:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622583808 00000100:00100000:0.0:1746143780.043591:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.043609:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622584064 00000100:00100000:0.0:1746143780.043612:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622584064 00000100:00100000:3.0:1746143780.043614:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622583936 00000100:00100000:3.0:1746143780.043617:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622583936 00000100:00100000:3.0:1746143780.043641:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622584192 00000100:00100000:3.0:1746143780.043644:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622584192 00000100:00100000:3.0:1746143780.043657:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11948 00000100:00100000:3.0:1746143780.043664:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622583808:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143780.043671:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11949 00000100:00100000:1.0:1746143780.043679:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622584064:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.043682:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.043687:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.043699:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73a96e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2e0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.043699:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a96d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2ee expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.043720:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.043722:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.043731:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a96d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2ee expref: 35 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143780.043746:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626765440:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143780.043746:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a96d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2ee expref: 35 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.043756:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137a00, rc 0) 00000100:00100000:3.0:1746143780.043812:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c50f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143780.043826:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11950 00000100:00100000:3.0:1746143780.043830:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622583936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.043834:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.043840:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73a96e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2e7 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143780.043856:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11951 00000100:00100000:3.0:1746143780.043857:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626765568:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143780.043863:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622584192:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143780.043869:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143780.043871:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746143780.043880:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a96ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2f5 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.043891:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143780.043892:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143780.043906:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a96ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2f5 expref: 37 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143780.043936:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a96ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2f5 expref: 37 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143780.043943:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c800, rc 0) 00000100:00100000:0.0:1746143780.043960:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622584192:12345-192.168.202.3@tcp:101:cat.0 Request processed in 98us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143780.043965:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11951 00000100:00100000:1.0:1746143780.044041:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622584064:12345-192.168.202.3@tcp:101:cat.0 Request processed in 362us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.044047:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11949 00002000:00010000:3.0:1746143780.046717:0:3134:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime: 1746143779 -> 1746143780 00002000:00010000:3.0:1746143780.046724:0:3134:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143779 -> 1746143780 00002000:00010000:3.0:1746143780.046726:0:3134:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime: 1746143779 -> 1746143780 00000100:00100000:3.0:1746143780.046748:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626765440:192.168.202.3@tcp:106: 00002000:00010000:2.0:1746143780.046950:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime: 1746143779 -> 1746143780 00002000:00010000:2.0:1746143780.046953:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime: 1746143779 -> 1746143780 00002000:00010000:2.0:1746143780.046955:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime: 1746143779 -> 1746143780 00000100:00100000:2.0:1746143780.046969:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626765568:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143780.046996:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73a96e7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2e7 expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.047009:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73a96e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2e7 expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.047021:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717a00, rc 0) 00000100:00100000:2.0:1746143780.047063:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622583936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3230us (3502us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143780.047071:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11950 00010000:00010000:3.0:1746143780.047158:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73a96e0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2e0 expref: 36 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.047167:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73a96e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2e0 expref: 36 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.047180:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e505400, rc 0) 00000100:00100000:3.0:1746143780.047199:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622583808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3536us (3703us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143780.047204:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11948 00000100:00100000:0.0:1746143780.049517:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.049679:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622584448 00000100:00100000:2.0:1746143780.049689:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622584448 00002000:00100000:2.0:1746143780.049742:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8800972e8000 x1830963622584448/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.049753:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8000 with x1830963622584448 ext(4194304->4968447) 00002000:00010000:2.0:1746143780.049759:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8000 00000100:00100000:2.0:1746143780.049797:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3472 00000100:00100000:2.0:1746143780.049805:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622584448:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143780.056435:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.056503:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622584704 00000100:00100000:2.0:1746143780.056513:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622584704 00000100:00100000:3.0:1746143780.056551:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622584448:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6745us (7042us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143780.056559:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12901 00000100:00100000:3.0:1746143780.056561:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3472 00000100:00100000:2.0:1746143780.056566:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+278:32228:x1830963622584704:12345-192.168.202.3@tcp:101:multiop.0 00002000:00100000:3.0:1746143780.056572:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8800972e8000 x1830963622584448/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.056580:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8000 with x1830963622584448 ext(4194304->4968447) 00002000:00010000:3.0:1746143780.056585:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8000 00010000:00010000:2.0:1746143780.056591:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.056610:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73a96f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b2fc expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.056723:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.056742:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b254 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.057686:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b277 expref: 279 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.057693:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b293 expref: 23 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.057701:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.057736:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b293 expref: 23 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.057749:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b293 expref: 23 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.057761:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626765696:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.057849:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b277 expref: 279 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.057856:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b277 expref: 279 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.057863:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626765824:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.058572:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b254 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.058581:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b254 expref: 14 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.058590:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626765952:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.058613:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.062619:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.062672:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.062818:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626765696:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.062834:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626765824:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.062867:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622584832 00000100:00100000:1.0:1746143780.062875:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622584832 00010000:00010000:1.0:1746143780.062950:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b293 expref: 24 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.062992:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5641 00000100:00100000:1.0:1746143780.063002:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622584832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143780.063017:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143780.063022:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b293 expref: 24 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.063032:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b293 expref: 24 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.063059:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73a9669 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b293 expref: 24 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.063081:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00000100:00100000:3.0:1746143780.063083:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622584960 00010000:00010000:1.0:1746143780.063086:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143780.063088:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622584960 00010000:00010000:1.0:1746143780.063095:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143780.063100:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.063122:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11952 00000100:00100000:3.0:1746143780.063127:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:32226:x1830963622584960:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143780.063143:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622584832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 142us (532us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143780.063145:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143780.063149:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5641 00010000:00010000:3.0:1746143780.063160:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b303 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.063183:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 17 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.063191:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143780.063193:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143780.063197:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.063225:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 17 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.063235:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 17 pid: 1945 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.063246:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626766080:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143780.063288:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143780.063875:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.063910:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.063946:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622585216 00000100:00100000:2.0:1746143780.063949:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622585216 00010000:00010000:2.0:1746143780.063975:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b254 expref: 15 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.063990:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622585088 00000100:00100000:2.0:1746143780.063992:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622585088 00010000:00010000:2.0:1746143780.064001:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b277 expref: 280 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.064013:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5642 00000100:00100000:2.0:1746143780.064018:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622585216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.064026:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.064031:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b254 expref: 15 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.064038:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b254 expref: 15 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.064049:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143780.064053:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.064060:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.064064:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143780.064083:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622585216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.064088:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5642 00000100:00100000:2.0:1746143780.064100:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5643 00000100:00100000:2.0:1746143780.064104:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+280:2010:x1830963622585088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.064110:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.064114:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b277 expref: 280 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.064121:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b277 expref: 280 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.064131:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73a9631 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b277 expref: 280 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.064143:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143780.064146:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.064151:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.064156:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.064168:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143780.064179:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:2010:x1830963622585088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.064184:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5643 00000100:00080000:3.0:1746143780.064283:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746143780.064688:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a95f2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b254 expref: 14 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143780.064710:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626765952:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143780.064730:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143780.064738:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143780.064743:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143780.064762:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:0.0:1746143780.064885:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73a96f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2fc expref: 280 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.064909:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2fc expref: 279 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.064933:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143780.064936:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143780.064938:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26800, rc 0) 00000100:00100000:0.0:1746143780.064971:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+279:32228:x1830963622584704:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8406us (8548us total) trans 8589943664 rc 0/0 00000100:00100000:0.0:1746143780.064977:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12901 00000100:00100000:3.0:1746143780.065116:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626766080:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143780.065133:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.065144:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31200, rc 0) 00000100:00100000:3.0:1746143780.065160:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:32226:x1830963622584960:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2034us (2489us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.065165:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11952 00000100:00100000:0.0:1746143780.066979:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.067105:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622585344 00000100:00100000:3.0:1746143780.067113:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622585344 00002000:00100000:3.0:1746143780.067152:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x396:0x0] (1654784->2097151) req@ffff8800972ea680 x1830963622585344/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.067162:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ea680 with x1830963622585344 ext(1654784->2097151) 00010000:00010000:3.0:1746143780.067170:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 18 pid: 1945 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.067182:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 18 pid: 1945 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.067188:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972ea680 00000100:00100000:3.0:1746143780.067209:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1448 00000100:00100000:3.0:1746143780.067215:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622585344:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143780.075827:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622585344:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8599us (8843us total) trans 17179873015 rc 0/0 00000100:00100000:3.0:1746143780.075840:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1448 00002000:00100000:3.0:1746143780.075852:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x396:0x0] (1654784->2097151) req@ffff8800972ea680 x1830963622585344/t17179873015(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/448 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.075862:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ea680 with x1830963622585344 ext(1654784->2097151) 00010000:00010000:3.0:1746143780.075873:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 20 pid: 1945 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.075888:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 20 pid: 1945 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.075907:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972ea680 00000100:00100000:0.0:1746143780.077876:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.077959:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622585472 00000100:00100000:1.0:1746143780.077970:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622585472 00010000:00010000:1.0:1746143780.078010:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 20 pid: 1945 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.078047:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5644 00000100:00100000:1.0:1746143780.078054:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622585472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143780.078070:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143780.078088:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 20 pid: 1945 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.078098:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 20 pid: 1945 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.078121:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2600/0x87925e4cb73a969a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2af expref: 20 pid: 1945 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.078154:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.078156:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.078164:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.078171:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.078205:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.078217:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626766208:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143780.078301:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.081481:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.081523:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626766208:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143780.081550:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.081581:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622585728 00000100:00100000:3.0:1746143780.081590:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622585728 00002000:00100000:3.0:1746143780.081631:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800972e8700 x1830963622585728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.081640:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8700 with x1830963622585728 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.081645:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e8700 00000100:00100000:3.0:1746143780.081676:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3473 00000100:00100000:3.0:1746143780.081682:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622585728:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143780.081838:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622585472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3782us (3965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.081848:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5644 00000100:00100000:3.0:1746143780.091516:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622585728:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9819us (10033us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143780.091529:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3473 00002000:00100000:3.0:1746143780.091542:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800972e8700 x1830963622585728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.091553:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8700 with x1830963622585728 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.091560:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e8700 00000100:00100000:0.0:1746143780.096143:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.096245:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622585856 00000100:00100000:3.0:1746143780.096255:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622585856 00000100:00100000:3.0:1746143780.096320:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11953 00000100:00100000:3.0:1746143780.096330:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+34:32226:x1830963622585856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.096350:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.096369:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b30a expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.096399:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.096406:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143780.096408:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143780.096412:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.096446:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.096458:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 17 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.096469:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626766336:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143780.096592:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143780.098554:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626766336:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143780.098579:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.098590:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:3.0:1746143780.098633:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:32226:x1830963622585856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2305us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.098639:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11953 00000100:00100000:0.0:1746143780.099672:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.099870:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622585984 00000100:00100000:3.0:1746143780.099876:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622585984 00002000:00100000:3.0:1746143780.099932:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1261567) req@ffff880093072d80 x1830963622585984/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.099940:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093072d80 with x1830963622585984 ext(1048576->1261567) 00010000:00010000:3.0:1746143780.099946:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 18 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.099960:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 18 pid: 9587 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.099965:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093072d80 00000100:00100000:3.0:1746143780.099986:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1449 00000100:00100000:3.0:1746143780.099992:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622585984:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143780.107143:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622585984:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7137us (7459us total) trans 21474840341 rc 0/0 00000100:00100000:3.0:1746143780.107158:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1449 00002000:00100000:3.0:1746143780.107173:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1261567) req@ffff880093072d80 x1830963622585984/t21474840341(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/448 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.107183:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093072d80 with x1830963622585984 ext(1048576->1261567) 00010000:00010000:3.0:1746143780.107194:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.107211:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.107218:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093072d80 00000100:00100000:0.0:1746143780.111025:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.111120:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622586112 00000100:00100000:1.0:1746143780.111127:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622586112 00010000:00010000:1.0:1746143780.111160:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.111193:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5645 00000100:00100000:1.0:1746143780.111200:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622586112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143780.111212:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143780.111229:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.111239:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.111258:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73a96b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2cb expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.111293:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.111295:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.111302:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.111309:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.111338:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.111351:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626766464:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143780.111418:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.115521:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626766464:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143780.115540:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143780.115577:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622586112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4377us (4558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.115585:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5645 00000100:00100000:0.0:1746143780.115968:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.116053:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622586368 00000100:00100000:3.0:1746143780.116059:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622586368 00002000:00100000:3.0:1746143780.116090:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880093073800 x1830963622586368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.116099:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093073800 with x1830963622586368 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.116104:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093073800 00000100:00100000:3.0:1746143780.116133:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3474 00000100:00100000:3.0:1746143780.116139:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622586368:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143780.122146:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622586368:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5999us (6171us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143780.122157:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3474 00002000:00100000:3.0:1746143780.122166:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880093073800 x1830963622586368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.122174:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093073800 with x1830963622586368 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.122179:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093073800 00000100:00100000:0.0:1746143780.130994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.131038:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.131137:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622586752 00000100:00100000:2.0:1746143780.131148:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622586752 00002000:00100000:2.0:1746143780.131201:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880093071500 x1830963622586752/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.131210:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071500 with x1830963622586752 ext(2097152->4194303) 00002000:00010000:2.0:1746143780.131216:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093071500 00000100:00100000:2.0:1746143780.131235:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622586880 00000100:00100000:2.0:1746143780.131238:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622586880 00002000:00100000:2.0:1746143780.131250:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880093071c00 x1830963622586880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.131256:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071c00 with x1830963622586880 ext(2097152->4194303) 00002000:00010000:2.0:1746143780.131259:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093071c00 00000100:00100000:3.0:1746143780.131279:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3475 00000100:00100000:3.0:1746143780.131301:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622586752:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143780.131827:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3476 00000100:00100000:2.0:1746143780.131837:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622586880:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143780.134338:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.134621:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622587008 00000100:00100000:3.0:1746143780.134631:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622587008 00000100:00100000:3.0:1746143780.134685:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11954 00000100:00100000:3.0:1746143780.134692:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+38:32228:x1830963622587008:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143780.134709:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.134725:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b311 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.134749:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db03200/0x87925e4cb73a954a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1e4 expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.134756:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a9646 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b285 expref: 39 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.134768:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a95b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b22a expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.134776:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.134778:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.134781:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1531904->2097151] (req 1531904->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 39 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.135057:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a95b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b22a expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.135070:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a95b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b22a expref: 11 pid: 9839 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143780.135080:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626766592:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143780.135165:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a9646 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b285 expref: 39 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.135172:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a9646 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b285 expref: 39 pid: 12327 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143780.135179:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626766720:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143780.135567:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db03200/0x87925e4cb73a954a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1e4 expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.135579:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db03200/0x87925e4cb73a954a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1e4 expref: 18 pid: 9585 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143780.135587:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626766848:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143780.135607:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143780.141141:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626766592:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.141153:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626766720:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.141159:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626766848:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.141188:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1531904->2097151] (req 1531904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 39 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.141209:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2000, rc 0) 00000100:00100000:2.0:1746143780.141248:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:32228:x1830963622587008:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6555us (6919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.141257:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11954 00000100:00100000:3.0:1746143780.141465:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622586752:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10176us (10480us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143780.141472:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3475 00002000:00100000:3.0:1746143780.141480:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880093071500 x1830963622586752/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.141488:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071500 with x1830963622586752 ext(2097152->4194303) 00002000:00010000:3.0:1746143780.141492:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093071500 00000100:00100000:0.0:1746143780.143597:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.143629:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.143739:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622587264 00000100:00100000:1.0:1746143780.143747:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622587264 00010000:00010000:1.0:1746143780.143776:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a9646 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b285 expref: 37 pid: 12327 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143780.143816:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622587136 00000100:00100000:1.0:1746143780.143818:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622587136 00010000:00010000:1.0:1746143780.143829:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a95b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b22a expref: 12 pid: 9839 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143780.143845:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5646 00000100:00100000:1.0:1746143780.143851:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622587264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143780.143862:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143780.143877:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a9646 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b285 expref: 37 pid: 12327 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143780.143893:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a9646 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b285 expref: 37 pid: 12327 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143780.144067:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73a9646 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b285 expref: 37 pid: 12327 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143780.144087:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143780.144117:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622587264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 265us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.144122:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5646 00000100:00100000:1.0:1746143780.144137:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5647 00000100:00100000:1.0:1746143780.144141:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622587136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143780.144147:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143780.144154:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a95b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b22a expref: 12 pid: 9839 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143780.144162:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a95b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b22a expref: 12 pid: 9839 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143780.144172:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73a95b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b22a expref: 12 pid: 9839 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143780.144186:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143780.144198:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622587136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 57us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.144203:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5647 00000100:00100000:2.0:1746143780.144684:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.144817:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622587392 00000100:00100000:3.0:1746143780.144822:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622587392 00010000:00010000:3.0:1746143780.144842:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db03200/0x87925e4cb73a954a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1e4 expref: 19 pid: 9585 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143780.144861:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5648 00000100:00100000:3.0:1746143780.144866:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622587392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.144874:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.144882:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db03200/0x87925e4cb73a954a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1e4 expref: 19 pid: 9585 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143780.144891:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db03200/0x87925e4cb73a954a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1e4 expref: 19 pid: 9585 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143780.144937:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db03200/0x87925e4cb73a954a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1e4 expref: 19 pid: 9585 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143780.144955:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.144957:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.144962:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.144969:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.144996:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143780.145006:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626766976:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143780.145034:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622586880:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13199us (13994us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143780.145041:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3476 00002000:00100000:2.0:1746143780.145048:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880093071c00 x1830963622586880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143780.145052:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00002000:00100000:2.0:1746143780.145056:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071c00 with x1830963622586880 ext(2097152->4194303) 00002000:00010000:2.0:1746143780.145060:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093071c00 00000100:00100000:3.0:1746143780.150535:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626766976:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143780.150554:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.150608:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622587392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5740us (5923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.150617:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5648 00000100:00100000:0.0:1746143780.153192:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.153303:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622587520 00000100:00100000:2.0:1746143780.153311:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622587520 00000100:00100000:2.0:1746143780.153350:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11955 00000100:00100000:2.0:1746143780.153357:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:32228:x1830963622587520:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143780.153374:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.153389:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b318 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.153414:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 37 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.153421:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.153423:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.153427:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->1142783] (req 1048576->1142783) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 37 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.153453:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 37 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.153463:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 37 pid: 3134 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.153474:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626767104:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.153551:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143780.156493:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626767104:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.156515:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->1142783] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 37 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.156529:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3ce00, rc 0) 00000100:00100000:2.0:1746143780.156563:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:32228:x1830963622587520:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3205us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.156570:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11955 00000100:00100000:0.0:1746143780.156759:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.156868:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622587648 00000100:00100000:3.0:1746143780.156874:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622587648 00010000:00010000:3.0:1746143780.156909:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 37 pid: 3134 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.156972:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5649 00000100:00100000:3.0:1746143780.156979:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622587648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.156991:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.157007:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 37 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.157017:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 37 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.157034:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9703 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b303 expref: 37 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.157047:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.157049:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.157055:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.157062:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.157088:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143780.157098:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626767232:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143780.157144:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.158866:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.158984:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622587904 00000100:00100000:2.0:1746143780.158991:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622587904 00002000:00100000:2.0:1746143780.159024:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880093072a00 x1830963622587904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.159034:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093072a00 with x1830963622587904 ext(4194304->4968447) 00002000:00010000:2.0:1746143780.159039:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093072a00 00000100:00100000:2.0:1746143780.159069:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3477 00000100:00100000:2.0:1746143780.159076:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622587904:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143780.160373:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626767232:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143780.160388:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.160413:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622587648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3434us (3654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.160421:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5649 00000100:00100000:0.0:1746143780.162176:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.162369:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622588160 00000100:00100000:3.0:1746143780.162375:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622588160 00002000:00100000:3.0:1746143780.162408:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x396:0x0] (1138688->1142783) req@ffff880093071180 x1830963622588160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.162417:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071180 with x1830963622588160 ext(1138688->1142783) 00002000:00010000:3.0:1746143780.162422:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093071180 00000100:00100000:3.0:1746143780.162453:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3478 00000100:00100000:3.0:1746143780.162459:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622588160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143780.162573:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622588160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 114us (402us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143780.162579:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3478 00002000:00100000:3.0:1746143780.162584:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x396:0x0] (1138688->1142783) req@ffff880093071180 x1830963622588160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/4536 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.162590:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071180 with x1830963622588160 ext(1138688->1142783) 00002000:00010000:3.0:1746143780.162593:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093071180 00000100:00100000:2.0:1746143780.164639:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622587904:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5558us (5772us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143780.164648:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3477 00002000:00100000:2.0:1746143780.164655:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880093072a00 x1830963622587904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.164663:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093072a00 with x1830963622587904 ext(4194304->4968447) 00002000:00010000:2.0:1746143780.164667:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093072a00 00000100:00100000:0.0:1746143780.207608:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.207714:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622588416 00000100:00100000:2.0:1746143780.207724:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622588416 00000100:00100000:2.0:1746143780.207780:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12902 00000100:00100000:2.0:1746143780.207788:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32233:x1830963622588416:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143780.207814:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.207834:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3c400/0x87925e4cb73a9726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b31f expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.207983:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.207997:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.208008:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143780.208018:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143780.208114:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3c400/0x87925e4cb73a9726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b31f expref: 26 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.208144:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b31f expref: 25 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.208151:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143780.208154:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143780.208157:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3dc00, rc 0) 00000100:00100000:2.0:1746143780.208205:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32233:x1830963622588416:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 417us (606us total) trans 8589943665 rc 0/0 00000100:00100000:2.0:1746143780.208211:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12902 00000100:00100000:0.0:1746143780.295856:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.295949:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.296014:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622588544 00000100:00100000:1.0:1746143780.296024:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622588544 00000100:00100000:0.0:1746143780.296053:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.296733:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622588672 00000100:00100000:0.0:1746143780.296735:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622588800 00000100:00100000:1.0:1746143780.296739:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622588672 00000100:00100000:0.0:1746143780.296745:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622588800 00000100:00100000:1.0:1746143780.296785:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11956 00000100:00100000:0.0:1746143780.296792:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11957 00000100:00100000:1.0:1746143780.296793:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622588544:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143780.296800:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622588672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143780.296808:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143780.296813:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.296825:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73a973b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b326 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.296826:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a9742 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b32d expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.296877:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626767488:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143780.296877:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626767360:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143780.296989:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11958 00000100:00100000:0.0:1746143780.296992:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.296995:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622588800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143780.297004:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.297013:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a9749 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b334 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.297023:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.297025:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.297030:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a9749 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b334 expref: 20 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.297043:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a9749 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b334 expref: 20 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.297053:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369800, rc 0) 00000100:00100000:1.0:1746143780.297080:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622588800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 85us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.297087:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11958 00000100:00100000:1.0:1746143780.297112:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143780.301794:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626767360:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143780.301841:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a9742 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b32d expref: 21 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.301856:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a9742 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b32d expref: 21 pid: 12327 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746143780.301857:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime: 1746143779 -> 1746143780 00002000:00010000:1.0:1746143780.301862:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143778 -> 1746143780 00002000:00010000:1.0:1746143780.301864:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime: 1746143779 -> 1746143780 00000100:00100000:1.0:1746143780.301873:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626767488:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143780.301884:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33800, rc 0) 00010000:00010000:1.0:1746143780.301905:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73a973b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b326 expref: 20 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.301928:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73a973b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b326 expref: 20 pid: 9587 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143780.301958:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622588672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5158us (6007us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143780.301966:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11957 00010000:00010000:1.0:1746143780.302021:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097368200, rc 0) 00000100:00100000:1.0:1746143780.302042:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622588544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5250us (6197us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143780.302048:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11956 00000100:00100000:0.0:1746143780.308021:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.308120:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622588928 00000100:00100000:1.0:1746143780.308134:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622588928 00000100:00100000:1.0:1746143780.308836:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11959 00000100:00100000:1.0:1746143780.308847:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32236:x1830963622588928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143780.308868:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.308887:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b33b expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.308952:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.308961:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143780.308963:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143780.308967:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 19 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.308998:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.309008:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 35 pid: 3134 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.309017:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626767616:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.309111:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.310346:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626767616:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.310377:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 19 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.310393:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369a00, rc 0) 00000100:00100000:1.0:1746143780.310427:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32236:x1830963622588928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1583us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.310436:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11959 00000100:00100000:0.0:1746143780.310685:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.310756:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622589056 00000100:00100000:3.0:1746143780.310762:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622589056 00002000:00100000:3.0:1746143780.310822:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1531904->2097151) req@ffff88009c4d7100 x1830963622589056/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.310831:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7100 with x1830963622589056 ext(1531904->2097151) 00010000:00010000:3.0:1746143780.310839:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 36 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.310851:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 36 pid: 3134 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.310857:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d7100 00000100:00100000:3.0:1746143780.310880:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1450 00000100:00100000:3.0:1746143780.310887:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622589056:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143780.315400:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.315471:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622589184 00000100:00100000:0.0:1746143780.315481:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622589184 00000100:00100000:0.0:1746143780.315530:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12903 00000100:00100000:0.0:1746143780.315539:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32237:x1830963622589184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143780.315563:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143780.315583:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73a9757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b342 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.315643:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.315656:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.315666:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.315689:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a9765 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.315695:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a9765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.315700:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a9765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.315778:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.315789:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2fc expref: 278 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.315795:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b31f expref: 24 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.315806:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 5/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.315834:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b31f expref: 24 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.315844:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b31f expref: 24 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143780.315855:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626767744:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143780.315985:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2fc expref: 278 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.315992:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2fc expref: 278 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143780.315999:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626767872:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143780.316014:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.318308:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.318356:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.318436:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622589312 00000100:00100000:2.0:1746143780.318445:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622589312 00010000:00010000:2.0:1746143780.318480:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b31f expref: 25 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.318512:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5650 00000100:00100000:3.0:1746143780.318515:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622589568 00000100:00100000:3.0:1746143780.318519:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622589568 00000100:00100000:2.0:1746143780.318519:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622589312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.318531:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.318536:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b31f expref: 25 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.318543:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4735 00010000:00010000:2.0:1746143780.318546:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b31f expref: 25 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.318547:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:8586:x1830963622589568:12345-192.168.202.3@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746143780.318566:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143780.318569:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143780.318576:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143780.318580:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143780.318585:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143780.318620:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622589312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 102us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.318626:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5650 00000100:00100000:3.0:1746143780.318693:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+280:8586:x1830963622589568:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 144us (337us total) trans 8589943666 rc 0/0 00000100:00100000:3.0:1746143780.318699:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4735 00010000:00010000:1.0:1746143780.318794:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a972d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b31f expref: 24 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.318810:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626767744:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.318820:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626767872:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.318842:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143780.319135:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622589056:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8248us (8450us total) trans 17179873016 rc 0/0 00000100:00100000:3.0:1746143780.319142:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1450 00002000:00100000:3.0:1746143780.319151:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1531904->2097151) req@ffff88009c4d7100 x1830963622589056/t17179873016(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/448 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.319160:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7100 with x1830963622589056 ext(1531904->2097151) 00010000:00010000:3.0:1746143780.319168:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 38 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.319183:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 38 pid: 3134 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.319189:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d7100 00000100:00100000:0.0:1746143780.319402:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.319469:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622589696 00000100:00100000:2.0:1746143780.319473:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622589696 00010000:00010000:2.0:1746143780.319486:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2fc expref: 280 pid: 14991 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.319505:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5651 00000100:00100000:2.0:1746143780.319509:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+280:2011:x1830963622589696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.319516:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.319519:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2fc expref: 280 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.319525:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2fc expref: 280 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.319537:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73a96fc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2fc expref: 280 pid: 14991 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.319737:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143780.319741:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143780.319748:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143780.319754:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143780.319890:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143780.319956:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+279:2011:x1830963622589696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 446us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.319963:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5651 00010000:00010000:0.0:1746143780.320138:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320145:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746143780.320180:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:0.0:1746143780.320185:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143780.320199:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320209:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320320:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320327:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320333:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320339:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320344:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143780.320348:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320354:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320363:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143780.320366:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143780.320368:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320372:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73a975e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320397:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a9765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320403:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a9765 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320407:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a9765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320410:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143780.320412:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a9765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320416:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a9765 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320421:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fee7d00) 00010000:00010000:0.0:1746143780.320423:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143780.320425:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a9765 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320429:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73a9765 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.320457:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73a9757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b342 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.320468:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b342 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143780.320474:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143780.320475:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143780.320477:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32c00, rc 0) 00000100:00100000:0.0:1746143780.320510:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:32237:x1830963622589184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4972us (5121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143780.320517:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12903 00000100:00100000:0.0:1746143780.320814:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.320998:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622589824 00000100:00100000:2.0:1746143780.321004:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622589824 00010000:00010000:2.0:1746143780.321022:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 38 pid: 3134 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.321038:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5652 00000100:00100000:2.0:1746143780.321043:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963622589824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.321052:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.321068:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 38 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.321077:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 38 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.321089:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73a9718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1531904->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b311 expref: 38 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.321099:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.321101:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.321107:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.321114:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.321138:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143780.321148:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626768000:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143780.321216:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.323197:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.323226:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.323292:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.323409:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622589952 00000100:00100000:1.0:1746143780.323419:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622589952 00000100:00100000:1.0:1746143780.323463:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622590080 00000100:00100000:1.0:1746143780.323466:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622590080 00000100:00100000:1.0:1746143780.323484:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622590208 00000100:00100000:1.0:1746143780.323487:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622590208 00000100:00100000:1.0:1746143780.323518:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11960 00000100:00100000:1.0:1746143780.323527:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622589952:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143780.323548:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.323571:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9773 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b349 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.323596:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.323598:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.323608:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9773 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b349 expref: 13 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.323624:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9773 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b349 expref: 13 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.323637:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b400, rc 0) 00000100:00100000:1.0:1746143780.323690:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622589952:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 162us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.323696:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11960 00000100:00100000:1.0:1746143780.323716:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11961 00000100:00100000:1.0:1746143780.323723:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622590080:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143780.323731:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.323740:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a977a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b350 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.323784:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626768128:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143780.323852:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.323875:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11962 00000100:00100000:1.0:1746143780.323882:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622590208:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143780.323891:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.323949:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a9781 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b357 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.323964:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.323966:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.323972:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a9781 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b357 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.323985:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a9781 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b357 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.323992:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55bc00, rc 0) 00000100:00100000:1.0:1746143780.324014:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622590208:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 132us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.324020:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11962 00000100:00100000:3.0:1746143780.324629:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.324652:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.324667:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622590336 00000100:00100000:2.0:1746143780.324679:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626768000:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143780.324681:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622590336 00010000:00010000:2.0:1746143780.324700:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.324704:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622590464 00000100:00100000:3.0:1746143780.324706:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622590464 00000100:00100000:3.0:1746143780.324718:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11963 00000100:00100000:3.0:1746143780.324723:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622590336:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143780.324730:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143780.324733:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622589824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3688us (3917us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143780.324740:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a9788 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b35e expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143780.324741:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5652 00010000:00010000:3.0:1746143780.324751:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.324752:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.324757:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a9788 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b35e expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.324766:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a9788 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b35e expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143780.324768:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11964 00010000:00010000:3.0:1746143780.324773:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512a00, rc 0) 00000100:00100000:2.0:1746143780.324773:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622590464:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143780.324780:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.324787:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a978f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b365 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143780.324790:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622590336:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 66us (162us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143780.324797:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.324798:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143780.324799:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11963 00010000:00010000:2.0:1746143780.324803:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a978f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b365 expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.324812:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a978f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b365 expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.324819:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3c400, rc 0) 00000100:00100000:2.0:1746143780.324832:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2011:x1830963622590464:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 60us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.324837:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11964 00000100:00100000:0.0:1746143780.326171:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.326328:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622590720 00000100:00100000:3.0:1746143780.326336:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622590720 00002000:00100000:3.0:1746143780.326375:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88009c4d7b80 x1830963622590720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.326385:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7b80 with x1830963622590720 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.326390:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7b80 00000100:00100000:3.0:1746143780.326409:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3479 00000100:00100000:3.0:1746143780.326417:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622590720:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143780.326993:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626768128:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143780.327024:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a977a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b350 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.327041:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55aa00/0x87925e4cb73a977a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b350 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.327051:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55aa00, rc 0) 00000100:00100000:1.0:1746143780.327095:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622590080:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3373us (3867us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143780.327101:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11961 00000100:00100000:0.0:1746143780.331199:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.331347:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622590976 00000100:00100000:1.0:1746143780.331357:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622590976 00000100:00100000:1.0:1746143780.331579:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12904 00000100:00100000:1.0:1746143780.331588:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b71e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:32237:x1830963622590976:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143780.331609:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.331628:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a000/0x87925e4cb73a9796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b36c expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.331728:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.331741:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b342 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.331748:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.331778:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b342 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.331793:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b342 expref: 16 pid: 7244 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.331804:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626768256:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.332987:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.337493:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.337742:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622590720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11323us (11574us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143780.337754:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3479 00002000:00100000:3.0:1746143780.337767:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88009c4d7b80 x1830963622590720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.337776:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7b80 with x1830963622590720 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.337782:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7b80 00000100:00100000:2.0:1746143780.337901:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622591104 00000100:00100000:2.0:1746143780.337910:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622591104 00010000:00010000:2.0:1746143780.337960:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b342 expref: 17 pid: 7244 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.337987:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5653 00000100:00100000:2.0:1746143780.337994:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622591104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.338008:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.338014:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b342 expref: 17 pid: 7244 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.338024:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b342 expref: 17 pid: 7244 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.338048:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143780.338052:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143780.338062:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143780.338069:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143780.338085:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143780.338102:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622591104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.338108:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5653 00010000:00010000:1.0:1746143780.338228:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73a976c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b342 expref: 16 pid: 7244 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.338247:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626768256:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.338270:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.338278:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.338282:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143780.338301:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143780.338431:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a000/0x87925e4cb73a9796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b36c expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.338443:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b36c expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.338448:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143780.338451:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143780.338454:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55be00, rc 0) 00000100:00100000:1.0:1746143780.338593:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b71e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32237:x1830963622590976:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7006us (7407us total) trans 8589943667 rc 0/0 00000100:00100000:1.0:1746143780.338600:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12904 00000100:00100000:0.0:1746143780.341430:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.341997:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622591232 00000100:00100000:1.0:1746143780.342006:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622591232 00000100:00100000:1.0:1746143780.342062:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12905 00000100:00100000:1.0:1746143780.342071:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32237:x1830963622591232:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143780.342096:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.342117:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a97ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b373 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.342209:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.342224:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b36c expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.342231:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.342263:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b36c expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.342274:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b36c expref: 17 pid: 7244 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.342285:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626768384:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.345396:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.345673:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.345751:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622591360 00000100:00100000:1.0:1746143780.345761:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622591360 00000100:00100000:1.0:1746143780.345805:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11965 00000100:00100000:1.0:1746143780.345813:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32236:x1830963622591360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143780.345831:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.345853:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b37a expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.345882:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.345890:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143780.345892:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143780.345906:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.345952:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.345963:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 36 pid: 3134 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.345974:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626768512:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.346044:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.347762:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.347960:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622591488 00000100:00100000:2.0:1746143780.347968:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622591488 00000100:00100000:1.0:1746143780.347994:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626768384:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.348021:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746143780.348053:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11966 00000100:00100000:2.0:1746143780.348061:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32233:x1830963622591488:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143780.348377:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.348409:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b381 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.348433:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143780.348438:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.348728:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143780.348733:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1204224->2097151] (req 1204224->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.348774:0:9587:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.348799:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1204224->2097151] (req 1204224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.348811:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3aa00, rc 0) 00000100:00100000:2.0:1746143780.350995:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:32233:x1830963622591488:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2915us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.351006:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11966 00000100:00100000:3.0:1746143780.351716:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.351935:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626768512:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.351964:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.351981:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7400, rc 0) 00000100:00100000:1.0:1746143780.352017:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32236:x1830963622591360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6204us (6349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.352023:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11965 00000100:00100000:0.0:1746143780.352121:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622591616 00000100:00100000:0.0:1746143780.352129:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622591616 00010000:00010000:0.0:1746143780.352158:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b36c expref: 18 pid: 7244 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143780.352191:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5654 00000100:00100000:0.0:1746143780.352197:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2010:x1830963622591616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143780.352210:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143780.352214:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b36c expref: 18 pid: 7244 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143780.352224:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b36c expref: 18 pid: 7244 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143780.352245:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73a979d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b36c expref: 18 pid: 7244 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143780.352264:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143780.352269:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.352277:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.352284:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143780.352310:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143780.352328:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2010:x1830963622591616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 131us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143780.352333:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5654 00010000:00010000:1.0:1746143780.352335:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.352342:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143780.352398:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:1.0:1746143780.352403:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143780.352422:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.352452:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429600/0x87925e4cb73a97ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b373 expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.352464:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b373 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.352470:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143780.352472:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143780.352474:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428000, rc 0) 00000100:00100000:1.0:1746143780.352496:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32237:x1830963622591232:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 10427us (11076us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.352502:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12905 00000100:00100000:2.0:1746143780.353336:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.353395:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622591744 00000100:00100000:3.0:1746143780.353400:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622591744 00002000:00100000:3.0:1746143780.353429:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1142783) req@ffff880092145880 x1830963622591744/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.353436:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145880 with x1830963622591744 ext(1048576->1142783) 00010000:00010000:3.0:1746143780.353441:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 37 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.353454:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 37 pid: 3134 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.353457:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092145880 00000100:00100000:3.0:1746143780.353478:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1451 00000100:00100000:3.0:1746143780.353482:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622591744:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143780.355711:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.356216:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622591872 00000100:00100000:1.0:1746143780.356225:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622591872 00000100:00100000:1.0:1746143780.356277:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11967 00000100:00100000:1.0:1746143780.356285:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622591872:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143780.356303:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.356487:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b6a00/0x87925e4cb73a97c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b388 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.356540:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626768768:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143780.356619:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.358989:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626768768:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143780.359027:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6a00/0x87925e4cb73a97c7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b388 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.359042:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6a00/0x87925e4cb73a97c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b388 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.359053:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6a00, rc 0) 00000100:00100000:1.0:1746143780.359096:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622591872:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2810us (3391us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143780.359104:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11967 00000100:00100000:3.0:1746143780.359440:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622591744:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5955us (6104us total) trans 17179873017 rc 0/0 00000100:00100000:3.0:1746143780.359449:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1451 00002000:00100000:3.0:1746143780.359459:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1142783) req@ffff880092145880 x1830963622591744/t17179873017(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/448 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.359467:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145880 with x1830963622591744 ext(1048576->1142783) 00010000:00010000:3.0:1746143780.359475:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 39 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.359487:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 39 pid: 3134 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.359493:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092145880 00000100:00100000:2.0:1746143780.361855:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.361883:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.362014:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622592256 00000100:00100000:3.0:1746143780.362023:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622592256 00010000:00010000:3.0:1746143780.362057:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 39 pid: 3134 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.362229:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5655 00000100:00100000:3.0:1746143780.362238:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963622592256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.362254:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.362274:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 39 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.362285:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 39 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.362307:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73a971f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b318 expref: 39 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.362333:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.362335:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.362343:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.362352:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.362368:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622592128 00000100:00100000:1.0:1746143780.362372:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622592128 00010000:00010000:3.0:1746143780.362386:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.362397:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 20 pid: 3135 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.362407:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12906 00000100:00100000:1.0:1746143780.362412:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32237:x1830963622592128:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:3.0:1746143780.362415:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626768896:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143780.362429:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.362444:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7800/0x87925e4cb73a97ce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b38f expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143780.362482:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c50f300 going to sleep for 11 seconds 00010000:00010000:1.0:1746143780.362540:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a97d5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.362555:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a97d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.362567:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a97d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.362577:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a97d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.362583:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a97d5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.362588:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a97d5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.362593:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913b7c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143780.362596:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a97d5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.362601:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a97d5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.362608:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143780.362611:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143780.362614:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a97d5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.362618:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73a97d5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143780.362637:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7800/0x87925e4cb73a97ce lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b38f expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.362643:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7800/0x87925e4cb73a97ce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b38f expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.362649:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7800, rc 0) 00000100:00100000:1.0:1746143780.362670:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32237:x1830963622592128:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 257us (790us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143780.362675:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12906 00000100:00100000:3.0:1746143780.364501:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626768896:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143780.364527:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.364674:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622592256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2435us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.364684:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5655 00000100:00100000:0.0:1746143780.365406:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.365519:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622592512 00000100:00100000:3.0:1746143780.365525:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622592512 00000100:00100000:3.0:1746143780.365834:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4736 00000100:00100000:3.0:1746143780.365843:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e248450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32237:x1830963622592512:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1746143780.366189:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e248450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:32237:x1830963622592512:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 346us (783us total) trans 8589943668 rc 0/0 00000100:00100000:3.0:1746143780.366195:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4736 00000100:00100000:0.0:1746143780.370799:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.370847:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.370879:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622592768 00000100:00100000:3.0:1746143780.370891:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622592768 00002000:00100000:3.0:1746143780.370989:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880136acb100 x1830963622592768/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.371000:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb100 with x1830963622592768 ext(1048576->2097151) 00010000:00010000:3.0:1746143780.371010:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 21 pid: 3135 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.371025:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 21 pid: 3135 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.371038:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136acb100 00000100:00100000:3.0:1746143780.371067:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622593024 00000100:00100000:3.0:1746143780.371070:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622593024 00002000:00100000:3.0:1746143780.371085:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880136ac9180 x1830963622593024/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.371093:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9180 with x1830963622593024 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.371096:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac9180 00000100:00100000:3.0:1746143780.371122:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1452 00000100:00100000:3.0:1746143780.371131:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622592768:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143780.371414:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3480 00000100:00100000:1.0:1746143780.371424:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622593024:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143780.379807:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622593024:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8372us (8946us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143780.379820:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3480 00002000:00100000:2.0:1746143780.379834:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880136ac9180 x1830963622593024/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.379842:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9180 with x1830963622593024 ext(1048576->2097151) 00002000:00010000:2.0:1746143780.379850:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac9180 00000100:00100000:3.0:1746143780.384307:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622592768:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 13163us (13505us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143780.384320:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1452 00002000:00100000:3.0:1746143780.384333:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880136acb100 x1830963622592768/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.384344:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb100 with x1830963622592768 ext(1048576->2097151) 00010000:00010000:3.0:1746143780.384355:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 21 pid: 3135 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.384369:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 21 pid: 3135 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.384376:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136acb100 00000100:00100000:0.0:1746143780.389620:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.390143:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622593280 00000100:00100000:2.0:1746143780.390156:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622593280 00000100:00100000:2.0:1746143780.390230:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12907 00000100:00100000:2.0:1746143780.390239:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+279:32240:x1830963622593280:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143780.390268:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.390290:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a97dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b396 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.390401:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.390416:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b373 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.390426:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.390457:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b373 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.390470:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b373 expref: 16 pid: 7244 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.390480:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626769024:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.391622:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.392462:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.392675:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.392768:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.392844:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622593408 00000100:00100000:2.0:1746143780.392851:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622593408 00000100:00100000:2.0:1746143780.392889:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622593536 00000100:00100000:2.0:1746143780.392891:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622593536 00000100:00100000:3.0:1746143780.393075:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622593664 00000100:00100000:3.0:1746143780.393080:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622593664 00000100:00100000:2.0:1746143780.393098:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11968 00010000:00010000:3.0:1746143780.393106:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 21 pid: 3135 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143780.393129:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11969 00000100:00100000:3.0:1746143780.393130:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5656 00000100:00100000:3.0:1746143780.393135:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963622593664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143780.393135:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622593536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.393147:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143780.393150:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143780.393161:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a97ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3a4 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.393168:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 21 pid: 3135 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.393179:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 21 pid: 3135 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.393190:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622593408:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143780.393198:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.393205:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73a97f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b39d expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.393216:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.393218:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.393225:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73a97f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b39d expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.393314:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73a97f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b39d expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.393325:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2600, rc 0) 00010000:00010000:0.0:1746143780.393421:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143780.393432:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a97ea lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3a4 expref: 41 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143780.393441:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73a97ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3a4 expref: 41 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143780.393460:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33800, rc 0) 00010000:00010000:3.0:1746143780.393507:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73a97b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b37a expref: 21 pid: 3135 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.393523:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.393525:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.393529:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.393538:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.393591:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143780.393603:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626769152:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143780.394578:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622593408:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1467us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.394586:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11968 00000100:00100000:3.0:1746143780.395376:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.395490:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622593536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2354us (2813us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143780.395496:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11969 00000100:00100000:3.0:1746143780.395849:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626769024:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143780.395871:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143780.395994:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.396179:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622593792 00000100:00100000:3.0:1746143780.396184:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622593792 00010000:00010000:3.0:1746143780.396208:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b373 expref: 17 pid: 7244 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.396227:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5657 00000100:00100000:3.0:1746143780.396232:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622593792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.396243:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.396248:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b373 expref: 17 pid: 7244 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.396257:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b373 expref: 17 pid: 7244 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.396277:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73a97b2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b373 expref: 17 pid: 7244 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.396289:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143780.396293:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143780.396301:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143780.396310:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143780.396324:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.396349:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2008:x1830963622593792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 116us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.396354:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5657 00010000:00010000:2.0:1746143780.396397:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.396403:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143780.396421:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143780.396547:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3dc00/0x87925e4cb73a97dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b396 expref: 282 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.396565:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b396 expref: 281 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.396571:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143780.396574:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143780.396576:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3d400, rc 0) 00000100:00100000:2.0:1746143780.396610:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+281:32240:x1830963622593280:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6373us (7004us total) trans 8589943669 rc 0/0 00000100:00100000:2.0:1746143780.396616:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12907 00000100:00100000:3.0:1746143780.399825:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626769152:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143780.399850:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.399909:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622593664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6772us (7138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.399939:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5656 00000100:00100000:0.0:1746143780.408001:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.408082:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622593920 00000100:00100000:2.0:1746143780.408093:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622593920 00000100:00100000:2.0:1746143780.408138:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11970 00000100:00100000:2.0:1746143780.408146:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:32233:x1830963622593920:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143780.408165:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.408182:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3ab expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.408213:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.408221:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a9781 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b357 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.408227:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a9749 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b334 expref: 21 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.408237:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.408239:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.408243:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->1089535] (req 1048576->1089535) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.408270:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a9749 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b334 expref: 21 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.408281:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a9749 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b334 expref: 21 pid: 3135 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143780.408293:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626769280:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.408387:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a9781 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b357 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.408394:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a9781 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b357 expref: 12 pid: 9587 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143780.408401:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626769408:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.408421:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.408427:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 34 pid: 3134 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.408438:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626769536:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.408450:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.409327:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.409364:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.409422:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622594304 00000100:00100000:1.0:1746143780.409427:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622594304 00000100:00100000:1.0:1746143780.409464:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11971 00000100:00100000:1.0:1746143780.409470:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:32240:x1830963622594304:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143780.409482:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.409493:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3b2 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.409512:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.409520:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a9788 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b35e expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.409526:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a96d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2ee expref: 36 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.409531:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.409533:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.409535:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3375104->3657727] (req 3375104->3657727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 36 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.409553:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a96d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2ee expref: 36 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.409561:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a96d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2ee expref: 36 pid: 3135 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143780.409569:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626769664:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.409621:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a9788 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b35e expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.409628:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a9788 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b35e expref: 12 pid: 1945 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143780.409636:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626769792:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.409660:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.409667:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 21 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.409675:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626769920:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.409689:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143780.410008:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622594176 00000100:00100000:3.0:1746143780.410013:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622594176 00002000:00100000:3.0:1746143780.410044:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880136ac9500 x1830963622594176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.410054:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9500 with x1830963622594176 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.410058:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac9500 00000100:00100000:3.0:1746143780.410421:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3481 00000100:00100000:3.0:1746143780.410429:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622594176:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143780.412197:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626769536:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143780.413946:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.413975:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622594432 00000100:00100000:3.0:1746143780.413982:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622594432 00010000:00010000:3.0:1746143780.414020:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a9781 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b357 expref: 13 pid: 9587 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143780.414059:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5658 00000100:00100000:3.0:1746143780.414066:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622594432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.414080:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.414102:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a9781 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b357 expref: 13 pid: 9587 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143780.414112:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a9781 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b357 expref: 13 pid: 9587 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143780.414138:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.414172:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622594432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.414178:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5658 00000100:00100000:2.0:1746143780.414289:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626769280:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.414300:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55bc00/0x87925e4cb73a9781 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b357 expref: 12 pid: 9587 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143780.414324:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626769408:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.414357:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->1089535] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.414367:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2000, rc 0) 00000100:00100000:2.0:1746143780.414401:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32233:x1830963622593920:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6255us (6412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.414407:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11970 00000100:00100000:2.0:1746143780.419787:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626769664:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.419804:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626769792:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.419812:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626769920:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.419938:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3375104->3657727] (req 3375104->3657727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 36 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.419958:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429a00, rc 0) 00000100:00100000:1.0:1746143780.419965:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.420010:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:32240:x1830963622594304:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10539us (10645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.420018:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11971 00000100:00100000:0.0:1746143780.420019:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622594560 00000100:00100000:0.0:1746143780.420026:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622594560 00010000:00010000:0.0:1746143780.420054:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a9788 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b35e expref: 12 pid: 1945 timeout: 939 lvb_type: 1 00000100:00100000:0.0:1746143780.420089:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5659 00000100:00100000:0.0:1746143780.420096:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622594560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143780.420110:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143780.420131:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a9788 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b35e expref: 12 pid: 1945 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143780.420144:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a9788 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b35e expref: 12 pid: 1945 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143780.420166:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73a9788 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b35e expref: 12 pid: 1945 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143780.420189:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143780.420206:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622594560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143780.420212:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5659 00000100:00100000:1.0:1746143780.420284:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.420319:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622594688 00000100:00100000:0.0:1746143780.420322:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622594688 00010000:00010000:0.0:1746143780.420335:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a9749 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b334 expref: 21 pid: 3135 timeout: 939 lvb_type: 1 00000100:00100000:0.0:1746143780.420360:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5660 00000100:00100000:0.0:1746143780.420366:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2010:x1830963622594688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143780.420372:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143780.420382:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a9749 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b334 expref: 21 pid: 3135 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143780.420390:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a9749 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b334 expref: 21 pid: 3135 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143780.420406:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097369800/0x87925e4cb73a9749 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b334 expref: 21 pid: 3135 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143780.420416:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143780.420662:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2010:x1830963622594688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 295us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143780.420672:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5660 00000100:00100000:1.0:1746143780.420738:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.420777:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.420993:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.421048:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622594816 00000100:00100000:2.0:1746143780.421052:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622594816 00010000:00010000:2.0:1746143780.421068:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.421089:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622594944 00000100:00100000:2.0:1746143780.421091:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622594944 00010000:00010000:2.0:1746143780.421100:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 36 pid: 3134 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.421121:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622595072 00000100:00100000:3.0:1746143780.421125:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622595072 00000100:00100000:3.0:1746143780.421136:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5661 00000100:00100000:3.0:1746143780.421142:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2010:x1830963622594816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.421153:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.421163:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.421174:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.421187:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e521800/0x87925e4cb73a96af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2c4 expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.421201:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.421220:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963622594816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 79us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.421225:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5661 00000100:00100000:3.0:1746143780.421238:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5662 00000100:00100000:3.0:1746143780.421242:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622594944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.421248:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.421254:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 37 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.421260:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 37 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.421270:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9711 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b30a expref: 37 pid: 3134 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.421279:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.421281:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.421288:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 18 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.421296:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 18 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.421326:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 18 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143780.421337:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626770048:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143780.421791:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561780 going to sleep for 11 seconds 00010000:00010000:3.0:1746143780.421819:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a96d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2ee expref: 36 pid: 3135 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143780.421836:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5663 00000100:00100000:3.0:1746143780.421841:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622595072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.421848:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.421855:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a96d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2ee expref: 36 pid: 3135 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143780.421864:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a96d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2ee expref: 36 pid: 3135 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143780.421875:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73a96d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2ee expref: 36 pid: 3135 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143780.421883:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.421884:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.421887:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.421904:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.421946:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143780.421954:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626770176:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143780.422191:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5610c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143780.422342:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622594176:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11914us (13018us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143780.422460:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3481 00002000:00100000:3.0:1746143780.422469:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880136ac9500 x1830963622594176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.422478:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9500 with x1830963622594176 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.422483:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac9500 00000100:00100000:3.0:1746143780.424589:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626770176:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143780.424608:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.424654:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622595072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2812us (3661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.424663:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5663 00000100:00100000:3.0:1746143780.426681:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626770048:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143780.426682:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143780.426700:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143780.426713:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.426731:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622594944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5488us (5953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.426740:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5662 00000100:00100000:3.0:1746143780.426950:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622595456 00000100:00100000:3.0:1746143780.426958:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622595456 00000100:00100000:2.0:1746143780.426986:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622595584 00000100:00100000:2.0:1746143780.426990:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622595584 00002000:00100000:3.0:1746143780.426997:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3375104->3379199) req@ffff880092b23100 x1830963622595456/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.427006:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b23100 with x1830963622595456 ext(3375104->3379199) 00002000:00100000:2.0:1746143780.427006:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1085440->1089535) req@ffff880092b21180 x1830963622595584/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746143780.427011:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b23100 00002000:00100000:2.0:1746143780.427012:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b21180 with x1830963622595584 ext(1085440->1089535) 00002000:00010000:2.0:1746143780.427015:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b21180 00000100:00100000:3.0:1746143780.427026:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3482 00000100:00100000:3.0:1746143780.427032:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622595456:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143780.427132:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3483 00000100:00100000:2.0:1746143780.427138:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622595584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143780.427237:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2009:x1830963622595584:12345-192.168.202.3@tcp:3:cat.0 Request processed in 100us (523us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143780.427243:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3483 00002000:00100000:2.0:1746143780.427247:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1085440->1089535) req@ffff880092b21180 x1830963622595584/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/4536 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.427260:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b21180 with x1830963622595584 ext(1085440->1089535) 00002000:00010000:2.0:1746143780.427262:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b21180 00000100:00100000:3.0:1746143780.427337:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622595456:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 305us (657us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143780.427343:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3482 00002000:00100000:3.0:1746143780.427347:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3375104->3379199) req@ffff880092b23100 x1830963622595456/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/4536 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.427352:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b23100 with x1830963622595456 ext(3375104->3379199) 00002000:00010000:3.0:1746143780.427354:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b23100 00000100:00100000:0.0:1746143780.428625:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.428707:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622595712 00000100:00100000:2.0:1746143780.428715:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622595712 00000100:00100000:2.0:1746143780.428751:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11972 00000100:00100000:2.0:1746143780.428758:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:32243:x1830963622595712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143780.428783:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.428801:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3b9 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.428831:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 19 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.428839:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143780.428840:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143780.428844:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 40 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.428873:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 19 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.428884:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 19 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.428908:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626770304:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.429020:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.429854:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.429910:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622595968 00000100:00100000:3.0:1746143780.429927:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622595968 00000100:00100000:3.0:1746143780.430289:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4737 00000100:00100000:3.0:1746143780.430297:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32233:x1830963622595968:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143780.430942:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32233:x1830963622595968:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 643us (1087us total) trans 8589943670 rc 0/0 00000100:00100000:3.0:1746143780.430950:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4737 00000100:00100000:2.0:1746143780.431321:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626770304:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.431350:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 40 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.431365:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31200, rc 0) 00000100:00100000:0.0:1746143780.431412:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.431739:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:32243:x1830963622595712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2981us (3118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.431746:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11972 00000100:00100000:0.0:1746143780.431746:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622596352 00000100:00100000:0.0:1746143780.431751:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622596352 00002000:00100000:0.0:1746143780.431780:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3653632->3657727) req@ffff880092b20a80 x1830963622596352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143780.432035:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20a80 with x1830963622596352 ext(3653632->3657727) 00002000:00010000:0.0:1746143780.432040:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b20a80 00000100:00100000:0.0:1746143780.432061:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3484 00000100:00100000:0.0:1746143780.432067:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622596352:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143780.432186:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622596352:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 119us (774us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143780.432191:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3484 00002000:00100000:0.0:1746143780.432196:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (3653632->3657727) req@ffff880092b20a80 x1830963622596352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/4536 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143780.432203:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20a80 with x1830963622596352 ext(3653632->3657727) 00002000:00010000:0.0:1746143780.432205:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b20a80 00000100:00100000:1.0:1746143780.433038:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.433463:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622596224 00000100:00100000:3.0:1746143780.433469:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622596224 00002000:00100000:3.0:1746143780.433495:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1204224->2097151) req@ffff8800921ce300 x1830963622596224/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.433507:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ce300 with x1830963622596224 ext(1204224->2097151) 00010000:00010000:3.0:1746143780.433515:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.433527:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 20 pid: 9587 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.433532:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921ce300 00000100:00100000:3.0:1746143780.433545:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1453 00000100:00100000:3.0:1746143780.433550:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622596224:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143780.442972:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622596224:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9405us (9920us total) trans 17179873018 rc 0/0 00000100:00100000:3.0:1746143780.443183:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1453 00002000:00100000:3.0:1746143780.443197:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1204224->2097151) req@ffff8800921ce300 x1830963622596224/t17179873018(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/448 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.443208:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ce300 with x1830963622596224 ext(1204224->2097151) 00010000:00010000:3.0:1746143780.443220:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 22 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.443237:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 22 pid: 9587 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.443244:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921ce300 00000100:00100000:0.0:1746143780.445719:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.445867:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622596480 00000100:00100000:3.0:1746143780.445878:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622596480 00010000:00010000:3.0:1746143780.445962:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 22 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.445997:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5664 00000100:00100000:3.0:1746143780.446005:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622596480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.446022:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.446049:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 22 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.446063:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 22 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.446088:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73a97c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b381 expref: 22 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.446116:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.446118:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.446126:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 39 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.446134:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 39 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.446168:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 39 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143780.446181:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626770432:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143780.446475:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5610c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143780.447268:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626770432:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143780.447283:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.447321:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622596480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1317us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.447333:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5664 00000100:00100000:0.0:1746143780.449331:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.449406:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622596736 00000100:00100000:3.0:1746143780.449413:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622596736 00002000:00100000:3.0:1746143780.449456:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092b21880 x1830963622596736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.449466:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b21880 with x1830963622596736 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.449470:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b21880 00000100:00100000:3.0:1746143780.449487:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3485 00000100:00100000:3.0:1746143780.449493:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622596736:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143780.455141:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622596736:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 5634us (5802us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143780.455153:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3485 00002000:00100000:3.0:1746143780.455166:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092b21880 x1830963622596736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.455176:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b21880 with x1830963622596736 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.455182:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b21880 00000100:00100000:0.0:1746143780.460025:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.460083:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622596864 00000100:00100000:2.0:1746143780.460094:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622596864 00000100:00100000:2.0:1746143780.460144:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11973 00000100:00100000:2.0:1746143780.460151:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:32243:x1830963622596864:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143780.460174:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.460198:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3c0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.460232:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 18 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.460240:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143780.460242:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143780.460245:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.460280:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 18 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.460293:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 18 pid: 9585 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.460306:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626770560:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.460406:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143780.463319:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626770560:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.463352:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.463371:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123269200, rc 0) 00000100:00100000:2.0:1746143780.463419:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:32243:x1830963622596864:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3267us (3535us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.463427:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11973 00000100:00100000:0.0:1746143780.463607:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.463738:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622596992 00000100:00100000:3.0:1746143780.463745:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622596992 00002000:00100000:3.0:1746143780.463783:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1089535) req@ffff880092b20e00 x1830963622596992/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.463797:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20e00 with x1830963622596992 ext(1048576->1089535) 00010000:00010000:3.0:1746143780.463804:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 19 pid: 9585 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.463817:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 19 pid: 9585 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.463823:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b20e00 00000100:00100000:3.0:1746143780.463849:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1454 00000100:00100000:3.0:1746143780.463857:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622596992:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143780.466513:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622596992:12345-192.168.202.3@tcp:4:cat.0 Request processed in 2645us (2896us total) trans 21474840342 rc 0/0 00000100:00100000:3.0:1746143780.466530:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1454 00002000:00100000:3.0:1746143780.466542:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->1089535) req@ffff880092b20e00 x1830963622596992/t21474840342(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/448 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.466550:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20e00 with x1830963622596992 ext(1048576->1089535) 00010000:00010000:3.0:1746143780.466560:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 21 pid: 9585 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.466573:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 21 pid: 9585 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.466579:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b20e00 00000100:00100000:0.0:1746143780.468958:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.469019:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622597120 00000100:00100000:3.0:1746143780.469029:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622597120 00010000:00010000:2.0:1746143780.469107:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 21 pid: 9585 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.469137:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5665 00000100:00100000:2.0:1746143780.469145:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622597120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.469157:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.469175:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 21 pid: 9585 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.469184:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 21 pid: 9585 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.469203:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a97ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ab expref: 21 pid: 9585 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.469227:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.469229:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.469234:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.469240:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.469267:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143780.469277:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626770688:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143780.469346:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143780.471103:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626770688:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143780.471128:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143780.471167:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622597120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2021us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.471181:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5665 00000100:00100000:0.0:1746143780.474355:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.474475:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622597376 00000100:00100000:3.0:1746143780.474487:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622597376 00002000:00100000:3.0:1746143780.474537:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092b23480 x1830963622597376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.474547:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b23480 with x1830963622597376 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.474553:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b23480 00000100:00100000:3.0:1746143780.474582:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3486 00000100:00100000:3.0:1746143780.474590:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622597376:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143780.481374:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622597376:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 6771us (7016us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143780.481387:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3486 00002000:00100000:3.0:1746143780.481400:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092b23480 x1830963622597376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.481409:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b23480 with x1830963622597376 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.481415:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b23480 00000100:00100000:0.0:1746143780.489094:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.489279:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622597632 00000100:00100000:3.0:1746143780.489290:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622597632 00002000:00100000:3.0:1746143780.489342:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880092b23b80 x1830963622597632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 504/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.489352:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b23b80 with x1830963622597632 ext(2097152->4194303) 00002000:00010000:3.0:1746143780.489358:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b23b80 00000100:00100000:3.0:1746143780.489391:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3487 00000100:00100000:3.0:1746143780.489399:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622597632:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143780.497443:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622597632:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8033us (8351us total) trans 0 rc 1814528/1814528 00000100:00100000:3.0:1746143780.497458:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3487 00002000:00100000:3.0:1746143780.497470:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880092b23b80 x1830963622597632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 504/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1814528/1814528 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.497480:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b23b80 with x1830963622597632 ext(2097152->4194303) 00002000:00010000:3.0:1746143780.497488:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b23b80 00000100:00100000:0.0:1746143780.504361:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.504569:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622597888 00000100:00100000:3.0:1746143780.504581:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622597888 00002000:00100000:3.0:1746143780.504638:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092b22300 x1830963622597888/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.504648:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b22300 with x1830963622597888 ext(4194304->4968447) 00002000:00010000:3.0:1746143780.504655:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b22300 00000100:00100000:3.0:1746143780.504738:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3488 00000100:00100000:3.0:1746143780.504748:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622597888:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143780.510495:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622597888:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5736us (6133us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143780.510507:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3488 00002000:00100000:3.0:1746143780.510519:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092b22300 x1830963622597888/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.510529:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b22300 with x1830963622597888 ext(4194304->4968447) 00002000:00010000:3.0:1746143780.510535:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b22300 00000100:00100000:0.0:1746143780.551064:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.551238:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622598144 00000100:00100000:2.0:1746143780.551248:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622598144 00000100:00100000:2.0:1746143780.551305:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12908 00000100:00100000:2.0:1746143780.551313:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32250:x1830963622598144:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143780.551341:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.551362:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a981b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3c7 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.551483:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.551498:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143780.551508:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143780.551519:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143780.551620:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a981b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c7 expref: 28 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.551652:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c7 expref: 27 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.551659:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143780.551662:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143780.551665:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:2.0:1746143780.551725:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:32250:x1830963622598144:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 411us (671us total) trans 8589943671 rc 0/0 00000100:00100000:2.0:1746143780.551731:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12908 00000100:00100000:0.0:1746143780.560285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.560349:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622598272 00000100:00100000:2.0:1746143780.560360:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622598272 00000100:00100000:2.0:1746143780.560413:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11974 00000100:00100000:2.0:1746143780.560422:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:32250:x1830963622598272:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143780.560442:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.560463:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3ce expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.560493:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.560501:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143780.560502:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143780.560506:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2551808->2756607] (req 2551808->2756607) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.560535:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.560548:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 34 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.560560:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626770816:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143780.560689:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143780.562683:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626770816:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143780.562718:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2551808->2756607] (req 2551808->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.562732:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e5f800, rc 0) 00000100:00100000:2.0:1746143780.562769:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32250:x1830963622598272:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2348us (2493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.562776:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11974 00000100:00100000:0.0:1746143780.563002:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.563099:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622598400 00000100:00100000:3.0:1746143780.563109:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622598400 00002000:00100000:3.0:1746143780.563156:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3375104->3657727) req@ffff8800911fbb80 x1830963622598400/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.563171:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911fbb80 with x1830963622598400 ext(3375104->3657727) 00010000:00010000:3.0:1746143780.563179:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 35 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.563192:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 35 pid: 9587 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.563199:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800911fbb80 00000100:00100000:3.0:1746143780.563234:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1455 00000100:00100000:3.0:1746143780.563241:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622598400:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143780.567337:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622598400:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4083us (4322us total) trans 21474840343 rc 0/0 00000100:00100000:3.0:1746143780.567350:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1455 00002000:00100000:3.0:1746143780.567363:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3375104->3657727) req@ffff8800911fbb80 x1830963622598400/t21474840343(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/448 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.567373:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911fbb80 with x1830963622598400 ext(3375104->3657727) 00010000:00010000:3.0:1746143780.567384:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 37 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143780.567400:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 37 pid: 9587 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143780.567406:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800911fbb80 00000100:00100000:0.0:1746143780.571633:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.571787:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622598528 00000100:00100000:2.0:1746143780.571795:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622598528 00010000:00010000:2.0:1746143780.571824:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 37 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.571859:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5666 00000100:00100000:2.0:1746143780.571866:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963622598528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.571880:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.571906:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 37 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.571941:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 37 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.571960:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d429a00/0x87925e4cb73a9806 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3375104->3657727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b2 expref: 37 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.571989:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.571991:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.571997:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.572005:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.572030:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143780.572040:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626770944:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143780.572398:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143780.574696:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626770944:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143780.574713:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143780.574908:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622598528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2878us (3117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.574937:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5666 00000100:00100000:0.0:1746143780.574956:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.575054:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622598784 00000100:00100000:3.0:1746143780.575061:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622598784 00002000:00100000:3.0:1746143780.575092:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2551808->2555903) req@ffff8800911fb800 x1830963622598784/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.575101:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911fb800 with x1830963622598784 ext(2551808->2555903) 00002000:00010000:3.0:1746143780.575105:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800911fb800 00000100:00100000:3.0:1746143780.575130:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3489 00000100:00100000:3.0:1746143780.575136:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622598784:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143780.575241:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622598784:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 105us (285us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143780.575247:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3489 00002000:00100000:3.0:1746143780.575252:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2551808->2555903) req@ffff8800911fb800 x1830963622598784/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/4536 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.575259:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911fb800 with x1830963622598784 ext(2551808->2555903) 00002000:00010000:3.0:1746143780.575261:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800911fb800 00000100:00100000:0.0:1746143780.580176:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.580266:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622599040 00000100:00100000:2.0:1746143780.580273:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622599040 00002000:00100000:2.0:1746143780.580309:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2752512->2756607) req@ffff880092b61f80 x1830963622599040/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.580318:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61f80 with x1830963622599040 ext(2752512->2756607) 00002000:00010000:2.0:1746143780.580322:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b61f80 00000100:00100000:2.0:1746143780.580355:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3490 00000100:00100000:2.0:1746143780.580363:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963622599040:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143780.580473:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963622599040:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 110us (302us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143780.580479:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3490 00002000:00100000:2.0:1746143780.580484:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b6:0x0] (2752512->2756607) req@ffff880092b61f80 x1830963622599040/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/4536 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.580491:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61f80 with x1830963622599040 ext(2752512->2756607) 00002000:00010000:2.0:1746143780.580493:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b61f80 00000100:00100000:0.0:1746143780.599258:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626771072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746143780.599314:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143780.599607:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626771072 00000100:00100000:3.0:1746143780.599614:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626771072 00000100:00100000:3.0:1746143780.599655:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1746143780.599662:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3774:x1830963626771072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1746143780.599691:0:12158:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446088704 avail 1316626432 00000100:00100000:3.0:1746143780.599727:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3774:x1830963626771072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.599733:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1746143780.599747:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626771072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746143780.618560:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.619675:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.619928:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622599168 00000100:00100000:2.0:1746143780.619939:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622599168 00000100:00100000:1.0:1746143780.619956:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622599296 00000100:00100000:1.0:1746143780.619965:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622599296 00000100:00100000:2.0:1746143780.620000:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11975 00000100:00100000:2.0:1746143780.620008:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2010:x1830963622599168:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143780.620010:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11976 00000100:00100000:1.0:1746143780.620017:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2010:x1830963622599296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143780.620029:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.620033:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143780.620047:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9837 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3d5 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.620049:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a983e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3dc expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.620069:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.620069:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.620070:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.620071:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.620079:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3d5 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.620079:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a983e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3dc expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.620094:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3d5 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.620098:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a983e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3dc expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143780.620105:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2e00, rc 0) 00010000:00010000:1.0:1746143780.620107:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55ba00, rc 0) 00000100:00100000:1.0:1746143780.620445:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963622599296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 426us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.620451:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11976 00000100:00100000:2.0:1746143780.620502:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963622599168:12345-192.168.202.3@tcp:101:cat.0 Request processed in 350us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.620511:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11975 00000100:00100000:2.0:1746143780.631290:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b99f1f93-ef24-4932-a1b4-452b64359da1:3771:1830963626771200:0@lo:400:kworker.0 00000100:00100000:2.0:1746143780.631350:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143780.631411:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626771328:0@lo:400:kworker.0 00000100:00100000:0.0:1746143780.631462:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143780.631707:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3773:1830963626771456:0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.631737:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143780.631755:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626771584:0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.631770:0:8213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626771200 00000100:00100000:3.0:1746143780.631777:0:8213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626771200 00000100:00100000:1.0:1746143780.631778:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143780.631786:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626771712:0@lo:400:kworker.0 00000100:00100000:1.0:1746143780.631793:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3774:1830963626772096:0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.631806:0:8213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1746143780.631808:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143780.631812:0:8213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3771:x1830963626771200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143780.631814:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143780.631819:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830963626772608:0@lo:400:kworker.0 00000100:00100000:2.0:1746143780.631829:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3771:1830963626772224:0@lo:400:kworker.0 00000100:00100000:1.0:1746143780.631832:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143780.631843:0:8213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3771:x1830963626771200:12345-0@lo:400:kworker.0 Request processed in 31us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.631845:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143780.631846:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143780.631849:0:8213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1746143780.631849:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3774:1830963626771968:0@lo:400:kworker.0 00000100:00100000:1.0:1746143780.631863:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143780.631869:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b99f1f93-ef24-4932-a1b4-452b64359da1:3771:1830963626771200:0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.631875:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626771456 00000100:00100000:3.0:1746143780.631877:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626771456 00000100:00100000:1.0:1746143780.631877:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626772480:0@lo:400:kworker.0 00000100:00100000:2.0:1746143780.631882:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143780.631887:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3771:1830963626771840:0@lo:400:kworker.0 00000100:00100000:1.0:1746143780.631902:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143780.631903:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626772096 00000100:00100000:3.0:1746143780.631906:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626772096 00000100:00100000:3.0:1746143780.631937:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626772608 00000100:00100000:2.0:1746143780.631937:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143780.631939:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626772608 00000100:00100000:1.0:1746143780.631940:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626772224 00000100:00100000:1.0:1746143780.631942:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626772224 00000100:00100000:3.0:1746143780.631947:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626771968 00000100:00100000:2.0:1746143780.631947:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626772352:0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.631948:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626771968 00000100:00100000:1.0:1746143780.631955:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626771840 00000100:00100000:1.0:1746143780.631957:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626771840 00000100:00100000:2.0:1746143780.631962:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143780.631966:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1746143780.631971:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3773:x1830963626771456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.631972:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1746143780.631975:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3774:x1830963626772096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143780.631985:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626771584 00000100:00100000:2.0:1746143780.631988:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626771584 00000100:00100000:1.0:1746143780.631997:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3773:x1830963626771456:12345-0@lo:400:kworker.0 Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.631998:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3774:x1830963626772096:12345-0@lo:400:kworker.0 Request processed in 22us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.632002:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1746143780.632004:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1746143780.632010:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1746143780.632010:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626771712 00000100:00100000:2.0:1746143780.632011:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626771712 00000100:00100000:3.0:1746143780.632014:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3774:x1830963626772608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143780.632022:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626772480 00000100:00100000:1.0:1746143780.632022:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1746143780.632024:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626772480 00000100:00100000:1.0:1746143780.632026:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3771:x1830963626772224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.632031:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3774:x1830963626772608:12345-0@lo:400:kworker.0 Request processed in 17us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.632035:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1746143780.632035:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626772352 00000100:00100000:2.0:1746143780.632037:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626772352 00000100:00100000:3.0:1746143780.632044:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1746143780.632047:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3771:x1830963626771840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143780.632049:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1746143780.632054:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3774:x1830963626771584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143780.632059:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3771:x1830963626772224:12345-0@lo:400:kworker.0 Request processed in 33us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.632063:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1746143780.632071:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1746143780.632074:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3771:x1830963626771840:12345-0@lo:400:kworker.0 Request processed in 26us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.632075:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830963626771968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.632078:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1746143780.632082:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3774:x1830963626771584:12345-0@lo:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.632087:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1746143780.632092:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830963626771968:12345-0@lo:400:kworker.0 Request processed in 16us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.632096:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00080000:3.0:1746143780.632097:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143780.632097:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00080000:3.0:1746143780.632099:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143780.632102:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746143780.632102:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963626771712:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1746143780.632103:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143780.632106:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1746143780.632111:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626771328 00000100:00100000:1.0:1746143780.632113:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3774:1830963626771968:0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.632114:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626771328 00000100:00100000:0.0:1746143780.632116:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963626772480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143780.632123:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963626771712:12345-0@lo:400:kworker.0 Request processed in 21us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.632123:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626771584:0@lo:400:kworker.0 00000100:00100000:2.0:1746143780.632127:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1746143780.632129:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3774:1830963626772096:0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.632131:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1746143780.632135:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3772:x1830963626771328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143780.632135:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830963626772608:0@lo:400:kworker.0 00000100:00100000:2.0:1746143780.632136:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1746143780.632140:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3771:x1830963626772352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143780.632157:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963626772480:12345-0@lo:400:kworker.0 Request processed in 45us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.632158:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626772480:0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.632164:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3772:x1830963626771328:12345-0@lo:400:kworker.0 Request processed in 29us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.632164:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3771:x1830963626772352:12345-0@lo:400:kworker.0 Request processed in 23us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143780.632164:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1746143780.632169:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1746143780.632169:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1746143780.632176:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3771:1830963626771840:0@lo:400:kworker.0 00000100:00100000:1.0:1746143780.632184:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626772352:0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.632187:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626771328:0@lo:400:kworker.0 00000100:00100000:1.0:1746143780.632190:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626771712:0@lo:400:kworker.0 00000100:00100000:1.0:1746143780.632198:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3771:1830963626772224:0@lo:400:kworker.0 00000100:00100000:3.0:1746143780.632204:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3773:1830963626771456:0@lo:400:kworker.0 00000100:00100000:1.0:1746143780.632406:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.632451:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.632584:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622599680 00000100:00100000:3.0:1746143780.632588:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622599680 00002000:00100000:3.0:1746143780.632610:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093070380 x1830963622599680/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.632619:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070380 with x1830963622599680 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.632623:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093070380 00000100:00100000:3.0:1746143780.632691:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622599808 00000100:00100000:3.0:1746143780.632694:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622599808 00002000:00100000:3.0:1746143780.632707:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880093071f80 x1830963622599808/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.632714:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071f80 with x1830963622599808 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.632716:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093071f80 00000100:00100000:3.0:1746143780.632727:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3491 00000100:00100000:3.0:1746143780.632731:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622599680:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143780.633213:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3492 00000100:00100000:0.0:1746143780.633220:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622599808:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143780.645028:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622599680:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12283us (12610us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143780.645040:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3491 00002000:00100000:3.0:1746143780.645053:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093070380 x1830963622599680/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.645063:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070380 with x1830963622599680 ext(1048576->2097151) 00002000:00010000:3.0:1746143780.645069:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093070380 00000100:00100000:0.0:1746143780.649439:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622599808:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16208us (16975us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143780.649452:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3492 00002000:00100000:0.0:1746143780.649463:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880093071f80 x1830963622599808/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143780.649473:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071f80 with x1830963622599808 ext(1048576->2097151) 00002000:00010000:0.0:1746143780.649479:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093071f80 00000100:00100000:0.0:1746143780.666423:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.667432:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622600064 00000100:00100000:2.0:1746143780.667445:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622600064 00002000:00100000:2.0:1746143780.667504:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880092b62300 x1830963622600064/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 504/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.667514:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62300 with x1830963622600064 ext(2097152->4194303) 00002000:00010000:2.0:1746143780.667519:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b62300 00000100:00100000:2.0:1746143780.668083:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3493 00000100:00100000:2.0:1746143780.668093:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622600064:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143780.677389:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622600064:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9285us (10963us total) trans 0 rc 1892352/1892352 00000100:00100000:0.0:1746143780.677402:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3493 00002000:00100000:0.0:1746143780.677414:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880092b62300 x1830963622600064/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 504/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1892352/1892352 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143780.677422:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62300 with x1830963622600064 ext(2097152->4194303) 00002000:00010000:0.0:1746143780.677428:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b62300 00000100:00100000:0.0:1746143780.678715:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.678803:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622600192 00000100:00100000:1.0:1746143780.678812:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622600192 00000100:00100000:1.0:1746143780.678865:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11977 00000100:00100000:1.0:1746143780.678872:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:32256:x1830963622600192:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143780.678899:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.678946:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3e3 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.678981:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.678990:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a978f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b365 expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.678997:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a96ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2f5 expref: 41 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.679004:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.679005:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.679009:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2613248->3031039] (req 2613248->3031039) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 41 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.679039:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a96ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2f5 expref: 41 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.679056:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a96ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2f5 expref: 41 pid: 12327 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143780.679067:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626772736:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.679156:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a978f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b365 expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.679165:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a978f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b365 expref: 12 pid: 12327 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143780.679172:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626772864:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.679585:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.679594:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 21 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.679603:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626772992:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.679622:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.686271:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.686308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.686343:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622600320 00000100:00100000:2.0:1746143780.686353:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622600320 00010000:00010000:2.0:1746143780.686391:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a978f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b365 expref: 13 pid: 12327 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143780.686426:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5667 00000100:00100000:2.0:1746143780.686432:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622600320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.686447:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.686466:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a978f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b365 expref: 13 pid: 12327 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143780.686476:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a978f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b365 expref: 13 pid: 12327 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143780.686499:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143780.686900:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626772736:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.686937:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a978f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b365 expref: 13 pid: 12327 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143780.686959:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626772864:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.686993:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626772992:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.687022:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3031039] (req 2613248->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 41 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.687032:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048800, rc 0) 00000100:00100000:3.0:1746143780.687241:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622600576 00000100:00100000:3.0:1746143780.687246:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622600576 00000100:00100000:3.0:1746143780.687274:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11978 00000100:00100000:3.0:1746143780.687279:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:32254:x1830963622600576:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.687292:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.687303:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a984c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3ea expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.687317:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.687319:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.687326:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a984c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ea expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.687336:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a984c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ea expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.687343:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512a00, rc 0) 00000100:00100000:2.0:1746143780.687415:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622600320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 981us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.687422:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5667 00000100:00100000:1.0:1746143780.687474:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:32256:x1830963622600192:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8602us (8763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.687481:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11977 00000100:00100000:3.0:1746143780.687596:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32254:x1830963622600576:12345-192.168.202.3@tcp:101:cat.0 Request processed in 316us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.687601:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11978 00000100:00100000:1.0:1746143780.687702:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.687826:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622600704 00000100:00100000:1.0:1746143780.688086:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.688147:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622600448 00000100:00100000:2.0:1746143780.688152:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622600448 00010000:00010000:2.0:1746143780.688166:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 23 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143780.688184:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5668 00000100:00100000:2.0:1746143780.688189:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622600448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.688196:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.688207:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 23 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.688215:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 23 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.688228:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73a96bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d2 expref: 23 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143780.688251:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143780.688271:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963622600448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.688277:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5668 00000100:00100000:0.0:1746143780.689324:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622600704 00010000:00010000:1.0:1746143780.689565:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a96ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2f5 expref: 41 pid: 12327 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143780.689600:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5669 00000100:00100000:1.0:1746143780.689607:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622600704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143780.689618:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143780.689630:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a96ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2f5 expref: 41 pid: 12327 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143780.689639:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a96ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2f5 expref: 41 pid: 12327 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143780.689654:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a96ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2f5 expref: 41 pid: 12327 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143780.689667:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.689669:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.689675:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 40 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.689683:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 40 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.689714:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 40 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.689728:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626773120:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143780.689803:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.691329:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626773120:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143780.691347:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143780.691898:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622600704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2282us (4185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.691908:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5669 00000100:00100000:0.0:1746143780.692100:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.692208:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622600960 00000100:00100000:1.0:1746143780.692214:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622600960 00002000:00100000:1.0:1746143780.692335:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x397:0x0] (2613248->2617343) req@ffff880092b60e00 x1830963622600960/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.692345:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60e00 with x1830963622600960 ext(2613248->2617343) 00002000:00010000:1.0:1746143780.692349:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b60e00 00000100:00100000:1.0:1746143780.692528:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3494 00000100:00100000:1.0:1746143780.692537:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622600960:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143780.692572:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.692611:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622601216 00000100:00100000:2.0:1746143780.692617:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622601216 00002000:00100000:2.0:1746143780.692635:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880092b61c00 x1830963622601216/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.692642:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61c00 with x1830963622601216 ext(3145728->4194303) 00002000:00010000:2.0:1746143780.692645:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b61c00 00000100:00100000:2.0:1746143780.692658:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3495 00000100:00100000:2.0:1746143780.692663:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622601216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143780.693082:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622600960:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 545us (982us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143780.693088:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3494 00002000:00100000:1.0:1746143780.693093:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x397:0x0] (2613248->2617343) req@ffff880092b60e00 x1830963622600960/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/4536 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.693100:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b60e00 with x1830963622600960 ext(2613248->2617343) 00002000:00010000:1.0:1746143780.693103:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b60e00 00000100:00100000:3.0:1746143780.700544:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622601216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7866us (7958us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143780.700558:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3495 00002000:00100000:3.0:1746143780.700571:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880092b61c00 x1830963622601216/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.700580:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61c00 with x1830963622601216 ext(3145728->4194303) 00002000:00010000:3.0:1746143780.700586:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b61c00 00000100:00100000:1.0:1746143780.700748:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.700844:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622601472 00000100:00100000:3.0:1746143780.700852:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622601472 00002000:00100000:3.0:1746143780.700888:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3026944->3031039) req@ffff8800919e4000 x1830963622601472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.700904:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e4000 with x1830963622601472 ext(3026944->3031039) 00002000:00010000:3.0:1746143780.700907:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919e4000 00000100:00100000:3.0:1746143780.700949:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3496 00000100:00100000:3.0:1746143780.700956:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622601472:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143780.701062:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622601472:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 107us (316us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143780.701068:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3496 00002000:00100000:3.0:1746143780.701072:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3026944->3031039) req@ffff8800919e4000 x1830963622601472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/4536 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.701078:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e4000 with x1830963622601472 ext(3026944->3031039) 00002000:00010000:3.0:1746143780.701081:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919e4000 00000100:00100000:0.0:1746143780.704339:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.704818:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622601600 00000100:00100000:3.0:1746143780.704829:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622601600 00000100:00100000:1.0:1746143780.705144:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11979 00000100:00100000:1.0:1746143780.705155:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622601600:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143780.705175:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.705194:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048200/0x87925e4cb73a9853 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3f1 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.705228:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082048200/0x87925e4cb73a9853 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3f1 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.705240:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082048200/0x87925e4cb73a9853 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3f1 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.705269:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048200, rc 0) 00000100:00100000:1.0:1746143780.705318:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622601600:12345-192.168.202.3@tcp:101:cat.0 Request processed in 165us (988us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143780.705323:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11979 00000100:00100000:0.0:1746143780.709022:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.709100:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622601856 00000100:00100000:1.0:1746143780.709109:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622601856 00002000:00100000:1.0:1746143780.709156:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092b61880 x1830963622601856/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.709166:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61880 with x1830963622601856 ext(4194304->4968447) 00002000:00010000:1.0:1746143780.709171:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b61880 00000100:00100000:1.0:1746143780.709351:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3497 00000100:00100000:1.0:1746143780.709360:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622601856:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143780.714449:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622601856:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5078us (5427us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143780.714462:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3497 00002000:00100000:1.0:1746143780.714474:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092b61880 x1830963622601856/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.714485:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61880 with x1830963622601856 ext(4194304->4968447) 00002000:00010000:1.0:1746143780.714491:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b61880 00000100:00100000:0.0:1746143780.717505:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.717579:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622601984 00000100:00100000:3.0:1746143780.717589:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622601984 00000100:00100000:3.0:1746143780.717652:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11980 00000100:00100000:3.0:1746143780.717659:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622601984:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.717679:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.717705:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124512c00/0x87925e4cb73a985a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3f8 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.717740:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124512c00/0x87925e4cb73a985a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3f8 expref: 23 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.717751:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124512c00/0x87925e4cb73a985a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3f8 expref: 23 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.717776:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512c00, rc 0) 00000100:00100000:3.0:1746143780.717818:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622601984:12345-192.168.202.3@tcp:101:cat.0 Request processed in 159us (324us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143780.717824:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11980 00000100:00100000:0.0:1746143780.724176:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.724276:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622602112 00000100:00100000:1.0:1746143780.724287:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622602112 00000100:00100000:1.0:1746143780.724379:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11981 00000100:00100000:1.0:1746143780.724389:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622602112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143780.724409:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.724425:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73a9861 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b3ff expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.724458:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73a9861 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ff expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.724475:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73a9861 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ff expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.724502:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048e00, rc 0) 00000100:00100000:1.0:1746143780.725286:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622602112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 896us (1117us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143780.725293:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11981 00000100:00100000:0.0:1746143780.731253:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.731300:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.731391:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622602368 00000100:00100000:1.0:1746143780.731401:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622602368 00000100:00100000:1.0:1746143780.731453:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622602240 00000100:00100000:1.0:1746143780.731455:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622602240 00000100:00100000:1.0:1746143780.731473:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11982 00000100:00100000:1.0:1746143780.731481:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622602368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143780.731500:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.731517:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048c00/0x87925e4cb73a9868 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b40d expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.731552:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082048c00/0x87925e4cb73a9868 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b40d expref: 41 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.731562:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082048c00/0x87925e4cb73a9868 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b40d expref: 41 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.731576:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048c00, rc 0) 00000100:00100000:1.0:1746143780.731620:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622602368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 140us (377us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143780.731627:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11982 00000100:00100000:1.0:1746143780.731641:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11983 00000100:00100000:1.0:1746143780.731645:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622602240:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143780.731652:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.731786:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73a986f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b406 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.731830:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626773248:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143780.732538:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bb40 going to sleep for 11 seconds 00002000:00010000:1.0:1746143780.733990:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143780 -> 1746143781 00002000:00010000:1.0:1746143780.733996:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143780 -> 1746143781 00002000:00010000:1.0:1746143780.733998:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143780 -> 1746143781 00000100:00100000:1.0:1746143780.734020:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626773248:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143780.734049:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73a986f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b406 expref: 37 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.734063:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73a986f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b406 expref: 37 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.734074:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048400, rc 0) 00000100:00100000:1.0:1746143780.734125:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963622602240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2477us (2822us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143780.734135:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11983 00000100:00100000:0.0:1746143780.743495:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.744128:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.744350:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622602496 00000100:00100000:3.0:1746143780.744361:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622602496 00000100:00100000:1.0:1746143780.744960:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622602624 00000100:00100000:1.0:1746143780.744964:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622602624 00000100:00100000:3.0:1746143780.744965:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11984 00000100:00100000:3.0:1746143780.744973:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622602496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.744993:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.745013:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011de82400/0x87925e4cb73a9876 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b414 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143780.745068:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626773376:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143780.745279:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11985 00000100:00100000:1.0:1746143780.745285:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622602624:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143780.745294:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.745304:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73a987d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b41b expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.745324:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73a987d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b41b expref: 41 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.745334:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73a987d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b41b expref: 41 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.745347:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049200, rc 0) 00000100:00100000:1.0:1746143780.745646:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622602624:12345-192.168.202.3@tcp:101:cat.0 Request processed in 360us (1517us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143780.745652:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11985 00000100:00100000:3.0:1746143780.745656:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143780.747507:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626773376:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143780.747535:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011de82400/0x87925e4cb73a9876 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b414 expref: 37 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.747547:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011de82400/0x87925e4cb73a9876 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b414 expref: 37 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.747561:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de82400, rc 0) 00000100:00100000:3.0:1746143780.747604:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622602496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2631us (4119us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143780.747611:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11984 00000100:00100000:0.0:1746143780.749876:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.750207:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622602752 00000100:00100000:3.0:1746143780.750216:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622602752 00000100:00100000:3.0:1746143780.750273:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11986 00000100:00100000:3.0:1746143780.750282:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:32260:x1830963622602752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.750300:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.750317:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b422 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.750349:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.750365:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143780.750368:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143780.750371:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 37 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.750404:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.750416:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 21 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143780.750427:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626773504:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143780.750520:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143780.753141:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626773504:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143780.753181:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 37 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.753199:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de83000, rc 0) 00000100:00100000:3.0:1746143780.753349:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:32260:x1830963622602752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3066us (3481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.753358:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11986 00000100:00100000:0.0:1746143780.753682:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.753982:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622602880 00000100:00100000:1.0:1746143780.753990:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622602880 00002000:00100000:1.0:1746143780.754030:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2551808->2756607) req@ffff8801368ea300 x1830963622602880/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.754040:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ea300 with x1830963622602880 ext(2551808->2756607) 00010000:00010000:1.0:1746143780.754047:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 22 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.754059:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 22 pid: 9587 timeout: 939 lvb_type: 0 00002000:00010000:1.0:1746143780.754070:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801368ea300 00000100:00100000:1.0:1746143780.754100:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1456 00000100:00100000:1.0:1746143780.754108:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622602880:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143780.757691:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622602880:12345-192.168.202.3@tcp:4:cat.0 Request processed in 3571us (3996us total) trans 21474840344 rc 0/0 00000100:00100000:1.0:1746143780.757704:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1456 00002000:00100000:1.0:1746143780.757716:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2551808->2756607) req@ffff8801368ea300 x1830963622602880/t21474840344(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/448 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.757726:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ea300 with x1830963622602880 ext(2551808->2756607) 00010000:00010000:1.0:1746143780.757737:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 24 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.757752:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 24 pid: 9587 timeout: 939 lvb_type: 0 00002000:00010000:1.0:1746143780.757759:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801368ea300 00000100:00100000:0.0:1746143780.763518:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.763610:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622603008 00000100:00100000:1.0:1746143780.763757:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622603008 00010000:00010000:1.0:1746143780.763801:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 24 pid: 9587 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143780.763849:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5670 00000100:00100000:1.0:1746143780.763857:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622603008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143780.763873:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143780.763907:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 24 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.763955:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 24 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.763979:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73a9830 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2551808->2756607) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ce expref: 24 pid: 9587 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143780.764003:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.764005:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.764013:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.764021:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.764057:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.764070:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626773632:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143780.764164:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.768992:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626773632:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143780.769014:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143780.769070:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622603008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5212us (5564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.769081:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5670 00000100:00100000:0.0:1746143780.769755:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.769791:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622603264 00000100:00100000:1.0:1746143780.769796:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622603264 00002000:00100000:1.0:1746143780.769830:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff8801368eb100 x1830963622603264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.769837:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb100 with x1830963622603264 ext(2097152->3145727) 00002000:00010000:1.0:1746143780.769841:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368eb100 00000100:00100000:1.0:1746143780.769863:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3498 00000100:00100000:1.0:1746143780.769870:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622603264:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143780.776167:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746143780.776286:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626773760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746143780.776363:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143780.776503:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626773760 00000100:00100000:0.0:1746143780.776602:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626773760 00000100:00100000:0.0:1746143780.777044:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1746143780.777053:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963626773760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746143780.777086:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1018081344 pending 5988352 free 3914395648 avail 3682873344 00000100:00100000:0.0:1746143780.777637:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963626773760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 584us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143780.777644:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1746143780.777725:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626773760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746143780.780902:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622603264:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11014us (11130us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143780.780942:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3498 00002000:00100000:1.0:1746143780.780954:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff8801368eb100 x1830963622603264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.780964:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb100 with x1830963622603264 ext(2097152->3145727) 00002000:00010000:1.0:1746143780.780969:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368eb100 00000100:00100000:0.0:1746143780.785531:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.785587:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622603392 00000100:00100000:3.0:1746143780.785598:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622603392 00000100:00100000:3.0:1746143780.785657:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11987 00000100:00100000:3.0:1746143780.785666:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:32260:x1830963622603392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.785688:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.785708:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b429 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.785976:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 41 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.785985:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143780.785987:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143780.785990:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.786028:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 41 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.786040:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 41 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143780.786053:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626773888:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143780.786240:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.789028:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.789117:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622603520 00000100:00100000:1.0:1746143780.789125:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622603520 00002000:00100000:1.0:1746143780.789174:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x397:0x0] (2613248->3031039) req@ffff8801368ebb80 x1830963622603520/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.789185:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ebb80 with x1830963622603520 ext(2613248->3031039) 00010000:00010000:1.0:1746143780.789195:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 42 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143780.789210:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 42 pid: 9587 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143780.789221:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368ebb80 00000100:00100000:1.0:1746143780.789255:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1457 00000100:00100000:1.0:1746143780.789262:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622603520:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143780.789536:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626773888:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143780.789571:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 43 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.789584:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634200, rc 0) 00000100:00100000:3.0:1746143780.789610:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+43:32260:x1830963622603392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3946us (4091us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.789617:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11987 00000100:00100000:0.0:1746143780.791059:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143780.791076:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626774016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143780.791128:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143780.791238:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626774016 00000100:00100000:1.0:1746143780.791243:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626774016 00000100:00100000:1.0:1746143780.791284:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1746143780.791291:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3771:x1830963626774016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746143780.791319:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1018256576 pending 6164480 free 3912818688 avail 3681296384 00000100:00100000:1.0:1746143780.791367:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3771:x1830963626774016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.791372:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1746143780.791474:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626774016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143780.795518:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622603520:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6244us (6487us total) trans 17179873019 rc 0/0 00000100:00100000:0.0:1746143780.795536:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1457 00002000:00100000:0.0:1746143780.795548:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x397:0x0] (2613248->3031039) req@ffff8801368ebb80 x1830963622603520/t17179873019(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/448 e 0 to 0 dl 1746143791 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143780.796553:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ebb80 with x1830963622603520 ext(2613248->3031039) 00010000:00010000:0.0:1746143780.796565:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 43 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143780.796582:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 43 pid: 9587 timeout: 940 lvb_type: 0 00002000:00010000:0.0:1746143780.796590:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368ebb80 00000100:00100000:0.0:1746143780.799773:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.800494:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622603648 00000100:00100000:1.0:1746143780.800503:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622603648 00010000:00010000:1.0:1746143780.800536:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 43 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143780.800572:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5671 00000100:00100000:1.0:1746143780.800579:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622603648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143780.800596:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143780.800610:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143780 -> 1746143781 00010000:00010000:1.0:1746143780.800615:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 43 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143780.800626:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 43 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143780.800654:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73a9845 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2613248->3145727] (req 2613248->3031039) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3e3 expref: 43 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143780.800675:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.800677:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.800684:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.800691:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.800719:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143780.800729:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626774144:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143780.800811:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.806698:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626774144:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143780.806718:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143780.806781:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622603648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6199us (7011us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.806791:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5671 00000100:00100000:1.0:1746143780.807403:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746143780.807426:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626774272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746143780.807493:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143780.807760:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626774272 00000100:00100000:2.0:1746143780.807768:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626774272 00000100:00100000:2.0:1746143780.807880:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1746143780.807900:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3774:x1830963626774272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1746143780.807964:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445326848 avail 1315864576 00000100:00100000:2.0:1746143780.808014:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3774:x1830963626774272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.808020:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1746143780.808047:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626774272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143780.810346:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.810415:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622603904 00000100:00100000:2.0:1746143780.810422:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622603904 00002000:00100000:2.0:1746143780.810464:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8801368eaa00 x1830963622603904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.810474:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eaa00 with x1830963622603904 ext(2097152->4194303) 00002000:00010000:2.0:1746143780.810479:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368eaa00 00000100:00100000:2.0:1746143780.810505:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3499 00000100:00100000:2.0:1746143780.810511:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622603904:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143780.812180:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.813103:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622604160 00000100:00100000:0.0:1746143780.813111:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622604160 00002000:00100000:0.0:1746143780.813154:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800919e6680 x1830963622604160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143780.813165:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e6680 with x1830963622604160 ext(3145728->4194303) 00002000:00010000:0.0:1746143780.813170:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919e6680 00000100:00100000:0.0:1746143780.815338:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3500 00000100:00100000:0.0:1746143780.815354:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622604160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143780.827430:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622603904:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16903us (17078us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143780.827442:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3499 00002000:00100000:2.0:1746143780.827455:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8801368eaa00 x1830963622603904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.827470:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eaa00 with x1830963622603904 ext(2097152->4194303) 00002000:00010000:2.0:1746143780.827477:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368eaa00 00000100:00100000:1.0:1746143780.828585:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622604160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13231us (16409us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143780.828594:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3500 00002000:00100000:1.0:1746143780.828601:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800919e6680 x1830963622604160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.828608:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e6680 with x1830963622604160 ext(3145728->4194303) 00002000:00010000:1.0:1746143780.828612:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919e6680 00010000:00010000:2.0:1746143780.833187:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143780.834951:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.835006:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622604416 00000100:00100000:1.0:1746143780.835019:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622604416 00002000:00100000:1.0:1746143780.835079:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8801368e8a80 x1830963622604416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.835089:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8a80 with x1830963622604416 ext(4194304->4968447) 00002000:00010000:1.0:1746143780.835096:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e8a80 00000100:00100000:1.0:1746143780.835150:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3501 00000100:00100000:1.0:1746143780.835161:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622604416:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143780.848552:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963622604416:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13381us (13626us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143780.848565:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3501 00002000:00100000:1.0:1746143780.848577:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8801368e8a80 x1830963622604416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.848587:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8a80 with x1830963622604416 ext(4194304->4968447) 00002000:00010000:1.0:1746143780.848593:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e8a80 00000100:00100000:0.0:1746143780.862393:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.862470:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622604544 00000100:00100000:3.0:1746143780.862482:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622604544 00000100:00100000:3.0:1746143780.862956:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11988 00000100:00100000:3.0:1746143780.862966:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622604544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143780.862987:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.863005:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a9892 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b430 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.863028:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.863030:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.863039:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a9892 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b430 expref: 24 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.863056:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a9892 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b430 expref: 24 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.863067:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635e00, rc 0) 00000100:00100000:3.0:1746143780.863124:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622604544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 159us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.863130:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11988 00000100:00100000:0.0:1746143780.867375:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.867447:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622604672 00000100:00100000:1.0:1746143780.867458:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622604672 00000100:00100000:1.0:1746143780.867519:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11989 00000100:00100000:1.0:1746143780.867527:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622604672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143780.867548:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.867566:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73a9899 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b437 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.867591:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.867593:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.867603:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73a9899 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b437 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.867619:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73a9899 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b437 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.867630:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52400, rc 0) 00000100:00100000:1.0:1746143780.867689:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622604672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 161us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.867695:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11989 00000100:00100000:0.0:1746143780.882975:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.883082:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622605184 00000100:00100000:1.0:1746143780.883092:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622605184 00002000:00100000:1.0:1746143780.883392:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff8801368e8380 x1830963622605184/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.883405:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8380 with x1830963622605184 ext(2097152->3145727) 00002000:00010000:1.0:1746143780.883412:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8380 00000100:00100000:1.0:1746143780.883470:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3502 00000100:00100000:1.0:1746143780.883482:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622605184:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143780.884743:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.884828:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622605056 00000100:00100000:2.0:1746143780.884835:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622605056 00002000:00100000:2.0:1746143780.884865:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8801373bb480 x1830963622605056/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.884873:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bb480 with x1830963622605056 ext(2097152->4194303) 00002000:00010000:2.0:1746143780.884877:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373bb480 00000100:00100000:2.0:1746143780.885012:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3503 00000100:00100000:2.0:1746143780.885019:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622605056:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143780.895870:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622605184:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12379us (12896us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143780.895883:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3502 00002000:00100000:1.0:1746143780.895906:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff8801368e8380 x1830963622605184/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143780.895947:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8380 with x1830963622605184 ext(2097152->3145727) 00002000:00010000:1.0:1746143780.895953:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8380 00000100:00100000:2.0:1746143780.905264:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2010:x1830963622605056:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20233us (20513us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143780.905279:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3503 00002000:00100000:2.0:1746143780.905291:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8801373bb480 x1830963622605056/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.905301:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bb480 with x1830963622605056 ext(2097152->4194303) 00002000:00010000:2.0:1746143780.905307:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373bb480 00000100:00100000:0.0:1746143780.914327:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.914431:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622605440 00000100:00100000:2.0:1746143780.914442:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622605440 00002000:00100000:2.0:1746143780.914494:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8801373b8000 x1830963622605440/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.914505:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8000 with x1830963622605440 ext(4194304->4968447) 00002000:00010000:2.0:1746143780.914512:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373b8000 00000100:00100000:2.0:1746143780.914549:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3504 00000100:00100000:2.0:1746143780.914557:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622605440:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143780.927104:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622605440:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12534us (12777us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143780.927116:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3504 00002000:00100000:2.0:1746143780.927129:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8801373b8000 x1830963622605440/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/440 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.927139:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8000 with x1830963622605440 ext(4194304->4968447) 00002000:00010000:2.0:1746143780.927147:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373b8000 00000100:00100000:0.0:1746143780.934424:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.935325:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622605568 00000100:00100000:1.0:1746143780.935336:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622605568 00000100:00100000:1.0:1746143780.935403:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11990 00000100:00100000:1.0:1746143780.935411:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32264:x1830963622605568:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143780.935433:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143780.935453:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b43e expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.935495:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 36 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.935504:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a983e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3dc expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.935510:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.935512:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143780.935515:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1421312->2097151] (req 1421312->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.935552:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a983e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3dc expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143780.935563:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a983e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3dc expref: 25 pid: 9585 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143780.935575:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626774400:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.935668:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 36 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.935676:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 36 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143780.935683:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626774528:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.935701:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143780.942207:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626774400:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143780.942222:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626774528:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143780.942267:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1421312->2097151] (req 1421312->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143780.942293:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53200, rc 0) 00000100:00100000:1.0:1746143780.942365:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32264:x1830963622605568:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6952us (7950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143780.942383:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11990 00000100:00100000:0.0:1746143780.942688:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.943247:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622605696 00000100:00100000:1.0:1746143780.943255:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622605696 00010000:00010000:1.0:1746143780.943283:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a983e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3dc expref: 25 pid: 9585 timeout: 940 lvb_type: 1 00000100:00100000:0.0:1746143780.943425:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.943991:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622605824 00000100:00100000:1.0:1746143780.943995:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622605824 00010000:00010000:1.0:1746143780.944010:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 37 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143780.944129:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5672 00000100:00100000:2.0:1746143780.944139:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622605696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.944153:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.944176:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a983e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3dc expref: 25 pid: 9585 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143780.944185:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a983e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3dc expref: 25 pid: 9585 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143780.944208:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73a983e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3dc expref: 25 pid: 9585 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143780.944225:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143780.944257:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622605696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 121us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.944266:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5672 00000100:00100000:2.0:1746143780.944279:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5673 00000100:00100000:2.0:1746143780.944283:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963622605824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143780.944290:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143780.944295:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 37 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143780.944303:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 37 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143780.944312:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73a9814 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c0 expref: 37 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143780.944319:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.944321:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143780.944327:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.944335:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143780.944362:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143780.944372:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626774656:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143780.944418:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143780.947442:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.947661:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626774656:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143780.947682:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143780.947748:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622605824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3463us (4321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143780.947760:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5673 00000100:00100000:3.0:1746143780.950998:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622606080 00000100:00100000:3.0:1746143780.951014:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622606080 00002000:00100000:3.0:1746143780.951071:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1421312->1425407) req@ffff8801373b8e00 x1830963622606080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.951081:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8e00 with x1830963622606080 ext(1421312->1425407) 00002000:00010000:3.0:1746143780.951087:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373b8e00 00000100:00100000:3.0:1746143780.951120:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3505 00000100:00100000:3.0:1746143780.951129:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622606080:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143780.951298:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622606080:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 168us (3866us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143780.951305:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3505 00002000:00100000:3.0:1746143780.951310:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1421312->1425407) req@ffff8801373b8e00 x1830963622606080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/4536 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143780.951316:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8e00 with x1830963622606080 ext(1421312->1425407) 00002000:00010000:3.0:1746143780.951319:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373b8e00 00000100:00100000:0.0:1746143780.962514:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143780.962625:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622606208 00000100:00100000:1.0:1746143780.962635:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622606208 00000100:00100000:3.0:1746143780.963999:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11991 00000100:00100000:3.0:1746143780.964013:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32264:x1830963622606208:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143780.964035:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143780.964055:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b445 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.964088:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.964095:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a9892 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b430 expref: 25 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.964100:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.964102:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.964105:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->2203647] (req 2097152->2203647) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 25 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.964138:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a9892 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b430 expref: 25 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143780.964151:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a9892 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b430 expref: 25 pid: 3134 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143780.964163:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626774784:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143780.964271:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.964278:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 35 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143780.964285:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626774912:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143780.964302:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143780.968143:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626774784:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143780.968156:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626774912:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143780.968194:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->2203647] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 25 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.968222:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634400, rc 0) 00000100:00100000:3.0:1746143780.968276:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32264:x1830963622606208:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4265us (5771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.968284:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11991 00000100:00100000:0.0:1746143780.972019:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143780.972072:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143780.972162:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622606336 00000100:00100000:3.0:1746143780.972174:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622606336 00010000:00010000:3.0:1746143780.972228:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a9892 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b430 expref: 25 pid: 3134 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143780.972263:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622606464 00000100:00100000:3.0:1746143780.972266:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622606464 00010000:00010000:3.0:1746143780.972276:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 36 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143780.972288:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5674 00000100:00100000:3.0:1746143780.972295:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622606336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.972309:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.972330:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a9892 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b430 expref: 25 pid: 3134 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143780.972340:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a9892 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b430 expref: 25 pid: 3134 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143780.972362:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635e00/0x87925e4cb73a9892 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b430 expref: 25 pid: 3134 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143780.972384:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.972424:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622606336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 129us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.972430:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5674 00000100:00100000:3.0:1746143780.972446:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5675 00000100:00100000:3.0:1746143780.972450:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622606464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143780.972456:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143780.972463:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 36 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143780.972470:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 36 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143780.972481:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73a9884 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b422 expref: 36 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143780.972489:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.972491:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143780.972498:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.972505:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143780.972534:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143780.972545:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626775040:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143780.972605:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143780.977352:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626775040:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143780.977382:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143780.977426:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963622606464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4974us (5353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143780.977437:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5675 00000100:00100000:0.0:1746143780.977826:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143780.978138:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622606720 00000100:00100000:2.0:1746143780.978145:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622606720 00002000:00100000:2.0:1746143780.978187:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2199552->2203647) req@ffff8801373bb800 x1830963622606720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/0 e 0 to 0 dl 1746143791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.978196:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bb800 with x1830963622606720 ext(2199552->2203647) 00002000:00010000:2.0:1746143780.978201:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373bb800 00000100:00100000:2.0:1746143780.978217:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3506 00000100:00100000:2.0:1746143780.978223:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622606720:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143780.978343:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622606720:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 120us (518us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143780.978348:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3506 00002000:00100000:2.0:1746143780.978353:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2199552->2203647) req@ffff8801373bb800 x1830963622606720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:176/0 lens 488/4536 e 0 to 0 dl 1746143791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143780.978359:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bb800 with x1830963622606720 ext(2199552->2203647) 00002000:00010000:2.0:1746143780.978361:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373bb800 00000100:00100000:0.0:1746143781.017235:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.017301:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622606848 00000100:00100000:3.0:1746143781.017311:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622606848 00000100:00080000:0.0:1746143781.017361:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143781.017399:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11992 00000100:00100000:3.0:1746143781.017408:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:32271:x1830963622606848:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143781.017427:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.017444:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b44c expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.017481:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.017489:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.017491:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.017494:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3309568->4026367] (req 3309568->4026367) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.017525:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.017536:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 23 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.017548:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626775168:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.018925:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.018960:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626775168:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.018984:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3309568->4026367] (req 3309568->4026367) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.019003:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635400, rc 0) 00000100:00100000:3.0:1746143781.019047:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:32271:x1830963622606848:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1641us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.019055:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11992 00000100:00100000:0.0:1746143781.019285:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.019462:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622606976 00000100:00100000:3.0:1746143781.019468:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622606976 00002000:00100000:3.0:1746143781.019520:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->2203647) req@ffff8801373b9180 x1830963622606976/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00080000:0.0:1746143781.019523:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1746143781.019530:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9180 with x1830963622606976 ext(2097152->2203647) 00010000:00010000:3.0:1746143781.019536:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 24 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.019547:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 24 pid: 3134 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143781.019553:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801373b9180 00000100:00100000:3.0:1746143781.019573:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1458 00000100:00100000:3.0:1746143781.019579:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622606976:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143781.023079:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622606976:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3487us (3782us total) trans 21474840345 rc 0/0 00000100:00100000:3.0:1746143781.023092:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1458 00002000:00100000:3.0:1746143781.023104:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->2203647) req@ffff8801373b9180 x1830963622606976/t21474840345(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/448 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.023120:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9180 with x1830963622606976 ext(2097152->2203647) 00010000:00010000:3.0:1746143781.023132:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 26 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.023146:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 26 pid: 3134 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143781.023153:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801373b9180 00000100:00100000:0.0:1746143781.025576:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.025667:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622607104 00000100:00100000:3.0:1746143781.025678:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622607104 00010000:00010000:3.0:1746143781.025713:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 26 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.025793:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5676 00000100:00100000:3.0:1746143781.025802:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622607104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.026005:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.026027:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 26 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.026040:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 26 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.026064:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f634400/0x87925e4cb73a98a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b445 expref: 26 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.026282:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.026285:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.026293:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.026301:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.026524:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.026537:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626775296:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143781.027282:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.029848:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626775296:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143781.029876:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.029962:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622607104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4159us (4393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.029974:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5676 00000100:00100000:0.0:1746143781.030546:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.030906:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622607360 00000100:00100000:3.0:1746143781.030925:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622607360 00002000:00100000:3.0:1746143781.030965:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (3309568->3313663) req@ffff8801373ba300 x1830963622607360/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.030974:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373ba300 with x1830963622607360 ext(3309568->3313663) 00002000:00010000:3.0:1746143781.030978:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373ba300 00000100:00100000:3.0:1746143781.031012:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3507 00000100:00100000:3.0:1746143781.031025:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622607360:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143781.031146:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622607360:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 128us (601us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143781.031151:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3507 00002000:00100000:3.0:1746143781.031155:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (3309568->3313663) req@ffff8801373ba300 x1830963622607360/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.031159:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373ba300 with x1830963622607360 ext(3309568->3313663) 00002000:00010000:3.0:1746143781.031161:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373ba300 00000100:00100000:0.0:1746143781.037157:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.037242:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622607616 00000100:00100000:3.0:1746143781.037253:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622607616 00002000:00100000:3.0:1746143781.037309:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (4022272->4026367) req@ffff8801373baa00 x1830963622607616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.037319:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373baa00 with x1830963622607616 ext(4022272->4026367) 00002000:00010000:3.0:1746143781.037325:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373baa00 00000100:00100000:3.0:1746143781.037366:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3508 00000100:00100000:3.0:1746143781.037375:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622607616:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143781.037537:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963622607616:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 163us (390us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143781.037544:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3508 00002000:00100000:3.0:1746143781.037550:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b6:0x0] (4022272->4026367) req@ffff8801373baa00 x1830963622607616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.037557:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373baa00 with x1830963622607616 ext(4022272->4026367) 00002000:00010000:3.0:1746143781.037560:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373baa00 00000100:00100000:0.0:1746143781.051252:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.051322:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622607744 00000100:00100000:2.0:1746143781.051332:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622607744 00000100:00100000:2.0:1746143781.051453:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12909 00000100:00100000:2.0:1746143781.051463:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32275:x1830963622607744:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143781.051492:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.051512:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093973000/0x87925e4cb73a98b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b453 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.051577:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.051590:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.051703:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.051723:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eca00/0x87925e4cb73a98c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.051728:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eca00/0x87925e4cb73a98c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.051733:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eca00/0x87925e4cb73a98c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.051807:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.051817:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b396 expref: 280 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.051823:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c7 expref: 26 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.051829:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 5/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.051859:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c7 expref: 26 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.051871:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c7 expref: 26 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.051883:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626775424:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.052037:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b396 expref: 280 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.052045:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b396 expref: 280 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.052053:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626775552:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.052072:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.054449:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.054493:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.054603:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626775424:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.054613:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626775552:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.054634:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143781.054693:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622608128 00000100:00100000:3.0:1746143781.054701:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622608128 00000100:00100000:1.0:1746143781.054710:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622608256 00000100:00100000:1.0:1746143781.054714:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622608256 00000100:00100000:1.0:1746143781.054750:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4738 00000100:00100000:3.0:1746143781.054757:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4739 00000100:00100000:1.0:1746143781.054758:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:30658:x1830963622608256:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143781.054763:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+281:8586:x1830963622608128:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1746143781.054906:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143781.055029:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+282:8586:x1830963622608128:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 265us (586us total) trans 8589943672 rc 0/0 00000100:00100000:3.0:1746143781.055036:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4739 00000100:00100000:1.0:1746143781.055038:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:30658:x1830963622608256:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 280us (544us total) trans 8589943673 rc 0/0 00000100:00100000:1.0:1746143781.055044:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4738 00000100:00100000:0.0:1746143781.056724:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.056765:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.056841:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622608384 00000100:00100000:3.0:1746143781.056848:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622608384 00010000:00010000:3.0:1746143781.056877:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c7 expref: 28 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.056930:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622608512 00000100:00100000:1.0:1746143781.056933:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622608512 00010000:00010000:1.0:1746143781.056945:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b396 expref: 282 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.056952:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5677 00000100:00100000:1.0:1746143781.056967:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5678 00000100:00100000:1.0:1746143781.056970:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+282:2011:x1830963622608512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.056983:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.056987:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b396 expref: 282 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.056993:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b396 expref: 282 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.057009:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3d400/0x87925e4cb73a97e3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b396 expref: 282 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.057020:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.057023:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.057029:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.057031:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.057034:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.057061:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+281:2011:x1830963622608512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 90us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.057065:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5678 00000100:00100000:3.0:1746143781.057203:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963622608384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.057212:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.057217:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c7 expref: 28 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.057227:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c7 expref: 28 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.057239:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9822 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3c7 expref: 28 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.057251:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.057254:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.057260:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.057268:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.057354:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143781.057421:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057429:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143781.057475:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:2.0:1746143781.057480:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143781.057500:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057515:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057526:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057531:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057537:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057543:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057548:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880123269200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.057552:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057559:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057567:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143781.057569:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143781.057572:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057577:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123269200/0x87925e4cb73a98bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057590:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eca00/0x87925e4cb73a98c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057594:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eca00/0x87925e4cb73a98c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057599:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eca00/0x87925e4cb73a98c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057603:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800972eca00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.057605:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eca00/0x87925e4cb73a98c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057609:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eca00/0x87925e4cb73a98c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057614:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14100) 00010000:00010000:2.0:1746143781.057616:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143781.057617:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eca00/0x87925e4cb73a98c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057621:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eca00/0x87925e4cb73a98c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.057650:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093973000/0x87925e4cb73a98b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b453 expref: 18 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.057660:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b453 expref: 17 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.057666:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.057667:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143781.057669:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800972eda00, rc 0) 00000100:00100000:3.0:1746143781.057709:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622608384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 750us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.057715:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5677 00000100:00100000:2.0:1746143781.058159:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:32275:x1830963622607744:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 6696us (6917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.058166:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12909 00000100:00100000:2.0:1746143781.061269:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.061543:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.061570:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.061594:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622608640 00000100:00100000:2.0:1746143781.061603:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622608640 00000100:00100000:3.0:1746143781.061691:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622608896 00000100:00100000:3.0:1746143781.061695:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622608896 00000100:00100000:1.0:1746143781.061722:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622608768 00000100:00100000:1.0:1746143781.061727:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622608768 00000100:00080000:0.0:1746143781.061815:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143781.061819:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143781.061874:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11993 00000100:00100000:2.0:1746143781.061884:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622608640:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143781.061931:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.061950:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a98d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b45a expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.061972:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.061974:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143781.061974:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11994 00010000:00010000:2.0:1746143781.061982:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a98d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b45a expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143781.061982:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622608768:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143781.061990:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.061998:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a98d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b45a expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.062001:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a98d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b461 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.062008:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97200, rc 0) 00000100:00100000:1.0:1746143781.062046:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626775680:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143781.062113:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.062158:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.062270:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622609024 00000100:00100000:1.0:1746143781.062274:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622609024 00000100:00100000:0.0:1746143781.062280:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11995 00000100:00100000:0.0:1746143781.062287:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622608896:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:1.0:1746143781.062292:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11996 00010000:00010000:0.0:1746143781.062294:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143781.062296:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622609024:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143781.062302:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143781.062303:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73a98df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b468 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.062309:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a98e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b46f expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.062319:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.062320:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.062325:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a98e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b46f expref: 15 pid: 9839 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143781.062329:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626775808:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143781.062334:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a98e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b46f expref: 15 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.062340:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52600, rc 0) 00000100:00100000:1.0:1746143781.062356:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622609024:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 59us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.062356:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.062361:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11996 00000100:00100000:2.0:1746143781.062461:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622608640:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 579us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.062466:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11993 00002000:00010000:1.0:1746143781.065996:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime: 1746143780 -> 1746143781 00002000:00010000:1.0:1746143781.066005:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime: 1746143780 -> 1746143781 00002000:00010000:1.0:1746143781.066008:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime: 1746143780 -> 1746143781 00000100:00100000:1.0:1746143781.066032:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626775680:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143781.066071:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a98d8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b461 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.066087:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a98d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b461 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.066099:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52c00, rc 0) 00000100:00100000:2.0:1746143781.066152:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626775808:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143781.066170:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73a98df lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b468 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.066184:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73a98df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b468 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143781.066436:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622608768:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4453us (4862us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143781.066445:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11994 00010000:00010000:2.0:1746143781.066591:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7f800, rc 0) 00000100:00100000:2.0:1746143781.066613:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622608896:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4326us (5070us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143781.066618:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11995 00000100:00100000:0.0:1746143781.071751:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.071853:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622609280 00000100:00100000:2.0:1746143781.071863:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622609280 00000100:00100000:2.0:1746143781.071975:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12910 00000100:00100000:2.0:1746143781.071983:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:32275:x1830963622609280:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143781.072005:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.072026:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a98ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b476 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.072131:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.072146:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b453 expref: 18 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.072155:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.072189:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b453 expref: 18 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.072204:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b453 expref: 18 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.072216:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626775936:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.072314:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.074963:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626775936:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.074985:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143781.075097:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.075490:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622609408 00000100:00100000:3.0:1746143781.075501:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622609408 00010000:00010000:3.0:1746143781.075540:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b453 expref: 19 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.075581:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5679 00000100:00100000:3.0:1746143781.075590:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2009:x1830963622609408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.075604:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.075610:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b453 expref: 19 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.075621:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b453 expref: 19 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.075644:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73a98ca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b453 expref: 19 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.076383:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.076390:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.076401:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.076412:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.076448:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.076521:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2009:x1830963622609408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 928us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.076529:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5679 00010000:00010000:2.0:1746143781.076618:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.076626:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143781.076646:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143781.076844:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73a98ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b476 expref: 19 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.076871:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b476 expref: 18 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.076877:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.076879:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143781.076881:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97e00, rc 0) 00000100:00100000:2.0:1746143781.076945:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:32275:x1830963622609280:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4962us (5204us total) trans 8589943674 rc 0/0 00000100:00100000:2.0:1746143781.076953:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12910 00000100:00100000:0.0:1746143781.078388:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.078430:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622609536 00000100:00100000:2.0:1746143781.078438:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622609536 00000100:00100000:2.0:1746143781.078482:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12911 00000100:00100000:2.0:1746143781.078489:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:32275:x1830963622609536:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143781.078510:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.078524:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73a9902 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b47d expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.078598:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.078611:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b476 expref: 19 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.078617:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.078645:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b476 expref: 19 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.078656:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b476 expref: 19 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.078667:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626776064:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.078748:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.081796:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626776064:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.081860:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143781.082095:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.082270:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622609664 00000100:00100000:3.0:1746143781.082277:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622609664 00010000:00010000:3.0:1746143781.082311:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b476 expref: 20 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.082349:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5680 00000100:00100000:3.0:1746143781.082356:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2009:x1830963622609664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.082370:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.082375:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b476 expref: 20 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.082383:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b476 expref: 20 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.082405:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73a98f4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b476 expref: 20 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.082422:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.082426:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.082440:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.082448:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.082476:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.082512:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2009:x1830963622609664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 156us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.082518:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5680 00010000:00010000:2.0:1746143781.082709:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.082716:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143781.082768:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:2.0:1746143781.082773:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143781.082790:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.082821:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73a9902 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b47d expref: 19 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.082845:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b47d expref: 18 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.082853:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.082855:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143781.082858:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97400, rc 0) 00000100:00100000:2.0:1746143781.082882:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:32275:x1830963622609536:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4394us (4497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.082903:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12911 00000100:00100000:0.0:1746143781.084806:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.084872:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622609792 00000100:00100000:2.0:1746143781.084879:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622609792 00000100:00100000:2.0:1746143781.084959:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11997 00000100:00100000:2.0:1746143781.084966:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622609792:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143781.084983:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.085000:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9910 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b484 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.085053:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626776192:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143781.085132:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.085458:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.085652:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622609920 00000100:00100000:2.0:1746143781.085657:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622609920 00000100:00100000:2.0:1746143781.085688:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11998 00000100:00100000:2.0:1746143781.085694:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622609920:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143781.085700:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.085708:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093973c00/0x87925e4cb73a9917 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b48b expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.085734:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626776320:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143781.085760:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.087045:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626776192:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143781.087061:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626776320:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143781.087066:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9910 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b484 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.087077:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9910 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b484 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.087078:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093973c00/0x87925e4cb73a9917 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b48b expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.087086:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093973c00/0x87925e4cb73a9917 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b48b expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.087093:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093973c00, rc 0) 00010000:00010000:2.0:1746143781.087097:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96c00, rc 0) 00000100:00100000:2.0:1746143781.087129:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622609792:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2163us (2328us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143781.087135:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11997 00000100:00100000:3.0:1746143781.087229:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622609920:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1535us (1771us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143781.087235:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11998 00000100:00100000:0.0:1746143781.089141:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.089237:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622610176 00000100:00100000:2.0:1746143781.089246:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622610176 00000100:00100000:2.0:1746143781.089332:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12912 00000100:00100000:2.0:1746143781.089341:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:32275:x1830963622610176:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143781.089363:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.089384:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a991e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b492 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.089643:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a9925 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.089658:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a9925 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.089669:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a9925 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143781.089681:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143781.089777:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad800/0x87925e4cb73a991e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b492 expref: 21 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.089792:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a9925 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b492 expref: 20 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.089800:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.089803:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143781.089806:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5acc00, rc 0) 00000100:00100000:2.0:1746143781.089897:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:32275:x1830963622610176:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 545us (756us total) trans 8589943675 rc 0/0 00000100:00100000:2.0:1746143781.089903:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12912 00000100:00100000:0.0:1746143781.091542:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.091716:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622610304 00000100:00100000:3.0:1746143781.091724:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622610304 00000100:00100000:3.0:1746143781.091767:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11999 00000100:00100000:3.0:1746143781.091773:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622610304:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143781.091807:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.091826:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9535 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1dd expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.091835:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73a963f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b27e expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.091842:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a95ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b223 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.091847:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.091849:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.091852:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.091880:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a95ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b223 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.091900:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a95ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b223 expref: 11 pid: 3134 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.091937:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626776448:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.092012:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73a963f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b27e expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.092019:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73a963f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b27e expref: 35 pid: 9586 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.092032:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626776576:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.092054:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1dd expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.092061:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9535 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1dd expref: 24 pid: 9585 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.092069:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626776704:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.092081:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5610c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.092649:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.092665:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.092677:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.092691:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622610560 00000100:00100000:2.0:1746143781.092695:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622610560 00000100:00100000:2.0:1746143781.092713:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622610816 00000100:00100000:2.0:1746143781.092715:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622610816 00000100:00100000:2.0:1746143781.092724:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622610432 00000100:00100000:2.0:1746143781.092725:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622610432 00000100:00100000:2.0:1746143781.092735:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12000 00000100:00100000:2.0:1746143781.092740:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622610560:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143781.092762:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.092775:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 41 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.092783:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a98d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b45a expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.092790:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9837 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3d5 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.092795:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.092796:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.092798:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.092814:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3d5 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.092823:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3d5 expref: 22 pid: 9587 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.092832:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626776832:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.092862:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a98d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b45a expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.092869:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a98d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b45a expref: 15 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.092877:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626776960:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.092909:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 41 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.092934:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 41 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.092942:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626777088:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.092965:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.092984:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.092998:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622610688 00000100:00100000:2.0:1746143781.093001:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622610688 00000100:00100000:2.0:1746143781.093016:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12001 00000100:00100000:2.0:1746143781.093020:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622610816:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143781.093035:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.093045:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.093051:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143781.093052:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143781.093055:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.093067:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 35 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.093074:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 35 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.093081:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626777216:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.093096:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c50f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.093108:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12002 00000100:00100000:2.0:1746143781.093113:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622610432:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143781.093126:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.093136:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.093148:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73a97f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b39d expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.093155:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9773 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b349 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.093159:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.093160:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.093162:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.093174:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9773 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b349 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.093180:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9773 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b349 expref: 15 pid: 3135 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.093187:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626777344:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.093206:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73a97f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b39d expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.093212:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73a97f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b39d expref: 41 pid: 3134 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.093219:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626777472:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.093234:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.093242:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 22 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.093248:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626777600:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.093258:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.093295:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.093308:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622610944 00000100:00100000:2.0:1746143781.093310:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622610944 00000100:00100000:3.0:1746143781.093316:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12003 00000100:00100000:3.0:1746143781.093325:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622610688:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143781.093343:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.093354:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 24 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.093361:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.093362:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.093364:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.093626:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 24 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.093642:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 24 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.093651:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626777728:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.093675:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.094798:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626776448:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143781.094897:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.095003:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626776576:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.095010:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626776704:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.095025:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622611072 00000100:00100000:1.0:1746143781.095030:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622611072 00010000:00010000:3.0:1746143781.095037:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.095057:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a95ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b223 expref: 14 pid: 3134 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.095073:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12004 00000100:00100000:1.0:1746143781.095079:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5681 00000100:00100000:3.0:1746143781.095080:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963622610944:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:1.0:1746143781.095084:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622611072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.095095:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.095107:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.095116:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a95ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b223 expref: 14 pid: 3134 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.095120:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.095126:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a95ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b223 expref: 14 pid: 3134 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.095127:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a98e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b46f expref: 16 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.095134:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73a9899 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b437 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.095144:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a95ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b223 expref: 14 pid: 3134 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.095146:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a984c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ea expref: 22 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.095152:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.095153:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.095155:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 7/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.095159:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143781.095176:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a984c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ea expref: 22 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.095181:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622611072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 97us (295us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143781.095185:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a984c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ea expref: 22 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.095187:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5681 00000100:00100000:3.0:1746143781.095201:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626777856:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.095258:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73a9899 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b437 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.095265:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73a9899 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b437 expref: 22 pid: 9587 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.095272:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626777984:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.095300:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a98e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b46f expref: 16 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.095311:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a98e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b46f expref: 16 pid: 9839 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.095318:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626778112:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.095339:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.095345:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 41 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.095351:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626778240:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.095363:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f8796c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.098548:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.098643:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622611200 00000100:00100000:3.0:1746143781.098652:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622611200 00010000:00010000:3.0:1746143781.098685:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73a963f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b27e expref: 36 pid: 9586 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.098722:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5682 00000100:00100000:3.0:1746143781.098728:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622611200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.098741:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.098760:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73a963f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b27e expref: 36 pid: 9586 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.098770:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73a963f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b27e expref: 36 pid: 9586 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.098791:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73a963f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b27e expref: 36 pid: 9586 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.098806:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.098859:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622611200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.098865:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5682 00000100:00100000:0.0:1746143781.102987:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626776832:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143781.102999:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626776960:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143781.103006:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626777088:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143781.103035:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.103137:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.103175:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.103194:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.103233:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626777344:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.103250:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626777216:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.103253:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622611584 00000100:00100000:2.0:1746143781.103259:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622611584 00010000:00010000:3.0:1746143781.103262:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.103280:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622611456 00000100:00100000:3.0:1746143781.103282:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622611456 00002000:00100000:2.0:1746143781.103302:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3309568->4026367) req@ffff8800921cca80 x1830963622611584/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746143781.103310:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3d5 expref: 23 pid: 9587 timeout: 940 lvb_type: 1 00002000:00100000:2.0:1746143781.103311:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cca80 with x1830963622611584 ext(3309568->4026367) 00010000:00010000:2.0:1746143781.103317:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 35 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.103326:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 35 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.103334:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622611328 00000100:00100000:3.0:1746143781.103336:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622611328 00002000:00010000:2.0:1746143781.103337:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800921cca80 00010000:00010000:3.0:1746143781.103344:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a98d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b45a expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.103349:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1459 00000100:00100000:2.0:1746143781.103357:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622611584:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143781.103361:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5683 00000100:00100000:3.0:1746143781.103365:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622611456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143781.103374:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5684 00000100:00100000:2.0:1746143781.103377:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2010:x1830963622611328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.103378:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.103383:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.103395:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3d5 expref: 23 pid: 9587 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.103396:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a98d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b45a expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.103405:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3d5 expref: 23 pid: 9587 timeout: 940 lvb_type: 1 00000100:00080000:0.0:1746143781.103435:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746143781.103581:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a98d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b45a expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.103602:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73a98d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b45a expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.103665:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9837 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3d5 expref: 23 pid: 9587 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.103677:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.103723:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963622611456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 356us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.103729:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5683 00000100:00100000:1.0:1746143781.103862:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.103874:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.103940:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.103952:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622611712 00000100:00100000:1.0:1746143781.103954:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622611712 00010000:00010000:2.0:1746143781.104195:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.104216:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2010:x1830963622611328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 838us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.104222:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5684 00000100:00100000:2.0:1746143781.104231:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622611840 00000100:00100000:2.0:1746143781.104233:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622611840 00010000:00010000:2.0:1746143781.104243:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9773 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b349 expref: 16 pid: 3135 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.104409:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 42 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.104443:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622612096 00000100:00100000:3.0:1746143781.104447:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5685 00000100:00100000:2.0:1746143781.104447:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622612096 00000100:00100000:3.0:1746143781.104452:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2010:x1830963622611840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.104456:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 22 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.104460:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143781.104468:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5686 00010000:00010000:3.0:1746143781.104471:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9773 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b349 expref: 16 pid: 3135 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.104472:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963622611712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.104477:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.104479:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9773 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b349 expref: 16 pid: 3135 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.104483:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 42 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.104489:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73a9773 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b349 expref: 16 pid: 3135 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.104490:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 42 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.104498:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143781.104500:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a980d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3b9 expref: 42 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.104509:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.104511:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143781.104512:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622611840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (636us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143781.104516:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.104519:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5685 00010000:00010000:2.0:1746143781.104523:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.104530:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5687 00000100:00100000:3.0:1746143781.104533:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622612096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.104538:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.104540:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143781.104543:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 22 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.104551:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 22 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.104557:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622611712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 80us (691us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143781.104560:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.104561:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5686 00000100:00100000:3.0:1746143781.104570:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622612096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 37us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.104575:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5687 00000100:00100000:2.0:1746143781.104589:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626777472:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.104593:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626777728:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.104596:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097369a00/0x87925e4cb73a9750 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b33b expref: 21 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.104605:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626777600:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.104606:0:3134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.104619:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.104639:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626777856:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.104733:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.104742:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622611968 00000100:00100000:1.0:1746143781.104745:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622611968 00010000:00010000:1.0:1746143781.104755:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9535 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1dd expref: 25 pid: 9585 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143781.104765:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5688 00000100:00100000:1.0:1746143781.104768:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622611968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.104775:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.104787:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9535 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1dd expref: 25 pid: 9585 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.104799:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1dd expref: 25 pid: 9585 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.104809:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9535 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b1dd expref: 25 pid: 9585 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.104821:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.104822:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.104825:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.104830:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.104847:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.104859:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622611968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.104863:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5688 00000100:00100000:1.0:1746143781.104907:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.104929:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622612224 00000100:00100000:1.0:1746143781.104931:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622612224 00010000:00010000:1.0:1746143781.104940:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a984c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ea expref: 21 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.104956:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5689 00000100:00100000:1.0:1746143781.104960:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2008:x1830963622612224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.104971:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.104979:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a984c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ea expref: 21 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.104985:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a984c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ea expref: 21 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.104994:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a984c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b3ea expref: 21 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.105001:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.105012:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622612224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 52us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.105016:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5689 00000100:00100000:1.0:1746143781.105045:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.105063:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.105069:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622612480 00000100:00100000:1.0:1746143781.105071:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622612480 00010000:00010000:1.0:1746143781.105078:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73a97f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b39d expref: 41 pid: 3134 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143781.105089:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5690 00000100:00100000:1.0:1746143781.105092:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622612480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.105097:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.105102:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73a97f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b39d expref: 41 pid: 3134 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.105111:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73a97f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b39d expref: 41 pid: 3134 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.105120:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73a97f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b39d expref: 41 pid: 3134 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.105127:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.105128:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.105130:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.105136:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.105155:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.105169:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622612480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.105173:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5690 00010000:00010000:2.0:1746143781.105381:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.105389:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.105404:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.105411:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.105418:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.105423:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082085c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143781.105427:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.105439:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.105449:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.105454:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73a9948 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.105500:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622610432:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 12386us (12822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.105507:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12002 00000100:00080000:0.0:1746143781.105924:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746143781.105950:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.105969:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.105999:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.106005:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.106010:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.106015:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db02800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143781.106017:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.106035:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.106044:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.106060:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db02800/0x87925e4cb73a993a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.106113:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622610560:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 13372us (13465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.106126:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12000 00000100:00100000:3.0:1746143781.106230:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622612352 00000100:00100000:3.0:1746143781.106235:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622612352 00002000:00100000:3.0:1746143781.106261:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1421312->2097151) req@ffff8800919e5500 x1830963622612352/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.106270:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e5500 with x1830963622612352 ext(1421312->2097151) 00010000:00010000:3.0:1746143781.106277:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 24 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.106286:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 24 pid: 9587 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143781.106292:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919e5500 00000100:00100000:3.0:1746143781.106308:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1460 00000100:00100000:3.0:1746143781.106313:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622612352:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143781.106439:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.106840:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622612608 00000100:00100000:3.0:1746143781.106843:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622612608 00010000:00010000:3.0:1746143781.106857:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a98e6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b46f expref: 13 pid: 9839 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.107027:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5691 00000100:00100000:3.0:1746143781.107032:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622612608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.107040:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.107049:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a98e6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b46f expref: 13 pid: 9839 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.107057:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a98e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b46f expref: 13 pid: 9839 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.107069:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.107088:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622612608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.107097:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5691 00000100:00100000:3.0:1746143781.107134:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626777984:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.107145:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73a98e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b46f expref: 12 pid: 9839 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.107153:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626778112:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.107163:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626778240:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.107189:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.107209:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.107217:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.107230:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.107237:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.107243:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.107252:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143781.107255:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.107261:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.107270:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.107275:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9933 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.107312:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622610304:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 15538us (15774us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.107319:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11999 00000100:00100000:2.0:1746143781.108346:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.108649:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622612736 00000100:00100000:0.0:1746143781.108656:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622612736 00010000:00010000:0.0:1746143781.108677:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73a9899 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b437 expref: 20 pid: 9587 timeout: 940 lvb_type: 1 00000100:00100000:0.0:1746143781.108708:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5692 00000100:00100000:0.0:1746143781.108714:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622612736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143781.108722:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143781.108734:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73a9899 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b437 expref: 20 pid: 9587 timeout: 940 lvb_type: 1 00010000:00010000:0.0:1746143781.108746:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73a9899 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b437 expref: 20 pid: 9587 timeout: 940 lvb_type: 1 00010000:00010000:0.0:1746143781.108761:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73a9899 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b437 expref: 20 pid: 9587 timeout: 940 lvb_type: 1 00010000:00010000:0.0:1746143781.108771:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143781.108803:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622612736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.108808:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5692 00000100:00100000:2.0:1746143781.108867:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.108999:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622612864 00000100:00100000:0.0:1746143781.109002:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622612864 00010000:00010000:0.0:1746143781.109014:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 40 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.109043:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5693 00000100:00100000:0.0:1746143781.109048:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622612864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143781.109058:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143781.109064:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 40 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.109075:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 40 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.109088:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634200/0x87925e4cb73a988b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b429 expref: 40 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.109098:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.109100:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.109104:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.109111:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.109135:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143781.109152:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.109152:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622612864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 104us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.109156:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5693 00010000:00010000:3.0:1746143781.109160:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.109173:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.109180:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.109187:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.109192:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093973000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143781.109195:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.109201:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.109211:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.109216:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093973000/0x87925e4cb73a9956 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.109255:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622610944:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 14175us (15959us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.109261:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12004 00000100:00100000:2.0:1746143781.117972:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963622611584:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 14600us (14760us total) trans 21474840346 rc 0/0 00000100:00100000:2.0:1746143781.117987:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1459 00002000:00100000:2.0:1746143781.118000:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3309568->4026367) req@ffff8800921cca80 x1830963622611584/t21474840346(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/448 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.118010:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cca80 with x1830963622611584 ext(3309568->4026367) 00010000:00010000:2.0:1746143781.118021:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 37 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.118034:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 37 pid: 3134 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143781.118042:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800921cca80 00000100:00100000:3.0:1746143781.119719:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622612352:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 13397us (14664us total) trans 21474840347 rc 0/0 00000100:00100000:3.0:1746143781.119729:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1460 00002000:00100000:3.0:1746143781.119739:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3b5:0x0] (1421312->2097151) req@ffff8800919e5500 x1830963622612352/t21474840347(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/448 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.119747:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e5500 with x1830963622612352 ext(1421312->2097151) 00010000:00010000:3.0:1746143781.119757:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 26 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.119767:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 26 pid: 9587 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143781.119774:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800919e5500 00000100:00100000:0.0:1746143781.120501:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.120579:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622612992 00000100:00100000:2.0:1746143781.120588:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622612992 00010000:00010000:2.0:1746143781.120615:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 37 pid: 3134 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.120647:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5694 00000100:00100000:2.0:1746143781.120654:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622612992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.120667:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.120683:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 37 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.120694:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 37 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.120717:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73a98ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3309568->4026367) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b44c expref: 37 pid: 3134 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.120733:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.120734:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.120739:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.120747:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.120781:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143781.120804:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.120811:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963622612992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 157us (312us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143781.120813:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.120817:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5694 00010000:00010000:0.0:1746143781.120834:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.120841:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.120848:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.120854:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082085000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143781.120858:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.120865:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.120876:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.120881:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085000/0x87925e4cb73a9941 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.120956:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622610816:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 27934us (28288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.120968:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12001 00000100:00100000:0.0:1746143781.122376:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.122564:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622613120 00000100:00100000:2.0:1746143781.122571:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622613120 00010000:00010000:2.0:1746143781.122598:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 26 pid: 9587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.122632:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5695 00000100:00100000:2.0:1746143781.122638:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2010:x1830963622613120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.122650:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.122664:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 26 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.122674:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 26 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.122692:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a53200/0x87925e4cb73a98a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b43e expref: 26 pid: 9587 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.122705:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.122707:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.122710:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.122721:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.122749:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143781.122772:0:3134:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.122782:0:3134:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.122797:0:3134:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.122805:0:3134:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.122812:0:3134:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.122817:0:3134:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800972eca00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143781.122821:0:3134:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.122827:0:3134:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.122843:0:3134:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.122849:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73a994f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.122942:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622613120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 302us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.122948:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5695 00000100:00100000:3.0:1746143781.123516:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622610688:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 30190us (30528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.123630:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12003 00000100:00100000:0.0:1746143781.125109:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.125232:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622613376 00000100:00100000:2.0:1746143781.125240:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622613376 00000100:00100000:2.0:1746143781.125294:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12913 00000100:00100000:2.0:1746143781.125302:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:32275:x1830963622613376:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:2.0:1746143781.125356:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.125382:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73a9909 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b47d expref: 20 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125398:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.125402:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143781.125430:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.125447:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b032 expref: 280 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125498:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b055 expref: 26 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125505:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af9f expref: 280 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125512:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 280 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125517:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a91ca lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc2 expref: 26 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125522:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b29a expref: 26 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125528:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d9 expref: 280 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125533:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 10/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.125562:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d9 expref: 280 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125573:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d9 expref: 280 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.125585:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626778368:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.125685:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b29a expref: 26 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125692:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b29a expref: 26 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.125709:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626778496:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.125736:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a91ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc2 expref: 26 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125744:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a91ca lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc2 expref: 26 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.125751:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626778624:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.125773:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 280 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125780:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 280 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.125786:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626778752:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.125806:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af9f expref: 280 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125812:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af9f expref: 280 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.125818:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626778880:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.125836:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b055 expref: 26 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125847:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b055 expref: 26 pid: 10936 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.125854:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626779008:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.125880:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b032 expref: 280 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.125898:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b032 expref: 280 pid: 10936 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.125904:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626779136:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.125951:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.128370:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.128403:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.128428:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.128431:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622613632 00000100:00100000:1.0:1746143781.128441:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622613632 00000100:00100000:0.0:1746143781.128453:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.128462:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622614016 00000100:00100000:3.0:1746143781.128465:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622614016 00000100:00100000:3.0:1746143781.128482:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4740 00000100:00100000:0.0:1746143781.128482:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.128494:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:16365:x1830963622613632:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143781.128509:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.128647:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4741 00000100:00100000:1.0:1746143781.128655:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+281:8586:x1830963622614016:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143781.128815:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+282:8586:x1830963622614016:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 160us (384us total) trans 8589943676 rc 0/0 00000100:00100000:1.0:1746143781.128821:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4741 00000100:00100000:1.0:1746143781.128849:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622613760 00000100:00100000:1.0:1746143781.128853:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622613760 00010000:00010000:1.0:1746143781.128867:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a91ca lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc2 expref: 29 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.128873:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626778368:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.128883:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626778496:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.128884:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5696 00000100:00100000:1.0:1746143781.128899:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2010:x1830963622613760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143781.128900:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626778624:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.128907:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626778752:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.128908:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.128932:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a91ca lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc2 expref: 29 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.128943:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a91ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc2 expref: 29 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.128954:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626778880:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.128960:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626779008:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.128963:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73a91ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afc2 expref: 29 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.128966:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626779136:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.128974:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.128978:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.128986:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143781.129296:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.129298:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:16365:x1830963622613632:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 803us (935us total) trans 8589943677 rc 0/0 00000100:00100000:3.0:1746143781.129304:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4740 00000100:00100000:3.0:1746143781.129323:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622614144 00000100:00100000:3.0:1746143781.129326:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622614144 00010000:00010000:3.0:1746143781.129337:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 282 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.129348:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622614272 00000100:00100000:3.0:1746143781.129349:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622614272 00010000:00010000:3.0:1746143781.129357:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af9f expref: 283 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.129370:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622614400 00000100:00100000:3.0:1746143781.129372:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622614400 00010000:00010000:3.0:1746143781.129378:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b032 expref: 284 pid: 10936 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.129385:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622614528 00000100:00100000:3.0:1746143781.129386:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622614528 00010000:00010000:3.0:1746143781.129392:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b055 expref: 28 pid: 10936 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.129400:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5697 00000100:00100000:3.0:1746143781.129405:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+284:2008:x1830963622614144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.129411:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.129415:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 284 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129421:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 284 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129433:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73a91bc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840afad expref: 284 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129441:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.129444:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.129450:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.129465:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+283:2008:x1830963622614144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 59us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.129471:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5697 00000100:00100000:3.0:1746143781.129481:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5698 00000100:00100000:3.0:1746143781.129485:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+282:2008:x1830963622614272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.129491:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.129495:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af9f expref: 282 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129502:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af9f expref: 282 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129512:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73a91ae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840af9f expref: 282 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129520:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.129523:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.129527:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.129541:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+281:2008:x1830963622614272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.129546:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5698 00000100:00100000:3.0:1746143781.129555:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5699 00000100:00100000:3.0:1746143781.129560:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+280:2011:x1830963622614400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.129566:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.129569:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b032 expref: 280 pid: 10936 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129581:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b032 expref: 280 pid: 10936 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129591:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73a9256 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b032 expref: 280 pid: 10936 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129600:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.129603:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.129608:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.129622:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:2011:x1830963622614400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 62us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.129627:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5699 00000100:00100000:3.0:1746143781.129636:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5700 00000100:00100000:1.0:1746143781.129639:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2010:x1830963622613760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 740us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.129641:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2010:x1830963622614528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143781.129645:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5696 00010000:00010000:3.0:1746143781.129647:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.129650:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b055 expref: 27 pid: 10936 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129656:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b055 expref: 27 pid: 10936 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129665:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73a9295 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b055 expref: 27 pid: 10936 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.129672:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.129675:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.129679:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.129692:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2010:x1830963622614528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.129697:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5700 00010000:00010000:2.0:1746143781.129742:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143781.130634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.130681:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622614656 00000100:00100000:2.0:1746143781.130687:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622614656 00000100:00100000:0.0:1746143781.130693:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143781.130708:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b29a expref: 26 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.130731:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622614784 00000100:00100000:2.0:1746143781.130733:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622614784 00000100:00100000:0.0:1746143781.130737:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5701 00010000:00010000:2.0:1746143781.130743:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d9 expref: 279 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.130746:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2010:x1830963622614656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143781.130754:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143781.130755:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5702 00000100:00100000:2.0:1746143781.130760:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+279:2009:x1830963622614784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143781.130760:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b29a expref: 26 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.130766:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143781.130769:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b29a expref: 26 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.130770:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d9 expref: 279 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.130778:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d9 expref: 279 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.130791:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73a967e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b29a expref: 26 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.130796:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27800/0x87925e4cb73a96cb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b2d9 expref: 279 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.130802:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143781.130806:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143781.130812:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143781.130822:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.130829:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.130832:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143781.130851:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.130870:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+278:2009:x1830963622614784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.130870:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2010:x1830963622614656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 126us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.130876:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5701 00000100:00100000:2.0:1746143781.130879:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5702 00010000:00010000:3.0:1746143781.131136:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.131143:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000040:00080000:3.0:1746143781.131451:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2663, 88 off222064 00000004:00080000:3.0:1746143781.131458:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840355545731ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.131498:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2625, 88 off219064 00000004:00080000:3.0:1746143781.131503:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840355590580ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.131549:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2626, 88 off219152 00000004:00080000:3.0:1746143781.131553:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840355641216ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.131568:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2664, 88 off222152 00000004:00080000:3.0:1746143781.131571:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840355658853ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.131585:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2665, 88 off222240 00000004:00080000:3.0:1746143781.131587:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840355675378ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.131595:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2627, 88 off219240 00000004:00080000:3.0:1746143781.131597:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840355685223ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.131609:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2628, 88 off219328 00000004:00080000:3.0:1746143781.131612:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840355699870ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.131621:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2629, 88 off219416 00000004:00080000:3.0:1746143781.131623:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840355710938ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.131632:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2666, 88 off222328 00000004:00080000:3.0:1746143781.131635:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840355722950ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.131642:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2630, 88 off219504 00000004:00080000:3.0:1746143781.131644:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840355732290ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.131662:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2667, 88 off222416 00000004:00080000:3.0:1746143781.131665:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840355752536ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.131672:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2631, 88 off219592 00000004:00080000:3.0:1746143781.131674:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840355762090ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.131681:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2668, 88 off222504 00000004:00080000:3.0:1746143781.131683:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840355770920ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.131690:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2669, 88 off222592 00000004:00080000:3.0:1746143781.131692:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840355779885ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.131699:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2670, 88 off222680 00000004:00080000:3.0:1746143781.131701:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840355788965ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.131708:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2671, 88 off222768 00000004:00080000:3.0:1746143781.131713:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840355800525ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.131720:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2632, 88 off219680 00000004:00080000:3.0:1746143781.131723:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840355811064ns, next at 770855090093ns, rc = 0 00000001:00080000:2.0:1746143781.132720:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943678 is committed 00000004:00080000:2.0:1746143781.132729:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1862 committed 00000004:00080000:2.0:1746143781.132735:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1898 committed 00000004:00080000:2.0:1746143781.132876:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1897 committed 00000004:00080000:2.0:1746143781.132878:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1896 committed 00000100:00100000:0.0:1746143781.132878:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626779648:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143781.132880:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1895 committed 00000004:00080000:2.0:1746143781.132882:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1861 committed 00000004:00080000:2.0:1746143781.132883:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1894 committed 00000004:00080000:2.0:1746143781.132885:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1860 committed 00000004:00080000:2.0:1746143781.132898:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1893 committed 00000004:00080000:2.0:1746143781.132899:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1859 committed 00000004:00080000:2.0:1746143781.132900:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1858 committed 00000004:00080000:2.0:1746143781.132901:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1857 committed 00000004:00080000:2.0:1746143781.132903:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1892 committed 00000004:00080000:2.0:1746143781.132904:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1891 committed 00000004:00080000:2.0:1746143781.132906:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1856 committed 00000004:00080000:2.0:1746143781.132907:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1855 committed 00000004:00080000:2.0:1746143781.132925:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1890 committed 00000001:00080000:2.0:1746143781.132931:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943677 is committed 00000001:00080000:2.0:1746143781.132935:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943676 is committed 00000100:00100000:0.0:1746143781.132957:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.132980:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626780160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.132992:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.133007:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143781.133011:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626779264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.133022:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.133030:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626779776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.133042:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.133050:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143781.133055:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626780672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.133069:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.133078:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626780288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.133119:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626780800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.133145:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.133160:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746143781.133163:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626781184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.133179:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.133315:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626779648 00000100:00100000:2.0:1746143781.133325:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626779648 00000100:00100000:2.0:1746143781.133370:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626780160 00000100:00100000:2.0:1746143781.133372:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626780160 00000100:00100000:0.0:1746143781.133374:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.133741:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626779520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.133813:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626779392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.133835:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.133875:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626779776 00000100:00100000:2.0:1746143781.133875:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626779264 00000100:00100000:2.0:1746143781.133880:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626779264 00000100:00100000:3.0:1746143781.133881:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626779776 00000100:00100000:3.0:1746143781.133931:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626780672 00000100:00100000:3.0:1746143781.133935:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626780672 00000100:00100000:3.0:1746143781.133945:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626780800 00000100:00100000:3.0:1746143781.133946:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626780800 00000100:00100000:3.0:1746143781.133951:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626781184 00000100:00100000:3.0:1746143781.133953:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626781184 00000100:00100000:3.0:1746143781.133958:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626780288 00000100:00100000:3.0:1746143781.133960:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626780288 00000100:00100000:2.0:1746143781.133968:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12005 00000100:00100000:3.0:1746143781.133976:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12006 00000100:00100000:2.0:1746143781.133977:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3773:x1830963626779648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.133981:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3773:x1830963626780160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.134078:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12007 00000100:00100000:2.0:1746143781.134083:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3773:x1830963626779776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.134118:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963626780160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (1123us total) trans 17179873020 rc 0/0 00000100:00100000:3.0:1746143781.134123:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12006 00002000:00010000:2.0:1746143781.134135:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143781.134138:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:3.0:1746143781.134139:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12008 00002000:00010000:2.0:1746143781.134139:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143781.134141:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:3.0:1746143781.134143:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3773:x1830963626779264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143781.134143:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746143781.134190:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963626779776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (1146us total) trans 17179873022 rc 0/0 00000100:00100000:2.0:1746143781.134196:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12007 00000100:00100000:3.0:1746143781.134200:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963626779264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (1176us total) trans 17179873023 rc 0/0 00000100:00100000:3.0:1746143781.134206:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12008 00000100:00100000:2.0:1746143781.134214:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12009 00000100:00100000:3.0:1746143781.134219:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12010 00000100:00100000:2.0:1746143781.134220:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963626780672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.134224:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3774:x1830963626780800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.134274:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12011 00000100:00100000:3.0:1746143781.134277:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3774:x1830963626781184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.134294:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3773:x1830963626780672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1223us total) trans 21474840348 rc 0/0 00000100:00100000:2.0:1746143781.134299:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12009 00000100:00100000:2.0:1746143781.134308:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12012 00000100:00100000:2.0:1746143781.134313:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3773:x1830963626780288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.134365:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3773:x1830963626780288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (990us total) trans 21474840350 rc 0/0 00000100:00100000:2.0:1746143781.134370:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12012 00002000:00010000:2.0:1746143781.134406:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143781.134409:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143781.134411:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:2.0:1746143781.134413:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143781.134414:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143781.134415:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3774:x1830963626781184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (1234us total) trans 21474840351 rc 0/0 00000100:00100000:3.0:1746143781.134420:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12011 00000100:00100000:2.0:1746143781.134435:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3773:x1830963626779648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 461us (1478us total) trans 17179873021 rc 0/0 00000100:00100000:2.0:1746143781.134441:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12005 00000100:00100000:3.0:1746143781.134450:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3774:x1830963626780800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (1305us total) trans 21474840349 rc 0/0 00000100:00100000:3.0:1746143781.134454:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12010 00000004:00010000:3.0:1746143781.134489:0:14991:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800939a5180 reply state ffff88007f6b8000 transno 8589943678 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.134505:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.134517:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.134519:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746143781.134523:0:14991:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143781.134545:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.134550:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626779904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.134559:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626780032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.134569:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.134586:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.134590:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626780416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.134595:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626780544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.134605:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.134625:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626780928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.134638:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.134957:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626779392 00000100:00100000:1.0:1746143781.134963:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626779392 00000100:00100000:1.0:1746143781.134985:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626779520 00000100:00100000:1.0:1746143781.134987:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626779520 00000100:00100000:1.0:1746143781.134994:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626779904 00000100:00100000:1.0:1746143781.134995:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626779904 00000100:00100000:1.0:1746143781.135001:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626780032 00000100:00100000:1.0:1746143781.135002:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626780032 00000100:00100000:1.0:1746143781.135008:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626780416 00000100:00100000:1.0:1746143781.135010:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626780416 00000100:00100000:1.0:1746143781.135015:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626780928 00000100:00100000:1.0:1746143781.135017:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626780928 00000100:00100000:1.0:1746143781.135026:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12013 00000100:00100000:1.0:1746143781.135035:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963626779392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.135037:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12014 00000100:00100000:3.0:1746143781.135043:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3772:x1830963626779520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.135043:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12015 00000100:00100000:2.0:1746143781.135050:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963626779904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.135089:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12016 00000100:00100000:1.0:1746143781.135094:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3772:x1830963626780032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.135213:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963626779520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (666us total) trans 17179873025 rc 0/0 00000100:00100000:2.0:1746143781.135214:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3771:x1830963626779904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (642us total) trans 17179873026 rc 0/0 00000100:00100000:3.0:1746143781.135219:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12014 00000100:00100000:2.0:1746143781.135223:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12015 00000100:00100000:3.0:1746143781.135233:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12017 00000100:00100000:2.0:1746143781.135237:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12018 00000100:00100000:3.0:1746143781.135239:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963626780416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.135243:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963626780928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.135305:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3771:x1830963626780416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (697us total) trans 21474840352 rc 0/0 00000100:00100000:3.0:1746143781.135310:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12017 00000100:00100000:3.0:1746143781.135325:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.135339:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626781056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.135355:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143781.135388:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a5880/2, rc 0, transno 17179873025 00000100:00100000:3.0:1746143781.135393:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626779520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.135404:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626780544 00000100:00100000:3.0:1746143781.135407:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626780544 00000100:00100000:3.0:1746143781.135427:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626781056 00000100:00100000:3.0:1746143781.135428:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626781056 00000100:00100000:3.0:1746143781.135438:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12019 00000100:00100000:3.0:1746143781.135441:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963626780544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.135527:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3772:x1830963626780544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (201us total) trans 21474840354 rc 0/0 00000100:00100000:3.0:1746143781.135532:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12019 00000100:00100000:1.0:1746143781.135537:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3772:x1830963626780032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 442us (949us total) trans 17179873027 rc 0/0 00000100:00100000:2.0:1746143781.135538:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3771:x1830963626780928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 295us (898us total) trans 21474840353 rc 0/0 00000100:00100000:1.0:1746143781.135544:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12016 00000100:00100000:3.0:1746143781.135547:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12020 00000100:00100000:3.0:1746143781.135552:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963626781056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.135556:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12018 00000004:00080000:1.0:1746143781.135575:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f64b480/2, rc 0, transno 21474840351 00000100:00100000:1.0:1746143781.135584:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626781184:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.135591:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f64aa00/2, rc 0, transno 21474840349 00002000:00010000:3.0:1746143781.135595:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00000100:00100000:1.0:1746143781.135595:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626780800:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143781.135598:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143781.135600:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143781.135602:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143781.135604:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143781.135623:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963626781056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (266us total) trans 21474840355 rc 0/0 00000100:00100000:3.0:1746143781.135628:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12020 00000100:00100000:1.0:1746143781.135635:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963626779392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 604us (1799us total) trans 17179873024 rc 0/0 00000100:00100000:1.0:1746143781.135639:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12013 00000004:00080000:3.0:1746143781.135648:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092144e00/2, rc 0, transno 17179873027 00000100:00100000:3.0:1746143781.135651:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626780032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.135656:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626781312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143781.135660:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f648000/2, rc 0, transno 21474840354 00000100:00100000:3.0:1746143781.135663:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626780544:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143781.135670:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f649500/2, rc 0, transno 21474840355 00000100:00100000:3.0:1746143781.135673:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626781056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.135682:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.135701:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626781312 00000100:00100000:1.0:1746143781.135704:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626781312 00000100:00100000:1.0:1746143781.135717:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12021 00000100:00100000:1.0:1746143781.135721:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963626781312:12345-0@lo:2:osp-syn-0-0.0 00010000:00080000:3.0:1746143781.135744:0:14991:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143781.135756:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32275:x1830963622613376:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 10453us (10652us total) trans 8589943678 rc 0/0 00000100:00100000:3.0:1746143781.135766:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12913 00000100:00100000:1.0:1746143781.135780:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963626781312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (96us total) trans 21474840356 rc 0/0 00000100:00100000:1.0:1746143781.135785:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12021 00010000:00010000:3.0:1746143781.135790:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.135798:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00000004:00080000:1.0:1746143781.135800:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f649880/2, rc 0, transno 21474840356 00000100:00100000:1.0:1746143781.135803:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626781312:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143781.135804:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.135811:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d7d600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143781.135815:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.135822:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.135833:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.135836:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143781.135839:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.135844:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d600/0x87925e4cb73a995d lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00000004:00080000:1.0:1746143781.136131:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f648700/2, rc 0, transno 21474840348 00000100:00100000:1.0:1746143781.136134:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626780672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143781.136151:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f64bb80/2, rc 0, transno 21474840353 00000100:00100000:0.0:1746143781.136154:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626780928:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143781.136165:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a5500/2, rc 0, transno 17179873024 00000100:00100000:0.0:1746143781.136168:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626779392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143781.136175:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092146a00/2, rc 0, transno 17179873026 00000100:00100000:0.0:1746143781.136177:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626779904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143781.136184:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f648a80/2, rc 0, transno 21474840352 00000100:00100000:0.0:1746143781.136186:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626780416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.136265:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f64ad80/2, rc 0, transno 21474840350 00000100:00100000:1.0:1746143781.136268:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626780288:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.136278:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a6300/2, rc 0, transno 17179873023 00000100:00100000:1.0:1746143781.136280:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626779264:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.136289:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a4380/2, rc 0, transno 17179873022 00000100:00100000:1.0:1746143781.136291:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626779776:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.136299:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a7800/2, rc 0, transno 17179873021 00000100:00100000:1.0:1746143781.136301:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626779648:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.136307:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092147b80/2, rc 0, transno 17179873020 00000100:00100000:1.0:1746143781.136310:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626780160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.137602:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.137736:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622614912 00000100:00100000:3.0:1746143781.137744:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622614912 00000100:00100000:3.0:1746143781.137834:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12914 00000100:00100000:3.0:1746143781.137842:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32275:x1830963622614912:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143781.137867:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.137885:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73a9964 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b499 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.137977:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73a9964 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b499 expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.137991:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73a9964 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b499 expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.138010:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.138013:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143781.138016:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53200, rc 0) 00000100:00100000:3.0:1746143781.138134:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32275:x1830963622614912:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 292us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.138143:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12914 00000100:00100000:0.0:1746143781.143140:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.143205:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622615040 00000100:00100000:3.0:1746143781.143216:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622615040 00000100:00100000:3.0:1746143781.143267:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12915 00000100:00100000:3.0:1746143781.143274:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32275:x1830963622615040:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143781.143290:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.143305:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73a996b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4a0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.143370:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52a00/0x87925e4cb73a9972 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.143382:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52a00/0x87925e4cb73a9972 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.143391:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52a00/0x87925e4cb73a9972 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143781.143420:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:3.0:1746143781.143424:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143781.143435:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52a00/0x87925e4cb73a9972 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.143455:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73a996b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a0 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.143467:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52a00/0x87925e4cb73a9972 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a0 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.143474:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.143476:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143781.143478:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52a00, rc 0) 00000100:00100000:3.0:1746143781.143524:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32275:x1830963622615040:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 251us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.143530:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12915 00000100:00100000:0.0:1746143781.145720:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.145753:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.145786:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.145815:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.145828:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.145857:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.145943:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622615168 00000100:00100000:1.0:1746143781.145954:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622615168 00000100:00100000:1.0:1746143781.145996:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622615424 00000100:00100000:1.0:1746143781.145998:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622615424 00000100:00100000:1.0:1746143781.146010:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622615680 00000100:00100000:1.0:1746143781.146012:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622615680 00000100:00100000:1.0:1746143781.146022:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622615296 00000100:00100000:1.0:1746143781.146023:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622615296 00000100:00100000:1.0:1746143781.146032:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622615552 00000100:00100000:1.0:1746143781.146033:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622615552 00000100:00100000:1.0:1746143781.146043:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622615808 00000100:00100000:1.0:1746143781.146044:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622615808 00000100:00100000:1.0:1746143781.146056:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12022 00000100:00100000:1.0:1746143781.146064:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622615168:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143781.146081:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.146101:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a9979 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4a7 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143781.146124:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a23, atime: 0x68140a22, ctime: 0x68140a23, blocks: 0x7d8 00010000:00010000:1.0:1746143781.146145:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146147:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146156:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a9979 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a7 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146171:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a9979 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a7 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146182:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551200, rc 0) 00000100:00100000:1.0:1746143781.146221:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622615168:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 158us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.146227:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12022 00000100:00100000:1.0:1746143781.146242:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12023 00000100:00100000:1.0:1746143781.146247:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622615424:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143781.146255:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.146265:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73a9980 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4b5 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143781.146278:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a24, atime: 0x68140a24, ctime: 0x68140a24, blocks: 0x800 00010000:00010000:1.0:1746143781.146286:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146287:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146291:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73a9980 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4b5 expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146301:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73a9980 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4b5 expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146308:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551800, rc 0) 00000100:00100000:1.0:1746143781.146322:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622615424:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 75us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.146326:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12023 00000100:00100000:1.0:1746143781.146335:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12024 00000100:00100000:1.0:1746143781.146339:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622615680:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143781.146345:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.146352:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a9987 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4c3 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143781.146361:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4964768, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x15f0 00010000:00010000:1.0:1746143781.146369:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146370:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146373:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a9987 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4c3 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146381:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a9987 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4c3 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146387:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550600, rc 0) 00000100:00100000:1.0:1746143781.146400:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622615680:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 60us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.146407:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12024 00000100:00100000:1.0:1746143781.146416:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12025 00000100:00100000:1.0:1746143781.146420:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622615296:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143781.146425:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.146432:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a998e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4ae expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143781.146441:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a24, atime: 0x68140a22, ctime: 0x68140a24, blocks: 0x808 00010000:00010000:1.0:1746143781.146449:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146450:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146453:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a998e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ae expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146461:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a998e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ae expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146472:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551600, rc 0) 00000100:00100000:1.0:1746143781.146487:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622615296:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 66us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.146491:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12025 00000100:00100000:1.0:1746143781.146499:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12026 00000100:00100000:1.0:1746143781.146503:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622615552:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143781.146508:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.146514:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a9995 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4bc expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143781.146523:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a25, atime: 0x68140a24, ctime: 0x68140a25, blocks: 0x808 00010000:00010000:1.0:1746143781.146530:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146531:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146534:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a9995 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4bc expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146542:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a9995 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4bc expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146548:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550000, rc 0) 00000100:00100000:1.0:1746143781.146562:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622615552:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 58us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.146566:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12026 00000100:00100000:1.0:1746143781.146575:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12027 00000100:00100000:1.0:1746143781.146579:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622615808:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143781.146585:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.146591:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a999c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4ca expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143781.146600:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a25, atime: 0x68140a24, ctime: 0x68140a24, blocks: 0x1008 00010000:00010000:1.0:1746143781.146605:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146607:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.146610:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a999c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ca expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146617:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a999c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ca expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.146623:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550e00, rc 0) 00000100:00100000:1.0:1746143781.146635:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622615808:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 55us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.146639:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12027 00000100:00100000:0.0:1746143781.151827:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.153197:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.153230:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.153245:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.153258:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.153287:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.153364:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622615936 00000100:00100000:2.0:1746143781.153376:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622615936 00000100:00100000:3.0:1746143781.153397:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622616064 00000100:00100000:3.0:1746143781.153411:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622616064 00000100:00100000:2.0:1746143781.153422:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622616192 00000100:00100000:2.0:1746143781.153424:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622616192 00000100:00100000:3.0:1746143781.153452:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622616320 00000100:00100000:3.0:1746143781.153454:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622616320 00000100:00100000:3.0:1746143781.153467:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622616448 00000100:00100000:3.0:1746143781.153468:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622616448 00000100:00100000:2.0:1746143781.153477:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622616576 00000100:00100000:2.0:1746143781.153480:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622616576 00000100:00100000:3.0:1746143781.153487:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12028 00000100:00100000:3.0:1746143781.153495:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622615936:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143781.153636:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622615936:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 141us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.153799:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12029 00000100:00100000:2.0:1746143781.153807:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963622616064:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143781.153842:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12030 00000100:00100000:1.0:1746143781.153855:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622616320:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143781.153960:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622616320:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 110us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.153967:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12030 00000100:00100000:1.0:1746143781.153985:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12031 00000100:00100000:1.0:1746143781.153989:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963622616192:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143781.154071:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963622616064:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 265us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.154077:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12029 00000100:00100000:2.0:1746143781.154087:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12032 00000100:00100000:2.0:1746143781.154091:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622616448:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143781.154118:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622616448:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 26us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.154123:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12032 00000100:00100000:2.0:1746143781.154132:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12033 00000100:00100000:2.0:1746143781.154136:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622616576:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143781.154163:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622616576:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 26us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.154167:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12033 00000100:00100000:1.0:1746143781.154261:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622616192:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 271us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.154267:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12031 00000100:00100000:3.0:1746143781.154612:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12028 00000100:00100000:0.0:1746143781.158260:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.158421:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.158762:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622616832 00000100:00100000:0.0:1746143781.158765:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.158772:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622616832 00000100:00100000:3.0:1746143781.158872:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622617088 00000100:00100000:3.0:1746143781.158874:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622617088 00000100:00100000:2.0:1746143781.158906:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622617344 00000100:00100000:2.0:1746143781.158924:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622617344 00000100:00100000:3.0:1746143781.158927:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12034 00000100:00100000:3.0:1746143781.158934:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622616832:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143781.158946:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12035 00000100:00100000:2.0:1746143781.158950:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622617088:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143781.159035:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622616832:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 101us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.159035:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622617088:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 83us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.159041:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12035 00000100:00100000:3.0:1746143781.159043:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12034 00000100:00100000:2.0:1746143781.159056:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12036 00000100:00100000:2.0:1746143781.159060:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622617344:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143781.159090:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622617344:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 30us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.159095:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12036 00000100:00100000:0.0:1746143781.159152:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.159167:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622616704 00000100:00100000:1.0:1746143781.159170:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622616704 00000100:00100000:1.0:1746143781.159199:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12037 00000100:00100000:1.0:1746143781.159204:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622616704:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143781.159279:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.159340:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622616704:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 135us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.159345:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12037 00000100:00100000:1.0:1746143781.159470:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622616960 00000100:00100000:1.0:1746143781.159473:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622616960 00000100:00100000:1.0:1746143781.159526:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12038 00000100:00100000:1.0:1746143781.159531:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622616960:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143781.159572:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622616960:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 40us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.159577:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12038 00000100:00100000:0.0:1746143781.159642:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.159759:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622617216 00000100:00100000:3.0:1746143781.159762:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622617216 00000100:00100000:3.0:1746143781.159793:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12039 00000100:00100000:3.0:1746143781.159798:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622617216:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143781.159839:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622617216:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 40us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.159844:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12039 00000100:00100000:0.0:1746143781.162328:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.162417:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622617472 00000100:00100000:1.0:1746143781.162426:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622617472 00000100:00100000:1.0:1746143781.162524:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12040 00000100:00100000:1.0:1746143781.162533:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622617472:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:1.0:1746143781.162746:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143781.162750:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143781.162752:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:1.0:1746143781.162754:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143781.162756:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143781.163525:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2008:x1830963622617472:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 989us (1201us total) trans 17179873028 rc 0/0 00000100:00100000:1.0:1746143781.163533:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12040 00000100:00100000:0.0:1746143781.165750:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.166092:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622617600 00000100:00100000:1.0:1746143781.166102:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622617600 00000100:00100000:1.0:1746143781.166447:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12041 00000100:00100000:1.0:1746143781.166463:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622617600:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:1.0:1746143781.166646:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143781.166650:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143781.166652:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143781.166654:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143781.166655:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143781.166870:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622617600:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 259us (974us total) trans 21474840357 rc 0/0 00000100:00100000:1.0:1746143781.166877:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12041 00000100:00100000:0.0:1746143781.171792:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.173162:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622617856 00000100:00100000:3.0:1746143781.173176:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622617856 00000100:00100000:3.0:1746143781.173259:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3509 00000100:00100000:3.0:1746143781.173268:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622617856:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143781.173307:0:20387:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a99a3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.173323:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.173325:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.173330:0:20387:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a99a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.173360:0:20387:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a99a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.175405:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.178439:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.178482:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.178509:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.178523:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.178547:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.178594:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622618112 00000100:00100000:2.0:1746143781.178606:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622618112 00000100:00100000:1.0:1746143781.179632:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622618496 00000100:00100000:1.0:1746143781.179641:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622618496 00000100:00100000:2.0:1746143781.182344:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622618624 00000100:00100000:2.0:1746143781.182394:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622618624 00000100:00100000:3.0:1746143781.182978:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622618880 00000100:00100000:3.0:1746143781.182984:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622618880 00000100:00100000:3.0:1746143781.183021:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622619136 00000100:00100000:3.0:1746143781.183024:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622619136 00000100:00100000:3.0:1746143781.183046:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622619392 00000100:00100000:3.0:1746143781.183048:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622619392 00000100:00100000:3.0:1746143781.183072:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3510 00000100:00100000:3.0:1746143781.183081:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622618112:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143781.183125:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a99aa lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.183141:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.183143:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.183149:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a99aa lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.183163:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a99aa lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.183975:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3511 00000100:00100000:3.0:1746143781.183984:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622618496:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143781.184004:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a99b1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.184016:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.184017:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.184020:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a99b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.184028:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a99b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.184099:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3512 00000100:00100000:1.0:1746143781.184107:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622618624:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143781.184123:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a99b8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.184129:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.184130:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.184133:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a99b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.184140:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a99b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.184679:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3513 00000100:00100000:3.0:1746143781.184687:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2009:x1830963622618880:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143781.184704:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a99bf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.184710:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.184711:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.184714:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a99bf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.184721:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a99bf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.184793:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3514 00000100:00100000:1.0:1746143781.184798:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2008:x1830963622619136:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143781.184814:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093973c00/0x87925e4cb73a99c6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.184821:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.184822:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.184825:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093973c00/0x87925e4cb73a99c6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.184832:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093973c00/0x87925e4cb73a99c6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.185122:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3515 00000100:00100000:0.0:1746143781.185132:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2009:x1830963622619392:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143781.185148:0:29555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a99cd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.185156:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.185158:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.185161:0:29555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a99cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.185169:0:29555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a99cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.187513:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.187631:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622619648 00000100:00100000:1.0:1746143781.187641:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622619648 00000100:00100000:1.0:1746143781.187698:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3516 00000100:00100000:1.0:1746143781.187706:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+21:2009:x1830963622619648:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143781.187723:0:20387:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a99a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.187736:0:20387:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a99a3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.187738:0:29557:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a99d4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.187748:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.187749:0:20387:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a99a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.187750:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.187755:0:29557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a99d4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.187756:0:20387:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a52c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143781.187761:0:20387:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a99a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.187767:0:29557:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a99d4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.187770:0:20387:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a99a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.187786:0:20387:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a99a3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.187791:0:20387:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a99a3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.187849:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2008:x1830963622617856:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 14582us (16069us total) trans 0 rc 1024000/1024000 00000100:00100000:2.0:1746143781.187857:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3509 00010000:00010000:3.0:1746143781.195204:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a99aa lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.195225:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a99aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.195234:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a99aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.195242:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143781.195247:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a99aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.195254:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a99aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.195276:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a99aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.195283:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75000/0x87925e4cb73a99aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.195382:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+21:2009:x1830963622618112:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 12295us (19978us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143781.195392:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3510 00010000:00010000:3.0:1746143781.199062:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a99b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.199078:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a99b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.199086:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a99b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.199093:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143781.199097:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a99b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.199106:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a99b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.199125:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a99b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.199131:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73a99b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.199202:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2008:x1830963622618496:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 15215us (20770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143781.199212:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3511 00010000:00010000:1.0:1746143781.199774:0:13453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a99b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.199784:0:13453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a99b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.199789:0:13453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a99b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.199794:0:13453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143781.199797:0:13453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a99b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.199803:0:13453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a99b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.199813:0:13453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a99b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.199817:0:13453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73a99b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.200127:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622618624:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 16020us (21643us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.200134:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3512 00010000:00010000:3.0:1746143781.203344:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a99bf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.203360:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a99bf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.203367:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a99bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.203373:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d467400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143781.203377:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a99bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.203385:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a99bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.203404:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a99bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.203409:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467400/0x87925e4cb73a99bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.204784:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963622618880:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 20085us (26261us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143781.204799:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3513 00010000:00010000:2.0:1746143781.207340:0:29555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a99cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.207356:0:29555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a99cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.207363:0:29555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a99cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.207370:0:29555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143781.207373:0:29555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a99cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.207381:0:29555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a99cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.207400:0:29555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a99cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.207406:0:29555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73a99cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.207501:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622619392:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 22365us (28946us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143781.207510:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3515 00010000:00010000:1.0:1746143781.208658:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093973c00/0x87925e4cb73a99c6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.208667:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093973c00/0x87925e4cb73a99c6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.208672:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093973c00/0x87925e4cb73a99c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.208677:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093973c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143781.208679:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093973c00/0x87925e4cb73a99c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.208686:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093973c00/0x87925e4cb73a99c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.208700:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093973c00/0x87925e4cb73a99c6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.208706:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093973c00/0x87925e4cb73a99c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.208959:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622619136:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 24157us (30432us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.208968:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3514 00010000:00010000:1.0:1746143781.210317:0:29557:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a99d4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.210328:0:29557:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a99d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.210340:0:29557:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a99d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.210345:0:29557:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082087600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143781.210348:0:29557:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a99d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.210354:0:29557:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a99d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.210368:0:29557:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a99d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.210373:0:29557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082087600/0x87925e4cb73a99d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.210420:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622619648:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 22713us (22915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.210429:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3516 00000100:00100000:0.0:1746143781.215228:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.215364:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622619904 00000100:00100000:3.0:1746143781.215374:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622619904 00000100:00100000:3.0:1746143781.215439:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12916 00000100:00100000:3.0:1746143781.215447:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32275:x1830963622619904:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1746143781.215500:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.215528:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52a00/0x87925e4cb73a9972 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a0 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.215547:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.215551:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143781.215598:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.215609:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.215617:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00010000:3.0:1746143781.215715:0:14991:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b7aaa00 reply state ffff880090e3f000 transno 8589943679 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.215723:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.215728:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.215730:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746143781.215732:0:14991:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143781.215796:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32275:x1830963622619904:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 351us (580us total) trans 8589943679 rc 0/0 00000100:00100000:3.0:1746143781.215802:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12916 00000100:00100000:0.0:1746143781.218949:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.219152:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622620032 00000100:00100000:1.0:1746143781.219162:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622620032 00000100:00100000:1.0:1746143781.219222:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12042 00000100:00100000:0.0:1746143781.219222:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.219232:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622620032:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:0.0:1746143781.219251:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.219268:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.219283:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.219303:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.219379:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622620160 00000100:00100000:3.0:1746143781.219384:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622620160 00000100:00100000:3.0:1746143781.219404:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622620288 00000100:00100000:3.0:1746143781.219405:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622620288 00000100:00100000:3.0:1746143781.219415:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622620416 00000100:00100000:3.0:1746143781.219417:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622620416 00000100:00100000:3.0:1746143781.219426:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622620544 00000100:00100000:3.0:1746143781.219428:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622620544 00000100:00100000:3.0:1746143781.219436:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622620672 00000100:00100000:3.0:1746143781.219443:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622620672 00000100:00100000:2.0:1746143781.219478:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12043 00000100:00100000:2.0:1746143781.219489:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622620160:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:3.0:1746143781.219530:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12044 00000100:00100000:3.0:1746143781.219536:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622620288:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143781.219583:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143781.219586:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143780 -> 1746143781 00002000:00010000:2.0:1746143781.219588:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143778 -> 1746143781 00002000:00010000:3.0:1746143781.219589:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143781.219590:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143780 -> 1746143781 00002000:00010000:3.0:1746143781.219591:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143780 -> 1746143781 00002000:00010000:2.0:1746143781.219592:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:3.0:1746143781.219593:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143780 -> 1746143781 00002000:00010000:3.0:1746143781.219595:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143780 -> 1746143781 00002000:00010000:3.0:1746143781.219597:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746143781.219655:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2011:x1830963622620160:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 168us (433us total) trans 17179873029 rc 0/0 00000100:00100000:2.0:1746143781.219661:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12043 00002000:00010000:1.0:1746143781.219661:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143781.219663:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143779 -> 1746143781 00002000:00010000:1.0:1746143781.219665:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143778 -> 1746143781 00002000:00010000:1.0:1746143781.219667:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143779 -> 1746143781 00002000:00010000:1.0:1746143781.219668:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:2.0:1746143781.219679:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12045 00000100:00100000:2.0:1746143781.219685:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622620416:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:3.0:1746143781.219779:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2011:x1830963622620288:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 242us (527us total) trans 17179873030 rc 0/0 00000100:00100000:3.0:1746143781.219785:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12044 00000100:00100000:3.0:1746143781.219798:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12046 00000100:00100000:3.0:1746143781.219803:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622620544:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:3.0:1746143781.219846:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:3.0:1746143781.219849:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.219850:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.219852:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.219854:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00002000:00010000:2.0:1746143781.219873:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746143781.219875:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2011:x1830963622620544:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 71us (590us total) trans 21474840359 rc 0/0 00002000:00010000:2.0:1746143781.219876:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.219878:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143780 -> 1746143781 00000100:00100000:3.0:1746143781.219880:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12046 00002000:00010000:2.0:1746143781.219880:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.219881:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143781.219902:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12047 00000100:00100000:3.0:1746143781.219907:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622620672:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:2.0:1746143781.219948:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2011:x1830963622620416:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 252us (667us total) trans 21474840360 rc 0/0 00000100:00100000:2.0:1746143781.219954:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12045 00000100:00100000:1.0:1746143781.220153:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622620032:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 922us (1246us total) trans 21474840358 rc 0/0 00000100:00100000:1.0:1746143781.220160:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12042 00002000:00010000:3.0:1746143781.220209:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143781.220211:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.220213:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143780 -> 1746143781 00002000:00010000:3.0:1746143781.220215:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143780 -> 1746143781 00002000:00010000:3.0:1746143781.220216:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746143781.220231:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2011:x1830963622620672:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 324us (928us total) trans 17179873031 rc 0/0 00000100:00100000:3.0:1746143781.220236:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12047 00000100:00100000:0.0:1746143781.223133:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.223203:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622620928 00000100:00100000:3.0:1746143781.223213:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622620928 00000100:00100000:3.0:1746143781.223264:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4742 00000100:00100000:3.0:1746143781.223272:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e248050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32275:x1830963622620928:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:3.0:1746143781.223336:0:7247:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x34a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a9925 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b492 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.223381:0:7247:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143781.223392:0:7247:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73a9964 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b499 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.223399:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143781.223432:0:7247:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73a9964 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b499 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.223444:0:7247:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73a9964 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b499 expref: 10 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.223457:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830963626781440:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.223553:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e5610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.227105:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.227188:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622621056 00000100:00100000:3.0:1746143781.227192:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830963626781440:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.227194:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622621056 00010000:00010000:3.0:1746143781.227222:0:7247:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143781.227228:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73a9964 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b499 expref: 11 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.227266:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5703 00000100:00100000:1.0:1746143781.227274:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622621056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.227287:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.227294:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73a9964 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b499 expref: 11 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.227538:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73a9964 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b499 expref: 11 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.227563:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73a9964 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b499 expref: 11 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.227580:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.227584:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143781.227592:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143781.227601:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143781.227631:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.227674:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622621056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 400us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.227681:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5703 00010000:00010000:3.0:1746143781.227779:0:7247:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143781.227793:0:7247:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000040:00080000:3.0:1746143781.228063:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2672, 88 off222856 00000004:00080000:3.0:1746143781.228069:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840452156443ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.228102:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2633, 88 off219768 00000004:00080000:3.0:1746143781.228106:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840452193585ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.228134:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2634, 88 off219856 00000004:00080000:3.0:1746143781.228137:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840452225290ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.228153:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2673, 88 off222944 00000004:00080000:3.0:1746143781.228156:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840452243711ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.228166:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2674, 88 off223032 00000004:00080000:3.0:1746143781.228169:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840452256943ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.228179:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2635, 88 off219944 00000004:00080000:3.0:1746143781.228181:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840452268656ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.228187:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2636, 88 off220032 00000004:00080000:3.0:1746143781.228192:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840452279466ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.228199:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2637, 88 off220120 00000004:00080000:3.0:1746143781.228201:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840452289296ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.228208:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2675, 88 off223120 00000004:00080000:3.0:1746143781.228211:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840452298574ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.228221:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2638, 88 off220208 00000004:00080000:3.0:1746143781.228224:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840452311694ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.228233:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2676, 88 off223208 00000004:00080000:3.0:1746143781.228235:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840452323106ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.228244:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2639, 88 off220296 00000004:00080000:3.0:1746143781.228246:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840452334216ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143781.228255:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2677, 88 off223296 00000004:00080000:3.0:1746143781.228257:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840452345118ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.228266:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2678, 88 off223384 00000004:00080000:3.0:1746143781.228269:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840452356541ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.228278:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2679, 88 off223472 00000004:00080000:3.0:1746143781.228281:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840452368713ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.228290:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2680, 88 off223560 00000004:00080000:3.0:1746143781.228293:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840452381294ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143781.228303:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2640, 88 off220384 00000004:00080000:3.0:1746143781.228306:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840452393586ns, next at 770855090093ns, rc = 0 00000001:00080000:2.0:1746143781.230590:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943680 is committed 00000004:00080000:2.0:1746143781.230600:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1870 committed 00000004:00080000:2.0:1746143781.230605:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1907 committed 00000004:00080000:2.0:1746143781.230611:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1906 committed 00000004:00080000:2.0:1746143781.230612:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1905 committed 00000004:00080000:2.0:1746143781.230613:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1904 committed 00000004:00080000:2.0:1746143781.230614:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1869 committed 00000004:00080000:2.0:1746143781.230616:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1903 committed 00000004:00080000:2.0:1746143781.230616:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1868 committed 00000004:00080000:2.0:1746143781.230618:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1902 committed 00000004:00080000:2.0:1746143781.230619:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1867 committed 00000004:00080000:2.0:1746143781.230620:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1866 committed 00000004:00080000:2.0:1746143781.230621:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1865 committed 00000004:00080000:2.0:1746143781.230623:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1901 committed 00000004:00080000:2.0:1746143781.230624:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1900 committed 00000004:00080000:2.0:1746143781.230625:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1864 committed 00000004:00080000:2.0:1746143781.230626:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1863 committed 00000004:00080000:2.0:1746143781.230627:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1899 committed 00000100:00100000:1.0:1746143781.230747:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626781568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.230763:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626781696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.230816:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.230857:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626782080:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143781.230863:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.230872:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143781.230874:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143781.230878:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.230883:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f635e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143781.230896:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.230901:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.230931:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00000100:00100000:1.0:1746143781.230931:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626781824:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143781.230934:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143781.230936:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.230942:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99db lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143781.230949:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.230963:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626782336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.230970:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626781568 00000100:00100000:3.0:1746143781.230975:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626781568 00000100:00100000:1.0:1746143781.230976:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.230990:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143781.230995:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626781952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.231002:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626782080 00000100:00100000:3.0:1746143781.231005:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626782080 00000100:00100000:1.0:1746143781.231014:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.231015:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626781824 00000100:00100000:3.0:1746143781.231017:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626781824 00000100:00100000:1.0:1746143781.231027:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626782464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.231028:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626782336 00000100:00100000:3.0:1746143781.231029:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626782336 00000100:00100000:3.0:1746143781.231039:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626781952 00000100:00100000:3.0:1746143781.231040:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626781952 00000100:00100000:1.0:1746143781.231040:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.231052:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626782464 00000100:00100000:3.0:1746143781.231054:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626782464 00000100:00100000:3.0:1746143781.231067:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12048 00000100:00100000:3.0:1746143781.231073:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963626781568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.231074:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12049 00000100:00100000:1.0:1746143781.231083:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963626782080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143781.231168:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143781.231171:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.231173:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.231175:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.231177:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:1.0:1746143781.231202:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3771:x1830963626782080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (325us total) trans 21474840362 rc 0/0 00000100:00100000:1.0:1746143781.231208:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12049 00000100:00100000:3.0:1746143781.231212:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3771:x1830963626781568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (396us total) trans 21474840361 rc 0/0 00000100:00100000:3.0:1746143781.231219:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12048 00000100:00100000:1.0:1746143781.231228:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12050 00000100:00100000:1.0:1746143781.231233:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3773:x1830963626781824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.231235:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12051 00000100:00100000:3.0:1746143781.231240:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3773:x1830963626782336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143781.231278:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:3.0:1746143781.231280:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143781.231281:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.231282:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143781.231284:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143781.231284:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.231286:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143781.231286:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143781.231287:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00002000:00010000:3.0:1746143781.231288:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143781.231315:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3773:x1830963626781824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (365us total) trans 21474840363 rc 0/0 00000100:00100000:3.0:1746143781.231316:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3773:x1830963626782336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (339us total) trans 21474840364 rc 0/0 00000100:00100000:1.0:1746143781.231320:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12050 00000100:00100000:3.0:1746143781.231330:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12051 00000100:00100000:1.0:1746143781.231335:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12052 00000100:00100000:1.0:1746143781.231340:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3773:x1830963626781952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.231342:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12053 00000100:00100000:3.0:1746143781.231347:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3773:x1830963626782464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.231393:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3773:x1830963626781952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (377us total) trans 21474840365 rc 0/0 00000100:00100000:1.0:1746143781.231398:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12052 00000100:00100000:3.0:1746143781.231404:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3773:x1830963626782464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (362us total) trans 21474840366 rc 0/0 00000100:00100000:3.0:1746143781.231410:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12053 00000004:00080000:1.0:1746143781.231434:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921ced80/2, rc 0, transno 21474840365 00000100:00100000:1.0:1746143781.231442:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626781952:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.231450:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cd880/2, rc 0, transno 21474840366 00000100:00100000:1.0:1746143781.231453:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626782464:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.231459:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cf480/2, rc 0, transno 21474840363 00000004:00010000:3.0:1746143781.231461:0:7247:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e248050 reply state ffff880082177000 transno 8589943680 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746143781.231462:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626781824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.231468:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cf100/2, rc 0, transno 21474840364 00010000:00010000:3.0:1746143781.231471:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746143781.231471:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626782336:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143781.231477:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.231479:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746143781.231482:0:7247:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746143781.231486:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.231487:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143781.231492:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5acc00/0x87925e4cb73a9925 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b492 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.231507:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626782592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.231525:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.231632:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626782976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.231769:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626782592 00000100:00100000:2.0:1746143781.231773:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626782592 00000100:00100000:2.0:1746143781.231790:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12054 00000100:00100000:2.0:1746143781.231794:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3771:x1830963626782592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.231950:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.231970:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626783488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.231991:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.232007:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143781.232011:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626782848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.232024:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.232034:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626783360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.232044:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.232060:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626782976 00000100:00100000:0.0:1746143781.232063:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626782976 00000100:00100000:0.0:1746143781.232081:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626783488 00000100:00100000:0.0:1746143781.232083:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626783488 00000100:00100000:0.0:1746143781.232090:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626782848 00000100:00100000:0.0:1746143781.232091:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626782848 00000100:00100000:0.0:1746143781.232098:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12055 00000100:00100000:0.0:1746143781.232102:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3774:x1830963626782976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143781.232155:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143781.232159:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.232161:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.232162:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.232164:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143781.232185:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963626782976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (238us total) trans 17179873032 rc 0/0 00000100:00100000:0.0:1746143781.232190:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12055 00000100:00100000:0.0:1746143781.232199:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626783360 00000100:00100000:0.0:1746143781.232201:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626783360 00000100:00100000:0.0:1746143781.232209:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12056 00000100:00100000:0.0:1746143781.232212:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963626783488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.232262:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963626783488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (270us total) trans 17179873033 rc 0/0 00000100:00100000:0.0:1746143781.232266:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12056 00000100:00100000:0.0:1746143781.232273:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12057 00000100:00100000:0.0:1746143781.232277:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963626782848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.232336:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3771:x1830963626782592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 541us (810us total) trans 21474840367 rc 0/0 00000100:00100000:2.0:1746143781.232341:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12054 00000100:00100000:2.0:1746143781.232351:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12058 00000100:00100000:2.0:1746143781.232355:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963626783360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.232403:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963626783360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (357us total) trans 17179873034 rc 0/0 00000100:00100000:2.0:1746143781.232407:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12058 00000100:00100000:2.0:1746143781.232427:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143781.232430:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919e6d80/2, rc 0, transno 21474840367 00000100:00100000:1.0:1746143781.232435:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626782592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.232444:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626782208:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.232445:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cc380/2, rc 0, transno 21474840362 00000100:00100000:1.0:1746143781.232448:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626782080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.232457:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f649180/2, rc 0, transno 21474840361 00000100:00100000:1.0:1746143781.232460:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626781568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.232461:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.232470:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626783104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.232473:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626782720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.232496:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626781696 00000100:00100000:1.0:1746143781.232496:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.232499:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626781696 00000100:00100000:2.0:1746143781.232509:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626782208 00000100:00100000:2.0:1746143781.232510:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626782208 00000100:00100000:2.0:1746143781.232515:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626783104 00000100:00100000:2.0:1746143781.232517:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626783104 00000100:00100000:1.0:1746143781.232519:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626783616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.232524:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12059 00000100:00100000:2.0:1746143781.232527:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3772:x1830963626781696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.232535:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.232554:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626783616 00000100:00100000:1.0:1746143781.232559:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626783616 00002000:00010000:2.0:1746143781.232560:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143781.232562:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.232564:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.232565:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.232567:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143781.232580:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12060 00000100:00100000:2.0:1746143781.232585:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3772:x1830963626781696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (156us total) trans 21474840368 rc 0/0 00000100:00100000:2.0:1746143781.232590:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12059 00000100:00100000:2.0:1746143781.232599:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12061 00000100:00100000:2.0:1746143781.232603:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3771:x1830963626783104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143781.232637:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143781.232640:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143781.232641:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:2.0:1746143781.232643:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143781.232645:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:2.0:1746143781.232665:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3771:x1830963626783104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (169us total) trans 17179873035 rc 0/0 00000100:00100000:1.0:1746143781.232668:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3772:x1830963626782208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.232669:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12061 00000100:00100000:2.0:1746143781.232678:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12062 00000100:00100000:2.0:1746143781.232688:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3771:x1830963626783616:12345-0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746143781.232715:0:7247:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143781.232726:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e248050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32275:x1830963622620928:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 9453us (9602us total) trans 8589943680 rc 0/0 00000100:00100000:3.0:1746143781.232733:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4742 00000100:00100000:2.0:1746143781.232735:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3771:x1830963626783616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (199us total) trans 17179873036 rc 0/0 00000100:00100000:2.0:1746143781.232739:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12062 00000100:00100000:1.0:1746143781.232743:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3772:x1830963626782208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (280us total) trans 21474840369 rc 0/0 00000100:00100000:1.0:1746143781.232749:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12060 00000100:00100000:2.0:1746143781.232756:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.232761:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626782720 00000100:00100000:1.0:1746143781.232764:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626782720 00010000:00010000:3.0:1746143781.232765:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00000100:00100000:2.0:1746143781.232769:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626783232:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746143781.232772:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143781.232778:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746143781.232780:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12063 00010000:00010000:3.0:1746143781.232782:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634200 already unused, calling callback (ffffffffa0f2a690) 00000100:00100000:2.0:1746143781.232783:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.232784:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3772:x1830963626782720:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746143781.232786:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143781.232791:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143781.232799:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.232801:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:2.0:1746143781.232802:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cc000/2, rc 0, transno 21474840368 00010000:00010000:3.0:1746143781.232804:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00000100:00100000:2.0:1746143781.232806:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626781696:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143781.232808:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73a99e2 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00000004:00080000:2.0:1746143781.232813:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cdc00/2, rc 0, transno 21474840369 00000100:00100000:2.0:1746143781.232815:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626782208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.232824:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626783232 00000100:00100000:3.0:1746143781.232828:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626783232 00002000:00010000:1.0:1746143781.232833:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143781.232835:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143781.232837:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143781.232839:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143781.232841:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143781.232852:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12064 00000100:00100000:3.0:1746143781.232857:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3772:x1830963626783232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143781.232876:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143781.232878:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.232879:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.232881:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.232882:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746143781.232925:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3774:x1830963626782848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 632us (883us total) trans 17179873038 rc 0/0 00000100:00100000:0.0:1746143781.232929:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12057 00002000:00010000:3.0:1746143781.233002:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143781.233005:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143781.233006:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143781.233008:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143781.233009:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746143781.233033:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3772:x1830963626783232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (248us total) trans 17179873039 rc 0/0 00000100:00100000:3.0:1746143781.233038:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12064 00000004:00080000:0.0:1746143781.233268:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093912680/2, rc 0, transno 17179873038 00000100:00100000:0.0:1746143781.233272:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626782848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143781.233278:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093913b80/2, rc 0, transno 17179873034 00000100:00100000:0.0:1746143781.233280:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626783360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143781.233285:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093912d80/2, rc 0, transno 17179873032 00000100:00100000:0.0:1746143781.233287:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626782976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.233288:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3772:x1830963626782720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 502us (529us total) trans 17179873037 rc 0/0 00000004:00080000:0.0:1746143781.233291:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4c700/2, rc 0, transno 17179873033 00000100:00100000:0.0:1746143781.233293:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626783488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.233294:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12063 00000004:00080000:1.0:1746143781.233325:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093913480/2, rc 0, transno 17179873035 00000100:00100000:1.0:1746143781.233328:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626783104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.233334:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4d500/2, rc 0, transno 17179873036 00000100:00100000:1.0:1746143781.233336:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626783616:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143781.233644:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093911f80/2, rc 0, transno 17179873037 00000100:00100000:2.0:1746143781.233648:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626782720:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143781.233654:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093913100/2, rc 0, transno 17179873039 00000100:00100000:2.0:1746143781.233657:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626783232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.235102:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.235250:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622621184 00000100:00100000:1.0:1746143781.235258:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622621184 00000100:00100000:1.0:1746143781.235316:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12917 00000100:00100000:1.0:1746143781.235322:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:32275:x1830963622621184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143781.235345:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.235364:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73a99e9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4d1 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.235417:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73a99e9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d1 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.235429:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73a99e9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d1 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.235445:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.235448:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143781.235451:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634e00, rc 0) 00000100:00100000:1.0:1746143781.235515:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32275:x1830963622621184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 191us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.235522:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12917 00000100:00100000:0.0:1746143781.240286:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.240387:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622621440 00000100:00100000:3.0:1746143781.240397:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622621440 00000100:00100000:3.0:1746143781.240467:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4743 00000100:00100000:3.0:1746143781.240475:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32275:x1830963622621440:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1746143781.241378:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32275:x1830963622621440:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 902us (1102us total) trans 8589943681 rc 0/0 00000100:00100000:3.0:1746143781.241385:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4743 00000100:00100000:0.0:1746143781.255776:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.255975:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622621696 00000100:00100000:1.0:1746143781.255986:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622621696 00000100:00100000:0.0:1746143781.256238:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.256316:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622621952 00000100:00100000:3.0:1746143781.256321:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622621952 00000100:00100000:1.0:1746143781.256333:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12918 00000100:00100000:1.0:1746143781.256352:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+260:32287:x1830963622621696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143781.256376:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.256395:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4d8 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.256420:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12919 00000100:00100000:3.0:1746143781.256427:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:32286:x1830963622621952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.256449:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.256457:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.256462:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73a99fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4df expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.256467:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.256475:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.256486:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73a9a05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.256491:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73a9a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.256496:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73a9a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.256537:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256547:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256556:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256564:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9a13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256569:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9a13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.256571:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.256574:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9a13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.256579:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.256589:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143781.256596:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143781.256644:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256650:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.256651:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.256655:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.256656:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143781.256661:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143781.256661:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.256666:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.256706:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256711:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256716:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256720:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256724:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb5600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143781.256727:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256732:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256741:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143781.256744:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143781.256747:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.256749:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f635800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143781.256752:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9a0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.256753:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.256759:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.256769:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143781.256772:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143781.256775:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.256779:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9a13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.256779:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a99f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.256783:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9a13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256787:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9a13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256791:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb4800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143781.256794:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9a13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256798:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9a13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256804:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fee7600) 00010000:00010000:3.0:1746143781.256806:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143781.256809:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9a13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.256812:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4800/0x87925e4cb73a9a13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.256814:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73a9a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.256822:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73a9a05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.256842:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73a99fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4df expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.256862:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4df expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.256868:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.256870:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143781.256872:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551000, rc 0) 00000100:00100000:3.0:1746143781.256946:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32286:x1830963622621952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 520us (709us total) trans 8589943683 rc 0/0 00000100:00100000:3.0:1746143781.256952:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12919 00010000:00010000:1.0:1746143781.257009:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73a9a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.257014:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f635400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143781.257017:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73a9a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.257021:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73a9a05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.257029:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fee7600) 00010000:00010000:1.0:1746143781.257031:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143781.257034:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73a9a05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.257038:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73a9a05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.257069:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73a99f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d8 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.257079:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d8 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.257095:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.257097:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143781.257099:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634a00, rc 0) 00000100:00100000:1.0:1746143781.258347:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32287:x1830963622621696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1997us (2576us total) trans 8589943682 rc 0/0 00000100:00100000:1.0:1746143781.258360:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12918 00000100:00100000:0.0:1746143781.259232:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.259294:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622622080 00000100:00100000:1.0:1746143781.259302:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622622080 00000100:00100000:1.0:1746143781.259342:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12065 00000100:00100000:1.0:1746143781.259348:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32286:x1830963622622080:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143781.259361:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.259605:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a9a36 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4e6 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.259625:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.259627:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.259634:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a9a36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4e6 expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.259646:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a9a36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4e6 expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.259654:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:1.0:1746143781.259694:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:32286:x1830963622622080:12345-192.168.202.3@tcp:101:cat.0 Request processed in 345us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.259699:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12065 00000100:00100000:0.0:1746143781.259846:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.259906:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622622336 00000100:00100000:2.0:1746143781.259947:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622622336 00000100:00100000:2.0:1746143781.259992:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12920 00000100:00100000:2.0:1746143781.259999:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32283:x1830963622622336:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143781.260018:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.260032:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9a3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4ed expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.260157:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143781.260171:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d8 expref: 261 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.260179:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4df expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.260185:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143781.260214:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4df expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.260229:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4df expref: 10 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.260241:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626783744:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.260325:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d8 expref: 261 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.260334:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d8 expref: 261 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.260347:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626783872:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.260366:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.262985:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.263030:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622622464 00000100:00100000:1.0:1746143781.263042:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622622464 00000100:00100000:0.0:1746143781.263063:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143781.263077:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d8 expref: 262 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.263107:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622622592 00000100:00100000:1.0:1746143781.263110:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622622592 00010000:00010000:1.0:1746143781.263122:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4df expref: 11 pid: 14991 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.263139:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5704 00000100:00100000:1.0:1746143781.263145:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2010:x1830963622622464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.263156:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143781.263165:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626783744:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.263177:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626783872:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.263201:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143781.263238:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5705 00000100:00100000:3.0:1746143781.263249:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622622592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.263262:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.263269:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4df expref: 11 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.263280:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4df expref: 11 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.263301:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73a9a28 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4df expref: 11 pid: 14991 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.263313:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.263318:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143781.263325:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143781.263332:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.263368:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622622592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 122us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.263374:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5705 00010000:00010000:1.0:1746143781.263424:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d8 expref: 262 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.263435:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d8 expref: 262 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.263452:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73a9a1a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d8 expref: 262 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.263616:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.263621:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143781.263629:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143781.263635:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143781.263645:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143781.263664:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143781.263667:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.263704:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+261:2010:x1830963622622464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 558us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.263710:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5704 00010000:00010000:3.0:1746143781.263726:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143781.263733:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143781.263751:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143781.263867:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9a3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ed expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.263881:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ed expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.263897:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.263900:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143781.263902:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e522200, rc 0) 00000100:00100000:3.0:1746143781.263974:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32283:x1830963622622336:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3975us (4128us total) trans 8589943684 rc 0/0 00000100:00100000:3.0:1746143781.263980:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12920 00000100:00100000:3.0:1746143781.263996:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622622720 00000100:00100000:3.0:1746143781.264000:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622622720 00000100:00100000:3.0:1746143781.264026:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622622976 00000100:00100000:3.0:1746143781.264029:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622622976 00000100:00100000:3.0:1746143781.264045:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12921 00000100:00100000:3.0:1746143781.264049:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:32287:x1830963622622720:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.264065:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.264074:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a9a52 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4f4 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.264109:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12922 00000100:00100000:2.0:1746143781.264117:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+264:32282:x1830963622622976:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143781.264130:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143781.264130:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.264139:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ed expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.264140:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73a9a60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b4fb expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.264144:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143781.264165:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ed expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.264175:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ed expref: 9 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.264185:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626784000:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.264197:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264206:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264214:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264226:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a9a6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264231:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a9a6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00000100:00100000:3.0:1746143781.264233:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d000 going to sleep for 11 seconds 00010000:00010000:2.0:1746143781.264236:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a9a6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264332:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a9a75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264339:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a9a75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264344:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a9a75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143781.264351:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143781.264410:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264419:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264424:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264430:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264436:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d848e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.264440:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264446:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264454:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143781.264457:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143781.264460:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264465:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73a9a67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264484:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a9a6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264488:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a9a6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264493:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a9a6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264497:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d848600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.264499:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a9a6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264503:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a9a6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264509:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5be3000) 00010000:00010000:2.0:1746143781.264511:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143781.264513:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a9a6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264518:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73a9a6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.264547:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73a9a60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4fb expref: 266 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.264557:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a9a75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4fb expref: 265 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.264564:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.264565:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143781.264568:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143781.264572:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143781.264577:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849800, rc 0) 00000100:00100000:0.0:1746143781.264597:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.264600:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+265:32282:x1830963622622976:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 484us (936us total) trans 8589943685 rc 0/0 00000100:00100000:2.0:1746143781.264605:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12922 00000100:00100000:1.0:1746143781.264775:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622623232 00000100:00100000:1.0:1746143781.264779:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622623232 00002000:00100000:1.0:1746143781.264803:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880095cb6680 x1830963622623232/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.264811:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6680 with x1830963622623232 ext(0->1048575) 00002000:00010000:1.0:1746143781.264814:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb6680 00000100:00100000:1.0:1746143781.264827:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3517 00000100:00100000:1.0:1746143781.264832:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622623232:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143781.269046:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.269195:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626784000:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.269201:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622623360 00000100:00100000:1.0:1746143781.269207:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622623360 00010000:00010000:3.0:1746143781.269213:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143781.269233:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ed expref: 10 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.269254:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5706 00000100:00100000:1.0:1746143781.269260:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622623360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.269272:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.269277:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ed expref: 10 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.269286:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ed expref: 10 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.269302:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9a44 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ed expref: 10 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.269313:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.269317:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143781.269326:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143781.269332:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143781.269357:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.269393:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622623360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 133us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.269399:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5706 00010000:00010000:3.0:1746143781.269449:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143781.269454:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143781.269602:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:3.0:1746143781.269605:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143781.269761:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143781.269787:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2800/0x87925e4cb73a9a52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4f4 expref: 265 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.269798:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4f4 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.269804:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.269806:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143781.269808:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d3e00, rc 0) 00000100:00100000:3.0:1746143781.269836:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:32287:x1830963622622720:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5786us (6193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.269842:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12921 00000100:00100000:1.0:1746143781.270070:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622623232:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5236us (5472us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.270076:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3517 00002000:00100000:1.0:1746143781.270084:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880095cb6680 x1830963622623232/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.270091:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6680 with x1830963622623232 ext(0->1048575) 00002000:00010000:1.0:1746143781.270094:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb6680 00000100:00100000:0.0:1746143781.276198:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.276655:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622623488 00000100:00100000:1.0:1746143781.276662:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622623488 00000100:00100000:1.0:1746143781.276711:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12066 00000100:00100000:1.0:1746143781.276718:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:32287:x1830963622623488:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143781.276733:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.276749:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a9a83 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b502 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.276769:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.276771:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.276779:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a9a83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b502 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.276790:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a9a83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b502 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.276799:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635800, rc 0) 00000100:00100000:1.0:1746143781.276849:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:32287:x1830963622623488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 130us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.276854:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12066 00000100:00100000:0.0:1746143781.278136:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.278313:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622623616 00000100:00100000:1.0:1746143781.278318:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622623616 00000100:00100000:1.0:1746143781.278357:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12067 00000100:00100000:1.0:1746143781.278362:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32286:x1830963622623616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143781.278372:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.278387:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a9a8a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b509 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.278405:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.278406:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.278410:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a9a8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b509 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.278419:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a9a8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b509 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.278425:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635e00, rc 0) 00000100:00100000:1.0:1746143781.278462:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:32286:x1830963622623616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 99us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.278476:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12067 00000100:00100000:3.0:1746143781.281442:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.281654:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622623872 00000100:00100000:1.0:1746143781.281662:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622623872 00002000:00100000:1.0:1746143781.281695:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880135b08000 x1830963622623872/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.281705:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08000 with x1830963622623872 ext(0->1048575) 00002000:00010000:1.0:1746143781.281710:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b08000 00000100:00100000:1.0:1746143781.281737:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3518 00000100:00100000:1.0:1746143781.281744:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622623872:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143781.286261:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.286467:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622624000 00000100:00100000:3.0:1746143781.286476:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622624000 00000100:00100000:3.0:1746143781.286522:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12923 00000100:00100000:3.0:1746143781.286530:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32286:x1830963622624000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.286551:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.286567:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a9a91 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b510 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.286610:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a9a91 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b510 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.286623:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a9a91 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b510 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.286637:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.286640:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143781.286642:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2000, rc 0) 00000100:00100000:3.0:1746143781.286680:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32286:x1830963622624000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 150us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.286685:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12923 00000100:00100000:1.0:1746143781.289504:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622623872:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7754us (8063us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.289514:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3518 00002000:00100000:1.0:1746143781.289523:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880135b08000 x1830963622623872/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.289531:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08000 with x1830963622623872 ext(0->1048575) 00002000:00010000:1.0:1746143781.289535:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b08000 00000100:00100000:0.0:1746143781.293357:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.293620:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622624256 00000100:00100000:1.0:1746143781.293627:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622624256 00002000:00100000:1.0:1746143781.293656:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095cb5880 x1830963622624256/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.293665:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5880 with x1830963622624256 ext(1048576->2097151) 00002000:00010000:1.0:1746143781.293669:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5880 00000100:00100000:1.0:1746143781.293694:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3519 00000100:00100000:1.0:1746143781.293701:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622624256:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143781.299307:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.299369:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622624384 00000100:00100000:2.0:1746143781.299378:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622624384 00000100:00100000:2.0:1746143781.299431:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12068 00000100:00100000:2.0:1746143781.299438:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+39:32287:x1830963622624384:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.299454:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.299468:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a9a98 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b517 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.299493:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.299495:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.299501:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a9a98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b517 expref: 40 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.299514:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a9a98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b517 expref: 40 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.299523:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369800, rc 0) 00000100:00100000:2.0:1746143781.300479:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:32287:x1830963622624384:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1039us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.300485:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12068 00000100:00100000:1.0:1746143781.302388:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622624256:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8684us (9033us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.302397:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3519 00002000:00100000:1.0:1746143781.302407:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095cb5880 x1830963622624256/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.302415:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5880 with x1830963622624256 ext(1048576->2097151) 00002000:00010000:1.0:1746143781.302419:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5880 00000100:00100000:0.0:1746143781.308656:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.308723:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622624640 00000100:00100000:1.0:1746143781.308731:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622624640 00002000:00100000:1.0:1746143781.308897:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095cb7480 x1830963622624640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.308907:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7480 with x1830963622624640 ext(1048576->2097151) 00002000:00010000:1.0:1746143781.309051:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb7480 00000100:00100000:1.0:1746143781.309129:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3520 00000100:00100000:1.0:1746143781.309137:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622624640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143781.311975:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.312109:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622624768 00000100:00100000:3.0:1746143781.312118:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622624768 00000100:00100000:3.0:1746143781.312155:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12069 00000100:00100000:3.0:1746143781.312162:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:32286:x1830963622624768:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.312177:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.312190:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a9a9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b51e expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.312213:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.312214:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.312220:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a9a9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b51e expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.312233:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a9a9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b51e expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.312243:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2800, rc 0) 00000100:00100000:3.0:1746143781.312272:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32286:x1830963622624768:12345-192.168.202.3@tcp:101:cat.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.312278:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12069 00000100:00100000:1.0:1746143781.316848:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622624640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7698us (8185us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.316863:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3520 00002000:00100000:1.0:1746143781.316875:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880095cb7480 x1830963622624640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.316896:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7480 with x1830963622624640 ext(1048576->2097151) 00002000:00010000:1.0:1746143781.316903:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb7480 00000100:00100000:0.0:1746143781.323426:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.323532:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.323733:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622625152 00000100:00100000:2.0:1746143781.323743:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622625152 00000100:00100000:2.0:1746143781.323801:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12070 00000100:00100000:2.0:1746143781.323808:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+40:32287:x1830963622625152:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.323824:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.323839:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73a9aa6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b525 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.323854:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622625024 00010000:00010000:2.0:1746143781.323859:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.323861:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143781.323862:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622625024 00010000:00010000:2.0:1746143781.323868:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73a9aa6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b525 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.323881:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73a9aa6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b525 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.323905:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6c00, rc 0) 00002000:00100000:1.0:1746143781.323938:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095cb5500 x1830963622625024/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.323949:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5500 with x1830963622625024 ext(1048576->2097151) 00002000:00010000:1.0:1746143781.323954:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5500 00000100:00100000:1.0:1746143781.323973:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3521 00000100:00100000:2.0:1746143781.323978:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:32287:x1830963622625152:12345-192.168.202.3@tcp:101:cat.0 Request processed in 170us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.323981:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622625024:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.323984:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12070 00000100:00100000:0.0:1746143781.343146:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.343291:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622625408 00000100:00100000:2.0:1746143781.343308:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622625408 00002000:00100000:2.0:1746143781.343361:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095cb6d80 x1830963622625408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.343372:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6d80 with x1830963622625408 ext(1048576->2097151) 00002000:00010000:2.0:1746143781.343378:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb6d80 00000100:00100000:2.0:1746143781.343413:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3522 00000100:00100000:2.0:1746143781.343421:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622625408:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143781.344383:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622625024:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20399us (20966us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.344392:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3521 00002000:00100000:1.0:1746143781.344399:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095cb5500 x1830963622625024/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.344407:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5500 with x1830963622625024 ext(1048576->2097151) 00002000:00010000:1.0:1746143781.344411:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5500 00000100:00100000:0.0:1746143781.346501:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.346591:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622625664 00000100:00100000:2.0:1746143781.346601:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622625664 00000100:00100000:2.0:1746143781.346666:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12924 00000100:00100000:2.0:1746143781.346675:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+264:32282:x1830963622625664:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143781.346702:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.346706:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746143781.346735:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3e00/0x87925e4cb73a9a59 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4f4 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.346771:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73a9a75 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4fb expref: 263 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.346788:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.346792:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143781.346804:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a9aad lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b52c expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.346854:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.346866:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73a99e9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d1 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.346872:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a9a91 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b510 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.346878:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143781.346942:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a9a91 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b510 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.346953:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a9a91 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b510 expref: 9 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.346966:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626784128:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.347057:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73a99e9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d1 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.347065:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73a99e9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d1 expref: 7 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.347073:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626784256:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.347092:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.352695:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.352822:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626784128:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.352834:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626784256:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.352864:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:3.0:1746143781.352942:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622625792 00000100:00100000:3.0:1746143781.352950:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622625792 00000100:00100000:1.0:1746143781.353726:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.353752:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.353768:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622625920 00000100:00100000:1.0:1746143781.353772:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622625920 00010000:00010000:1.0:1746143781.353795:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a9a91 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b510 expref: 10 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.353815:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622626048 00000100:00100000:1.0:1746143781.353817:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622626048 00010000:00010000:1.0:1746143781.353825:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73a99e9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d1 expref: 8 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.353843:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5707 00000100:00100000:1.0:1746143781.353850:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622625920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.353864:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.353871:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a9a91 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b510 expref: 10 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.353959:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5708 00000100:00100000:0.0:1746143781.353966:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622626048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143781.353975:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143781.353980:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73a99e9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d1 expref: 8 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.353988:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73a99e9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d1 expref: 8 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.354010:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73a99e9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4d1 expref: 8 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.354053:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12071 00000100:00100000:2.0:1746143781.354062:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:32286:x1830963622625792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.354079:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.354094:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b533 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.354118:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.354120:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.354127:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.354141:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.354151:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107a00, rc 0) 00000100:00100000:2.0:1746143781.354196:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:32286:x1830963622625792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 136us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.354202:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12071 00000100:00100000:2.0:1746143781.354300:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622625408:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10879us (11166us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143781.354307:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3522 00010000:00010000:0.0:1746143781.354315:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00002000:00100000:2.0:1746143781.354316:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880095cb6d80 x1830963622625408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.354325:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6d80 with x1830963622625408 ext(1048576->2097151) 00002000:00010000:2.0:1746143781.354330:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb6d80 00010000:00010000:0.0:1746143781.354536:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143781.354544:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143781.354549:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143781.354732:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a9a91 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b510 expref: 10 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.354786:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2000/0x87925e4cb73a9a91 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b510 expref: 10 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.354968:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622626048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1001us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.354974:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5708 00000100:00100000:2.0:1746143781.355770:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143781.355806:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.355811:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.355822:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.355827:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.355851:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.355872:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622625920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2023us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.355878:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5707 00010000:00010000:1.0:1746143781.355977:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.355986:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:02000000:1.0:1746143781.356039:0:7245:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:3.0:1746143781.356545:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622626176 00000100:00100000:3.0:1746143781.356553:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622626176 00000100:00100000:3.0:1746143781.356588:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12925 00000100:00100000:3.0:1746143781.356595:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32286:x1830963622626176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.356612:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.356624:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b53a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.356668:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143781.356676:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.356689:0:6587:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143781.356698:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.356708:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.356710:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143781.356713:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.356723:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c800, rc 0) 00000100:00100000:3.0:1746143781.357331:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32286:x1830963622626176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 734us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.357338:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12925 00000100:00100000:0.0:1746143781.359390:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.359443:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622626304 00000100:00100000:3.0:1746143781.359453:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622626304 00000100:00100000:3.0:1746143781.359512:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12072 00000100:00100000:3.0:1746143781.359520:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:32287:x1830963622626304:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.359538:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.359555:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9ac9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b541 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.359579:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.359580:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.359588:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9ac9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b541 expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.359603:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9ac9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b541 expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.359612:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c000, rc 0) 00000100:00100000:3.0:1746143781.359656:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+38:32287:x1830963622626304:12345-192.168.202.3@tcp:101:cat.0 Request processed in 137us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.359662:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12072 00000100:00100000:0.0:1746143781.362487:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.362666:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622626432 00000100:00100000:3.0:1746143781.362675:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622626432 00000100:00100000:3.0:1746143781.362717:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12926 00000040:00080000:1.0:1746143781.362720:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2681, 88 off223648 00000100:00100000:3.0:1746143781.362723:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:32287:x1830963622626432:12345-192.168.202.3@tcp:101:cat.0 00000004:00080000:1.0:1746143781.362728:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840586815820ns, next at 775898816462ns, rc = 0 00010000:00010000:3.0:1746143781.362742:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:1.0:1746143781.362756:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2641, 88 off220472 00010000:00010000:3.0:1746143781.362760:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b548 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746143781.362760:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840586847462ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143781.362772:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2642, 88 off220560 00000004:00080000:1.0:1746143781.362775:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840586863092ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143781.362783:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2682, 88 off223736 00000004:00080000:1.0:1746143781.362785:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840586873282ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143781.362792:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2683, 88 off223824 00000004:00080000:1.0:1746143781.362794:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840586882167ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143781.362801:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2643, 88 off220648 00000004:00080000:1.0:1746143781.362803:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840586890827ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143781.362810:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2644, 88 off220736 00000004:00080000:1.0:1746143781.362812:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840586900269ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143781.362820:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2645, 88 off220824 00000004:00080000:1.0:1746143781.362822:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840586909822ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143781.362829:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2684, 88 off223912 00000004:00080000:1.0:1746143781.362832:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840586919692ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143781.362838:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2646, 88 off220912 00000004:00080000:1.0:1746143781.362840:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840586927917ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143781.362846:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2685, 88 off224000 00000004:00080000:1.0:1746143781.362848:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840586935584ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143781.362854:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2647, 88 off221000 00000004:00080000:1.0:1746143781.362857:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840586945199ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143781.362865:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2686, 88 off224088 00000004:00080000:1.0:1746143781.362867:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840586954912ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143781.362873:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2687, 88 off224176 00000004:00080000:1.0:1746143781.362875:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840586963487ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143781.362882:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2688, 88 off224264 00000004:00080000:1.0:1746143781.362893:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840586981309ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143781.362901:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2689, 88 off224352 00000004:00080000:1.0:1746143781.362903:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840586991152ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143781.362910:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2648, 88 off221088 00000004:00080000:1.0:1746143781.362946:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840587033867ns, next at 770855090093ns, rc = 0 00010000:00010000:3.0:1746143781.363968:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 266 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.363980:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 266 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.363993:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.363995:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143781.363999:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.364005:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55cc00, rc 0) 00000100:00100000:3.0:1746143781.364678:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:32287:x1830963622626432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1953us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.364685:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12926 00000001:00080000:0.0:1746143781.367994:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943686 is committed 00000004:00080000:0.0:1746143781.368008:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1878 committed 00000004:00080000:0.0:1746143781.368067:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1916 committed 00000004:00080000:0.0:1746143781.368087:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1915 committed 00000004:00080000:0.0:1746143781.368088:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1914 committed 00000004:00080000:0.0:1746143781.368090:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1913 committed 00000004:00080000:0.0:1746143781.368091:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1877 committed 00000004:00080000:0.0:1746143781.368093:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1912 committed 00000004:00080000:0.0:1746143781.368094:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1876 committed 00000004:00080000:0.0:1746143781.368096:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1911 committed 00000004:00080000:0.0:1746143781.368098:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1875 committed 00000004:00080000:0.0:1746143781.368099:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1874 committed 00000004:00080000:0.0:1746143781.368101:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1873 committed 00000004:00080000:0.0:1746143781.368102:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1910 committed 00000004:00080000:0.0:1746143781.368103:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1909 committed 00000004:00080000:0.0:1746143781.368104:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1872 committed 00000004:00080000:0.0:1746143781.368105:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1871 committed 00000004:00080000:0.0:1746143781.368107:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1908 committed 00000001:00080000:0.0:1746143781.368118:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943684 is committed 00000001:00080000:0.0:1746143781.368126:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943681 is committed 00000100:00100000:0.0:1746143781.368162:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626784640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.368226:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.368256:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143781.368261:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626784512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.368278:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.368719:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626785024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.368721:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626784768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.368744:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.368803:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626784384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.368803:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626785280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.368957:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626785152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.368972:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.368981:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626785792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.368991:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.369000:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626786304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.369011:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.369030:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626784640 00000100:00100000:1.0:1746143781.369036:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626784640 00000100:00100000:1.0:1746143781.369066:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626784512 00000100:00100000:1.0:1746143781.369067:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626784512 00000100:00100000:1.0:1746143781.369075:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626784768 00000100:00100000:1.0:1746143781.369077:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626784768 00000100:00100000:1.0:1746143781.369086:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626785152 00000100:00100000:1.0:1746143781.369087:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626785152 00000100:00100000:1.0:1746143781.369097:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626785792 00000100:00100000:1.0:1746143781.369099:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626785792 00000100:00100000:1.0:1746143781.369107:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626786304 00000100:00100000:1.0:1746143781.369109:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626786304 00000100:00100000:1.0:1746143781.369122:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12073 00000100:00100000:1.0:1746143781.369128:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3774:x1830963626784640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.369223:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12074 00000100:00100000:0.0:1746143781.369230:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3774:x1830963626784512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.369247:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12075 00000100:00100000:0.0:1746143781.369252:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3771:x1830963626784768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143781.369272:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143781.369275:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143781.369277:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143781.369279:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143781.369281:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746143781.369303:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:0.0:1746143781.369306:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00000100:00100000:1.0:1746143781.369307:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3774:x1830963626784640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (1080us total) trans 21474840370 rc 0/0 00002000:00010000:0.0:1746143781.369308:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.369310:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.369312:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00000100:00100000:1.0:1746143781.369314:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12073 00000100:00100000:1.0:1746143781.369328:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12076 00000100:00100000:1.0:1746143781.369332:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3771:x1830963626785152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.369336:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3771:x1830963626784768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (591us total) trans 21474840371 rc 0/0 00000100:00100000:0.0:1746143781.369341:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12075 00000100:00100000:0.0:1746143781.369352:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12077 00000100:00100000:0.0:1746143781.369356:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3771:x1830963626785792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.369387:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3771:x1830963626785152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (414us total) trans 21474840372 rc 0/0 00000100:00100000:1.0:1746143781.369392:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12076 00002000:00010000:0.0:1746143781.369397:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143781.369399:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00000100:00100000:1.0:1746143781.369401:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12078 00002000:00010000:0.0:1746143781.369401:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143781.369403:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00000100:00100000:1.0:1746143781.369405:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3771:x1830963626786304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143781.369405:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143781.369435:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3771:x1830963626785792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (429us total) trans 21474840373 rc 0/0 00000100:00100000:0.0:1746143781.369441:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12077 00000100:00100000:1.0:1746143781.369488:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963626786304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (476us total) trans 17179873040 rc 0/0 00000100:00100000:1.0:1746143781.369493:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12078 00000004:00080000:1.0:1746143781.369525:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d841500/2, rc 0, transno 21474840371 00000100:00100000:1.0:1746143781.369532:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626784768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.369540:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d843480/2, rc 0, transno 21474840372 00000100:00100000:1.0:1746143781.369542:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626785152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.369547:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d842300/2, rc 0, transno 21474840373 00000100:00100000:1.0:1746143781.369550:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626785792:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143781.369555:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b4b800/2, rc 0, transno 17179873040 00000100:00100000:1.0:1746143781.369557:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626786304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.369576:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143781.369580:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626786432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.369594:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.369606:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626786432 00000100:00100000:1.0:1746143781.369609:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626786432 00000100:00100000:1.0:1746143781.369620:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12079 00000100:00100000:1.0:1746143781.369623:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3771:x1830963626786432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.369668:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3771:x1830963626786432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (73us total) trans 21474840374 rc 0/0 00000100:00100000:1.0:1746143781.369673:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12079 00000004:00080000:1.0:1746143781.369686:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b48a80/2, rc 0, transno 21474840374 00000100:00100000:1.0:1746143781.369688:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626786432:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746143781.369735:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b52c expref: 263 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.369746:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.369748:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746143781.369752:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.369765:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.369771:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.369776:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.369781:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.369786:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.369806:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.369819:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626786560:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143781.369882:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.369899:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626786688:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143781.369935:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.370056:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.370061:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626785280 00000100:00100000:2.0:1746143781.370066:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626785280 00000100:00100000:1.0:1746143781.370070:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626785664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.370087:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.370088:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12080 00000100:00100000:2.0:1746143781.370093:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3774:x1830963626785280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.370097:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626786176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.370109:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143781.370124:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d842a00/2, rc 0, transno 21474840370 00000100:00100000:1.0:1746143781.370128:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626784640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.370142:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626785664 00002000:00010000:2.0:1746143781.370143:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:1.0:1746143781.370144:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626785664 00002000:00010000:2.0:1746143781.370146:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.370148:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.370150:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.370151:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143781.370157:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626786176 00000100:00100000:1.0:1746143781.370159:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626786176 00000100:00100000:1.0:1746143781.370167:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12081 00000100:00100000:1.0:1746143781.370171:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3774:x1830963626785664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.370178:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3774:x1830963626785280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (122us total) trans 17179873041 rc 0/0 00000100:00100000:2.0:1746143781.370183:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12080 00000100:00100000:2.0:1746143781.370196:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12082 00000100:00100000:2.0:1746143781.370200:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3774:x1830963626786176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143781.370212:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143781.370214:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143781.370216:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143781.370217:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143781.370219:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746143781.370237:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3774:x1830963626785664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (148us total) trans 17179873042 rc 0/0 00000100:00100000:1.0:1746143781.370242:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12081 00000100:00100000:2.0:1746143781.370252:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3774:x1830963626786176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (142us total) trans 17179873043 rc 0/0 00000100:00100000:2.0:1746143781.370260:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12082 00000004:00080000:1.0:1746143781.370265:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092145180/2, rc 0, transno 17179873041 00000100:00100000:1.0:1746143781.370268:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626785280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.370274:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092146d80/2, rc 0, transno 17179873042 00000100:00100000:1.0:1746143781.370276:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626785664:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.370282:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b49500/2, rc 0, transno 17179873043 00000100:00100000:1.0:1746143781.370284:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626786176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.370287:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.370302:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626785536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.370302:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626785024 00000100:00100000:1.0:1746143781.370304:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626785024 00000100:00100000:2.0:1746143781.370319:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.370319:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12083 00000100:00100000:1.0:1746143781.370323:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3773:x1830963626785024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.370328:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626786048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.370341:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.370358:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626785536 00000100:00100000:2.0:1746143781.370361:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626785536 00002000:00010000:1.0:1746143781.370362:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143781.370365:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143781.370366:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143781.370368:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143781.370369:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746143781.370373:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626786048 00000100:00100000:2.0:1746143781.370375:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626786048 00000100:00100000:2.0:1746143781.370384:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12084 00000100:00100000:2.0:1746143781.370388:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3773:x1830963626785536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.370391:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963626785024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (103us total) trans 17179873044 rc 0/0 00000100:00100000:1.0:1746143781.370395:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12083 00000100:00100000:1.0:1746143781.370405:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12085 00000100:00100000:1.0:1746143781.370409:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3773:x1830963626786048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.370446:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+59:3773:x1830963626785536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (126us total) trans 21474840375 rc 0/0 00000100:00100000:2.0:1746143781.370451:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12084 00000100:00100000:1.0:1746143781.370458:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3773:x1830963626786048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (116us total) trans 21474840376 rc 0/0 00000100:00100000:1.0:1746143781.370464:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12085 00000004:00080000:2.0:1746143781.370473:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092145500/2, rc 0, transno 17179873044 00000100:00100000:2.0:1746143781.370476:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626785024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143781.370483:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d841f80/2, rc 0, transno 21474840375 00000100:00100000:2.0:1746143781.370485:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626785536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143781.370492:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093726680/2, rc 0, transno 21474840376 00000100:00100000:2.0:1746143781.370495:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626786048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.370549:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.370566:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626784896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.370582:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.370602:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626785408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.370615:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.370623:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626785920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.370634:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.370653:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626784384 00000100:00100000:3.0:1746143781.370666:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626784384 00000100:00100000:3.0:1746143781.370682:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626784896 00000100:00100000:3.0:1746143781.370683:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626784896 00000100:00100000:3.0:1746143781.370691:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626785408 00000100:00100000:3.0:1746143781.370693:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626785408 00000100:00100000:3.0:1746143781.370700:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626785920 00000100:00100000:3.0:1746143781.370701:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626785920 00000100:00100000:3.0:1746143781.370710:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12086 00000100:00100000:3.0:1746143781.370714:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3772:x1830963626784384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143781.370756:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143781.370758:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.370760:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.370762:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.370764:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143781.370784:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3772:x1830963626784384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (235us total) trans 17179873045 rc 0/0 00000100:00100000:3.0:1746143781.370789:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12086 00000100:00100000:3.0:1746143781.370799:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12087 00000100:00100000:3.0:1746143781.370803:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3772:x1830963626784896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.370863:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3772:x1830963626784896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (279us total) trans 21474840377 rc 0/0 00000100:00100000:3.0:1746143781.370868:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12087 00000100:00100000:3.0:1746143781.370876:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12088 00000100:00100000:3.0:1746143781.370880:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3772:x1830963626785408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143781.370945:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143781.370947:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143781.370948:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:3.0:1746143781.370950:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143781.370951:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143781.370968:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3772:x1830963626785408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (352us total) trans 17179873046 rc 0/0 00000100:00100000:3.0:1746143781.370973:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12088 00000100:00100000:3.0:1746143781.370981:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12089 00000100:00100000:3.0:1746143781.370985:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3772:x1830963626785920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.371031:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3772:x1830963626785920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (396us total) trans 17179873047 rc 0/0 00000100:00100000:3.0:1746143781.371037:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12089 00000004:00080000:3.0:1746143781.371057:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092144a80/2, rc 0, transno 17179873045 00000100:00100000:3.0:1746143781.371060:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626784384:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143781.371067:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d840e00/2, rc 0, transno 21474840377 00000100:00100000:3.0:1746143781.371070:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626784896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143781.371075:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092146300/2, rc 0, transno 17179873046 00000100:00100000:3.0:1746143781.371078:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626785408:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143781.371083:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092144000/2, rc 0, transno 17179873047 00000100:00100000:3.0:1746143781.371085:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626785920:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143781.371213:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143781.371215:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.371217:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.371219:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.371221:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:0.0:1746143781.371242:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3774:x1830963626784512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2013us (2962us total) trans 21474840378 rc 0/0 00000100:00100000:0.0:1746143781.371250:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12074 00000004:00080000:1.0:1746143781.371257:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d843800/2, rc 0, transno 21474840378 00000100:00100000:1.0:1746143781.371261:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626784512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.373324:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.373501:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626786560:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143781.373511:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963626786688:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143781.373548:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73a9aad lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b52c expref: 263 pid: 7245 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746143781.373566:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b52c expref: 262 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.373596:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189dc00, rc 0) 00000100:00100000:1.0:1746143781.373635:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:32282:x1830963622625664:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 26961us (27142us total) trans 8589943686 rc 0/0 00000100:00100000:1.0:1746143781.373643:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12924 00000100:00100000:3.0:1746143781.374140:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622626560 00000100:00100000:3.0:1746143781.374148:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622626560 00000100:00100000:3.0:1746143781.374478:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4744 00000100:00100000:3.0:1746143781.374487:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32286:x1830963622626560:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:3.0:1746143781.374582:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32286:x1830963622626560:12345-192.168.202.3@tcp:49:cat.0 Request processed in 96us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.374588:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4744 00000100:00100000:0.0:1746143781.374693:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.374749:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622626688 00000100:00100000:3.0:1746143781.374752:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622626688 00000100:00100000:3.0:1746143781.374774:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4745 00000100:00100000:3.0:1746143781.374778:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32287:x1830963622626688:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:3.0:1746143781.374877:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32287:x1830963622626688:12345-192.168.202.3@tcp:49:cat.0 Request processed in 97us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.374883:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4745 00000100:00100000:0.0:1746143781.380132:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.380205:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622626816 00000100:00100000:3.0:1746143781.380215:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622626816 00000100:00100000:3.0:1746143781.380275:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4746 00000100:00100000:3.0:1746143781.380283:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32282:x1830963622626816:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:3.0:1746143781.380621:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32282:x1830963622626816:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 337us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.380628:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4746 00000100:00100000:0.0:1746143781.382000:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.382062:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622626944 00000100:00100000:2.0:1746143781.382069:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622626944 00000100:00100000:2.0:1746143781.382118:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12090 00000100:00100000:2.0:1746143781.382124:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:32283:x1830963622626944:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143781.382139:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.382159:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b54f expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.382188:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a9995 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4bc expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.382197:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9ac9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b541 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.382204:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.382211:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.382213:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.382216:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1642496->2097151] (req 1642496->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.382247:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.382259:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 28 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.382270:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626786816:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.382365:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9ac9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b541 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.382378:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9ac9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b541 expref: 37 pid: 3135 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.382386:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626786944:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.382413:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a9995 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4bc expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.382421:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a9995 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4bc expref: 16 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.382428:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626787072:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.382447:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.384138:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.384201:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622627200 00000100:00100000:2.0:1746143781.384208:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622627200 00002000:00100000:2.0:1746143781.384247:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095e33100 x1830963622627200/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.384256:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33100 with x1830963622627200 ext(1048576->2097151) 00010000:00010000:2.0:1746143781.384264:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 29 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.384275:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 29 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143781.384281:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e33100 00000100:00100000:2.0:1746143781.384315:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1461 00000100:00100000:2.0:1746143781.384322:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622627200:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143781.386287:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.386590:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626786816:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.386600:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626786944:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.386608:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626787072:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.386643:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1642496->2097151] (req 1642496->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.386665:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55be00, rc 0) 00000100:00100000:3.0:1746143781.386707:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32283:x1830963622626944:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4583us (4712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.386716:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12090 00000100:00100000:2.0:1746143781.387764:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.387844:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622627584 00000100:00100000:3.0:1746143781.387850:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622627584 00000100:00100000:3.0:1746143781.387899:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12091 00000100:00100000:3.0:1746143781.387905:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:32282:x1830963622627584:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143781.387937:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.387956:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b556 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.387980:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a9987 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4c3 expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.387987:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.387989:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.387992:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.388020:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a9987 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4c3 expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.388031:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a9987 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4c3 expref: 16 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.388049:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626787200:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.388108:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695da80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.388167:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622627328 00000100:00100000:1.0:1746143781.388172:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622627328 00010000:00010000:1.0:1746143781.388191:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9ac9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b541 expref: 40 pid: 3135 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.388211:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.388267:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.388299:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622627456 00000100:00100000:1.0:1746143781.388303:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622627456 00010000:00010000:1.0:1746143781.388319:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a9995 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4bc expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143781.388335:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5709 00000100:00100000:1.0:1746143781.388340:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622627328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.388348:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.388365:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9ac9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b541 expref: 40 pid: 3135 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.388374:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9ac9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b541 expref: 40 pid: 3135 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.388391:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9ac9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b541 expref: 40 pid: 3135 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.388410:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.388430:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622627328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 90us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.388436:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5709 00000100:00100000:1.0:1746143781.388451:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5710 00000100:00100000:1.0:1746143781.388455:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622627456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.388462:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.388468:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a9995 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4bc expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.388476:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a9995 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4bc expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.388487:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d550000/0x87925e4cb73a9995 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4bc expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.388495:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.388508:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2008:x1830963622627456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 52us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.388513:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5710 00000100:00100000:0.0:1746143781.388556:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622627712 00000100:00100000:0.0:1746143781.388560:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622627712 00000100:00100000:0.0:1746143781.388581:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12092 00000100:00100000:0.0:1746143781.388587:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:32287:x1830963622627712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143781.388595:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143781.388604:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b55d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.388616:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.388620:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1642496->2097151] (req 1642496->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.388626:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143781.388629:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.388651:0:13436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1642496->2097151] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.388667:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.388677:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c600, rc 0) 00000100:00100000:0.0:1746143781.388694:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:32287:x1830963622627712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 107us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.388699:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12092 00000100:00100000:0.0:1746143781.391094:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.391197:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626787200:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.391224:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.391240:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55aa00, rc 0) 00000100:00100000:3.0:1746143781.391279:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:32282:x1830963622627584:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3373us (3518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.391287:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12091 00000100:00100000:2.0:1746143781.391430:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2009:x1830963622627200:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7108us (7299us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143781.391437:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1461 00002000:00100000:2.0:1746143781.391446:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880095e33100 x1830963622627200/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.391454:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33100 with x1830963622627200 ext(1048576->2097151) 00010000:00010000:2.0:1746143781.391464:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 28 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.391487:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 28 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143781.391493:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e33100 00000100:00100000:2.0:1746143781.391519:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622627840 00000100:00100000:2.0:1746143781.391524:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622627840 00010000:00010000:2.0:1746143781.391544:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a9987 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4c3 expref: 16 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.391575:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5711 00000100:00100000:2.0:1746143781.391581:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2008:x1830963622627840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.391594:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.391608:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a9987 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4c3 expref: 16 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.391617:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a9987 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4c3 expref: 16 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.391642:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73a9987 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4c3 expref: 16 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.391662:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.391664:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.391670:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.391678:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.391705:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.391716:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626787456:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143781.391772:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.394754:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626787456:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143781.394879:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.395105:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2008:x1830963622627840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3521us (4017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.395119:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5711 00000100:00100000:0.0:1746143781.397407:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.397449:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622628096 00000100:00100000:2.0:1746143781.397457:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622628096 00002000:00100000:2.0:1746143781.397498:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2732032->2736127) req@ffff880095e32680 x1830963622628096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.397505:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32680 with x1830963622628096 ext(2732032->2736127) 00002000:00010000:2.0:1746143781.397510:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e32680 00000100:00100000:2.0:1746143781.397534:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3523 00000100:00100000:2.0:1746143781.397540:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963622628096:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143781.397675:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963622628096:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 134us (278us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143781.397679:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3523 00002000:00100000:2.0:1746143781.397683:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2732032->2736127) req@ffff880095e32680 x1830963622628096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.397688:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32680 with x1830963622628096 ext(2732032->2736127) 00002000:00010000:2.0:1746143781.397690:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e32680 00000100:00100000:0.0:1746143781.398882:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.399014:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.399094:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622628224 00000100:00100000:1.0:1746143781.399101:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622628224 00000100:00100000:1.0:1746143781.399136:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622628352 00000100:00100000:1.0:1746143781.399138:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622628352 00000100:00100000:1.0:1746143781.399150:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12093 00000100:00100000:1.0:1746143781.399156:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2010:x1830963622628224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143781.399171:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.399187:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9aec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b564 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.399197:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12094 00000100:00100000:2.0:1746143781.399206:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2011:x1830963622628352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143781.399208:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.399215:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.399220:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9aec lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b564 expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.399223:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9af3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b56b expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.399229:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9aec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b564 expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.399245:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:2.0:1746143781.399265:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626787584:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143781.399273:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2010:x1830963622628224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 118us (395us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143781.399279:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12093 00000100:00100000:2.0:1746143781.399321:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.401222:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.401519:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.401588:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622628480 00000100:00100000:2.0:1746143781.401596:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622628480 00000100:00100000:3.0:1746143781.401803:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622628608 00000100:00100000:3.0:1746143781.401807:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622628608 00010000:00010000:3.0:1746143781.401830:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 30 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.401853:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5712 00000100:00100000:3.0:1746143781.401860:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622628608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.401872:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.401904:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 30 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.401938:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 30 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.401963:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73a9abb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b533 expref: 30 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.401987:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.401989:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.401995:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.402002:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.402034:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.402044:0:16784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 29 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.402055:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626787712:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143781.402117:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.402359:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12095 00000100:00100000:2.0:1746143781.402367:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2011:x1830963622628480:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.402381:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.402394:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9afa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b572 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.402407:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.402409:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.402413:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9afa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b572 expref: 22 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.402424:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9afa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b572 expref: 22 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.402431:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2e00, rc 0) 00000100:00100000:2.0:1746143781.402468:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622628480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 102us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.402474:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12095 00000100:00100000:3.0:1746143781.402683:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626787584:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143781.402703:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9af3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b56b expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.402712:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9af3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b56b expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.402722:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2600, rc 0) 00000100:00100000:3.0:1746143781.402858:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2011:x1830963622628352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3653us (3844us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143781.402863:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12094 00000100:00100000:0.0:1746143781.405281:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.405530:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622628736 00000100:00100000:3.0:1746143781.405540:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622628736 00000100:00100000:3.0:1746143781.405590:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12096 00000100:00100000:3.0:1746143781.405599:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:32282:x1830963622628736:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143781.405618:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.405634:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b579 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.405663:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a999c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ca expref: 17 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.405673:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9afa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b572 expref: 21 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.405678:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.405680:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.405683:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->2306047] (req 2097152->2306047) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.405716:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9afa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b572 expref: 21 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.405733:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9afa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b572 expref: 21 pid: 12328 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.405745:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626787840:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.406550:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a999c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ca expref: 17 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.406561:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a999c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ca expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.406569:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626787968:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.406594:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.407946:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626787840:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.407960:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626787968:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.407988:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->2306047] (req 2097152->2306047) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.408013:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513200, rc 0) 00000100:00100000:2.0:1746143781.408049:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:32282:x1830963622628736:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2451us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.408057:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12096 00000100:00100000:3.0:1746143781.408176:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626787712:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143781.408187:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.408211:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622628608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6351us (6691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.408220:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5712 00000100:00100000:0.0:1746143781.408907:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.408996:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622628864 00000100:00100000:3.0:1746143781.409004:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622628864 00010000:00010000:3.0:1746143781.409033:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a999c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ca expref: 18 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.409071:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5713 00000100:00100000:3.0:1746143781.409079:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622628864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.409095:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.409117:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a999c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ca expref: 18 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.409128:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a999c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ca expref: 18 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.409151:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73a999c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ca expref: 18 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.409164:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.409186:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622628864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 108us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.409193:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5713 00000100:00100000:0.0:1746143781.409584:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.409615:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.409625:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622629248 00000100:00100000:2.0:1746143781.409630:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622629248 00000100:00100000:0.0:1746143781.409650:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.409669:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12097 00000100:00100000:2.0:1746143781.409675:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:32286:x1830963622629248:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.409691:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.409706:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b580 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.409727:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.409735:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143781.409737:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143781.409740:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.409768:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622629376 00010000:00010000:2.0:1746143781.409769:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.409771:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622629376 00010000:00010000:2.0:1746143781.409781:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 38 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.409782:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9afa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b572 expref: 22 pid: 12328 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.409798:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626788096:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.409801:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5714 00000100:00100000:3.0:1746143781.409806:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622629376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.409812:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.409825:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9afa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b572 expref: 22 pid: 12328 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.409832:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9afa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b572 expref: 22 pid: 12328 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.409844:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2e00/0x87925e4cb73a9afa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b572 expref: 22 pid: 12328 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.409854:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.409855:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.409861:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.409868:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.409948:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.409998:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622629120 00000100:00100000:1.0:1746143781.410002:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622629120 00010000:00010000:3.0:1746143781.410008:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.410016:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626788224:192.168.202.3@tcp:105: 00002000:00100000:1.0:1746143781.410027:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1642496->1646591) req@ffff880095e31180 x1830963622629120/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143781.410035:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695da80 going to sleep for 11 seconds 00002000:00100000:1.0:1746143781.410036:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963622629120 ext(1642496->1646591) 00010000:00010000:1.0:1746143781.410042:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 29 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.410050:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 29 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143781.410056:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e31180 00000100:00100000:1.0:1746143781.410069:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1462 00000100:00100000:1.0:1746143781.410074:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622629120:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143781.411488:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622629120:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 1406us (1829us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143781.411498:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1462 00002000:00100000:1.0:1746143781.411506:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1642496->1646591) req@ffff880095e31180 x1830963622629120/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.411514:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963622629120 ext(1642496->1646591) 00010000:00010000:1.0:1746143781.411522:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 29 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.411531:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 29 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143781.411537:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e31180 00000100:00100000:0.0:1746143781.411734:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.411940:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626788224:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143781.411959:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.411981:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622629376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2175us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.411989:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5714 00000100:00100000:3.0:1746143781.412019:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626788096:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.412037:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.412057:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2000, rc 0) 00000100:00100000:3.0:1746143781.412072:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:32286:x1830963622629248:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2398us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.412078:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12097 00000100:00100000:1.0:1746143781.412138:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622629504 00000100:00100000:1.0:1746143781.412143:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622629504 00002000:00100000:1.0:1746143781.412169:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2732032->3145727) req@ffff880095e30380 x1830963622629504/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.412176:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30380 with x1830963622629504 ext(2732032->3145727) 00010000:00010000:1.0:1746143781.412181:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 39 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.412189:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 39 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143781.412198:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e30380 00000100:00100000:1.0:1746143781.412211:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1463 00000100:00100000:1.0:1746143781.412217:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622629504:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143781.415769:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.416618:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622629760 00000100:00100000:0.0:1746143781.416628:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622629760 00002000:00100000:0.0:1746143781.416781:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2301952->2306047) req@ffff880093725f80 x1830963622629760/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143781.416791:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725f80 with x1830963622629760 ext(2301952->2306047) 00002000:00010000:0.0:1746143781.416820:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093725f80 00000100:00100000:0.0:1746143781.416848:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3524 00000100:00100000:0.0:1746143781.416856:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622629760:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143781.417011:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622629760:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 155us (1252us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143781.417019:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3524 00002000:00100000:0.0:1746143781.417025:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2301952->2306047) req@ffff880093725f80 x1830963622629760/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143781.417032:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725f80 with x1830963622629760 ext(2301952->2306047) 00002000:00010000:0.0:1746143781.417035:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093725f80 00000100:00100000:1.0:1746143781.417631:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622629504:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5411us (5895us total) trans 21474840379 rc 0/0 00000100:00100000:1.0:1746143781.417639:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1463 00002000:00100000:1.0:1746143781.417645:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2732032->3145727) req@ffff880095e30380 x1830963622629504/t21474840379(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/448 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.417652:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30380 with x1830963622629504 ext(2732032->3145727) 00010000:00010000:1.0:1746143781.417661:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 41 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.417673:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 41 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143781.417679:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095e30380 00000100:00100000:0.0:1746143781.420089:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.420246:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.420414:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622630144 00000100:00100000:1.0:1746143781.420424:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622630144 00002000:00100000:1.0:1746143781.420469:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1642496->2097151) req@ffff88012b7a8e00 x1830963622630144/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.420479:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8e00 with x1830963622630144 ext(1642496->2097151) 00010000:00010000:1.0:1746143781.420489:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 28 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.420506:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 28 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143781.420512:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7a8e00 00000100:00100000:1.0:1746143781.420538:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1464 00000100:00100000:1.0:1746143781.420546:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:2008:x1830963622630144:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143781.420561:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622630016 00000100:00100000:3.0:1746143781.420565:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622630016 00000100:00100000:3.0:1746143781.420599:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12098 00000100:00100000:3.0:1746143781.420604:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32283:x1830963622630016:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143781.420613:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.420629:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b587 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.420652:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.420657:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.420663:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143781.420667:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->2322431] (req 2097152->2322431) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.420704:0:9586:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.420716:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->2322431] (req 2097152->2322431) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.420731:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa17600, rc 0) 00000100:00100000:3.0:1746143781.420760:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:32283:x1830963622630016:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 155us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.420766:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12098 00000100:00100000:0.0:1746143781.422135:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.422209:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.422287:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622630400 00000100:00100000:3.0:1746143781.422294:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622630400 00000100:00100000:3.0:1746143781.422329:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4747 00000100:00100000:3.0:1746143781.422335:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b497c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32282:x1830963622630400:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143781.422538:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b497c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:32282:x1830963622630400:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 201us (406us total) trans 8589943687 rc 0/0 00000100:00100000:3.0:1746143781.422545:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4747 00000100:00100000:2.0:1746143781.422644:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622630528 00000100:00100000:2.0:1746143781.422649:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622630528 00010000:00010000:2.0:1746143781.422670:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 41 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.422699:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5715 00000100:00100000:2.0:1746143781.422705:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622630528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.422715:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.422732:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 41 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.422742:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 41 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.422761:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9ade lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b556 expref: 41 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.422777:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.422779:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.422786:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.422798:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.423489:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.423503:0:16784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 30 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.423514:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626788480:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143781.423570:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.428374:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626788480:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143781.428401:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.429036:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622630528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6327us (6823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.429047:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5715 00000100:00100000:0.0:1746143781.429383:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.429405:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622630784 00000100:00100000:0.0:1746143781.429412:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622630784 00002000:00100000:0.0:1746143781.429452:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88012b7ab800 x1830963622630784/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143781.429462:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ab800 with x1830963622630784 ext(2097152->3145727) 00010000:00010000:0.0:1746143781.429471:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 31 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.429483:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 31 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:0.0:1746143781.429489:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7ab800 00000100:00100000:0.0:1746143781.429519:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1465 00000100:00100000:0.0:1746143781.429527:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2010:x1830963622630784:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.431019:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2008:x1830963622630144:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10468us (10766us total) trans 21474840380 rc 0/0 00000100:00100000:2.0:1746143781.431030:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1464 00002000:00100000:2.0:1746143781.431038:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1642496->2097151) req@ffff88012b7a8e00 x1830963622630144/t21474840380(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/448 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.431047:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8e00 with x1830963622630144 ext(1642496->2097151) 00010000:00010000:2.0:1746143781.431055:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.431065:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143781.431071:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7a8e00 00000100:00100000:0.0:1746143781.436203:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.437101:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622630912 00000100:00100000:3.0:1746143781.437113:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622630912 00010000:00010000:3.0:1746143781.437157:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.437403:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5716 00000100:00100000:3.0:1746143781.437412:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2011:x1830963622630912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.437428:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.437451:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.437464:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.437488:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73a9ad7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b54f expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.437508:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.437510:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.437517:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.437524:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.437562:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.437575:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626788608:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143781.437660:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.441531:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2010:x1830963622630784:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11991us (12135us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143781.441544:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1465 00002000:00100000:0.0:1746143781.441558:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88012b7ab800 x1830963622630784/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143781.441567:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ab800 with x1830963622630784 ext(2097152->3145727) 00010000:00010000:0.0:1746143781.441578:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 31 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.441591:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 31 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:0.0:1746143781.441598:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7ab800 00000100:00100000:3.0:1746143781.441802:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626788608:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143781.441822:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.441844:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2011:x1830963622630912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4433us (5650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.441852:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5716 00000100:00100000:0.0:1746143781.446402:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.446544:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622631168 00000100:00100000:2.0:1746143781.446555:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622631168 00002000:00100000:2.0:1746143781.446606:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88012b7a8a80 x1830963622631168/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.446621:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8a80 with x1830963622631168 ext(1048576->2097151) 00002000:00010000:2.0:1746143781.446626:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a8a80 00000100:00100000:2.0:1746143781.446650:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3525 00000100:00100000:2.0:1746143781.446658:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622631168:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143781.449189:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.449267:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.449288:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622631296 00000100:00100000:3.0:1746143781.449298:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622631296 00000100:00100000:3.0:1746143781.449342:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12099 00000100:00100000:3.0:1746143781.449350:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32286:x1830963622631296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.449368:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.449386:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b58e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.449417:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.449426:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.449427:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.449431:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.449462:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.449472:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 41 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.449483:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626788736:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.449555:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.451011:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622631424 00000100:00100000:0.0:1746143781.451022:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622631424 00010000:00010000:0.0:1746143781.451054:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 30 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.451084:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5717 00000100:00100000:0.0:1746143781.451090:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2011:x1830963622631424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143781.451103:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143781.451124:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 30 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.451134:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 30 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.451156:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73a9b08 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b580 expref: 30 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.451191:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.451193:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.451199:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.451206:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.451233:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.451242:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626788864:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143781.451303:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.455304:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626788736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.455343:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.455368:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2800, rc 0) 00000100:00100000:3.0:1746143781.455417:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:32286:x1830963622631296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6066us (6234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.455425:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12099 00000100:00100000:2.0:1746143781.455783:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622631168:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 9125us (9390us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143781.455791:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3525 00002000:00100000:2.0:1746143781.455801:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88012b7a8a80 x1830963622631168/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.455809:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a8a80 with x1830963622631168 ext(1048576->2097151) 00002000:00010000:2.0:1746143781.455814:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7a8a80 00000100:00100000:1.0:1746143781.456219:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963626788864:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143781.456233:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.456252:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2011:x1830963622631424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5163us (6985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.456260:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5717 00000100:00100000:0.0:1746143781.456543:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.456638:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622631552 00000100:00100000:2.0:1746143781.456646:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622631552 00002000:00100000:2.0:1746143781.456673:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2306047) req@ffff88012b7a9880 x1830963622631552/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.456681:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9880 with x1830963622631552 ext(2097152->2306047) 00010000:00010000:2.0:1746143781.456687:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.456703:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143781.456709:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b7a9880 00000100:00100000:2.0:1746143781.456721:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1466 00000100:00100000:2.0:1746143781.456726:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622631552:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143781.462182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.462274:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622631808 00000100:00100000:1.0:1746143781.462284:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622631808 00002000:00100000:1.0:1746143781.462328:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2318336->2322431) req@ffff88012b7aa300 x1830963622631808/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.462339:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7aa300 with x1830963622631808 ext(2318336->2322431) 00002000:00010000:1.0:1746143781.462345:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7aa300 00000100:00100000:1.0:1746143781.462667:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3526 00000100:00100000:1.0:1746143781.462676:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2008:x1830963622631808:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.462826:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622631552:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 6098us (6282us total) trans 17179873048 rc 0/0 00000100:00100000:2.0:1746143781.462836:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1466 00002000:00100000:2.0:1746143781.462842:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->2306047) req@ffff88012b7a9880 x1830963622631552/t17179873048(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/448 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.462849:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9880 with x1830963622631552 ext(2097152->2306047) 00010000:00010000:2.0:1746143781.462858:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 44 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.462872:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 44 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143781.462878:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b7a9880 00000100:00100000:1.0:1746143781.463227:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2008:x1830963622631808:12345-192.168.202.3@tcp:3:cat.0 Request processed in 551us (1055us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143781.463233:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3526 00002000:00100000:1.0:1746143781.463238:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2318336->2322431) req@ffff88012b7aa300 x1830963622631808/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.463246:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7aa300 with x1830963622631808 ext(2318336->2322431) 00002000:00010000:1.0:1746143781.463249:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7aa300 00000100:00100000:0.0:1746143781.467293:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.467432:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622631936 00000100:00100000:1.0:1746143781.467444:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622631936 00000100:00100000:1.0:1746143781.467503:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12927 00000100:00100000:1.0:1746143781.467513:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:32289:x1830963622631936:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143781.467539:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.467559:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73a9b1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b595 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.467624:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467638:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467649:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467661:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9b2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467666:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467670:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467744:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467756:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467761:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746143781.467801:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:1.0:1746143781.467805:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143781.467822:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467830:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467837:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467842:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467847:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467852:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467858:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a3c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143781.467862:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467867:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467876:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143781.467880:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143781.467895:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467900:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3c00/0x87925e4cb73a9b24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467953:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467958:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9b2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467962:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9b2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467967:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a3e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143781.467969:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9b2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467973:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9b2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467979:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093ba5500) 00010000:00010000:1.0:1746143781.467981:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143781.467983:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9b2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.467987:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9b2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143781.468010:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73a9b1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b595 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.468024:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b595 expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.468030:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.468032:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143781.468035:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2200, rc 0) 00000100:00100000:1.0:1746143781.468088:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32289:x1830963622631936:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 576us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.468094:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12927 00000100:00100000:2.0:1746143781.468800:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.469252:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.469267:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.469290:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.469311:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622632576 00000100:00100000:0.0:1746143781.469317:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622632576 00000100:00100000:0.0:1746143781.469361:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4748 00000100:00100000:0.0:1746143781.469368:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32283:x1830963622632576:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143781.469481:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622632320 00000100:00100000:1.0:1746143781.469485:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622632320 00000100:00100000:1.0:1746143781.469508:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622632448 00000100:00100000:1.0:1746143781.469510:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622632448 00000100:00100000:1.0:1746143781.469525:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12100 00000100:00100000:1.0:1746143781.469529:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622632320:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143781.469539:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143781.469539:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32283:x1830963622632576:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 171us (248us total) trans 8589943688 rc 0/0 00000100:00100000:0.0:1746143781.469545:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4748 00010000:00010000:1.0:1746143781.469553:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9b39 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b59c expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.469599:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626788992:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143781.469655:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.469673:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12101 00000100:00100000:1.0:1746143781.469678:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622632448:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143781.469686:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.469699:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124512400/0x87925e4cb73a9b40 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5a3 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.469723:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626789120:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143781.469744:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.469763:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622632064 00000100:00100000:1.0:1746143781.469766:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622632064 00010000:00010000:1.0:1746143781.469900:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 46 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.469936:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5718 00000100:00100000:1.0:1746143781.469941:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622632064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.469951:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.469967:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 46 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.469977:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 46 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.469994:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.469995:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.470002:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.470011:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.470033:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.470046:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626789248:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143781.470952:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.471695:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626788992:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143781.471725:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9b39 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b59c expref: 41 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.471735:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9b39 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b59c expref: 41 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.471743:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2c00, rc 0) 00010000:00010000:2.0:1746143781.471782:0:13436:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff880092b4aa00 x1830963626789120) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 46 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.471934:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622632320:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2402us (2680us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143781.471942:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12100 00000100:00100000:1.0:1746143781.471976:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626789248:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143781.471985:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.472003:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622632064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2061us (3205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.472010:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5718 00010000:00010000:2.0:1746143781.472187:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e513200/0x87925e4cb73a9b01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b579 expref: 45 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.472202:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626789120:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143781.472220:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124512400/0x87925e4cb73a9b40 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5a3 expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.472227:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124512400/0x87925e4cb73a9b40 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5a3 expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.472233:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512400, rc 0) 00000100:00100000:2.0:1746143781.472266:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622632448:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2587us (2996us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143781.472272:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12101 00000100:00100000:0.0:1746143781.473299:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.473331:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.473390:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.473453:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622632832 00000100:00100000:3.0:1746143781.473461:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622632832 00000100:00100000:2.0:1746143781.473487:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622632704 00000100:00100000:2.0:1746143781.473491:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622632704 00000100:00100000:3.0:1746143781.473494:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622632960 00000100:00100000:3.0:1746143781.473495:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622632960 00000100:00100000:3.0:1746143781.473510:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12102 00000100:00100000:3.0:1746143781.473517:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2010:x1830963622632832:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143781.473686:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143781.473687:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12103 00000100:00100000:2.0:1746143781.473693:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2010:x1830963622632960:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143781.473700:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.473704:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9b47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5b1 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.473709:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a9b4e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5b8 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.473725:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.473727:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.473735:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a9b4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b8 expref: 18 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.473748:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a9b4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b8 expref: 18 pid: 13436 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143781.473752:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626789376:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143781.473757:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2200, rc 0) 00000100:00100000:2.0:1746143781.473789:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2010:x1830963622632960:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 96us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.473795:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12104 00000100:00100000:2.0:1746143781.473802:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12103 00000100:00100000:0.0:1746143781.473802:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2010:x1830963622632704:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143781.473808:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143781.473815:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9b55 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5aa expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.473826:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.473827:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.473831:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5aa expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143781.473841:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5aa expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143781.473848:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7cc00, rc 0) 00000100:00100000:3.0:1746143781.474037:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.474095:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2010:x1830963622632704:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 293us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.474101:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12104 00000100:00100000:0.0:1746143781.479497:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.479555:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622633088 00000100:00100000:2.0:1746143781.479566:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622633088 00000100:00100000:2.0:1746143781.479620:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12105 00000100:00100000:2.0:1746143781.479632:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:32287:x1830963622633088:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.479650:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.479668:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5bf expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.479695:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.479703:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143781.479705:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143781.479708:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 41 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.479739:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.479756:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 28 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.479768:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626789504:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.479856:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.479977:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626789376:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143781.480004:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9b47 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b1 expref: 17 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.480014:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9b47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b1 expref: 17 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.480039:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2600, rc 0) 00000100:00100000:3.0:1746143781.480063:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2010:x1830963622632832:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 6547us (6766us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143781.480071:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12102 00000100:00100000:0.0:1746143781.480863:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.480942:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622633344 00000100:00100000:1.0:1746143781.480947:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622633344 00002000:00100000:1.0:1746143781.480983:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091d4fb80 x1830963622633344/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.480992:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4fb80 with x1830963622633344 ext(2097152->4194303) 00002000:00010000:1.0:1746143781.480997:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4fb80 00000100:00100000:1.0:1746143781.481606:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3527 00000100:00100000:1.0:1746143781.481615:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622633344:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.484144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.484557:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626789504:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.484591:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 41 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.484611:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2600, rc 0) 00000100:00100000:3.0:1746143781.484661:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:32287:x1830963622633088:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5033us (5175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.484670:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12105 00000100:00100000:3.0:1746143781.484715:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622633600 00000100:00100000:3.0:1746143781.484722:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622633600 00002000:00100000:3.0:1746143781.484762:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880093726300 x1830963622633600/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.484771:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093726300 with x1830963622633600 ext(3145728->4194303) 00010000:00010000:3.0:1746143781.484779:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 29 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.484791:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 29 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143781.484797:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093726300 00000100:00100000:3.0:1746143781.484824:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1467 00000100:00100000:3.0:1746143781.484831:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622633600:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143781.488633:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.488951:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622633984 00000100:00100000:3.0:1746143781.488962:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622633984 00000100:00100000:3.0:1746143781.489025:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12928 00000100:00100000:3.0:1746143781.489034:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32289:x1830963622633984:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143781.489056:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.489077:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73a9b63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5c6 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.489189:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a9b6a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.489204:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b595 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.489212:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a9b6a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.489243:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b595 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.489253:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b595 expref: 8 pid: 7245 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.489265:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626789632:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.489329:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.489393:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.490214:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622633728 00000100:00100000:3.0:1746143781.490219:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622633728 00002000:00100000:3.0:1746143781.490250:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->2322431) req@ffff880093727100 x1830963622633728/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.491359:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093727100 with x1830963622633728 ext(2097152->2322431) 00010000:00010000:3.0:1746143781.491372:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 31 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.491384:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 31 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143781.491391:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093727100 00000100:00100000:3.0:1746143781.491429:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1468 00000100:00100000:3.0:1746143781.491439:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2008:x1830963622633728:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143781.495081:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.495170:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626789632:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.495199:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a9b6a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143781.495954:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622634112 00000100:00100000:1.0:1746143781.495960:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622634112 00010000:00010000:1.0:1746143781.495992:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b595 expref: 9 pid: 7245 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.496018:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5719 00000100:00100000:1.0:1746143781.496026:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622634112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.496041:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.496046:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b595 expref: 9 pid: 7245 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.496056:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b595 expref: 9 pid: 7245 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.496078:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73a9b32 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b595 expref: 9 pid: 7245 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.496104:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.496108:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a9b6a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.496118:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a9b6a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.496124:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a9b6a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.496143:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143781.496159:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a9b6a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.496167:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a9b6a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143781.496181:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622634112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 156us (1111us total) trans 0 rc 0/0 00000004:00200000:3.0:1746143781.496186:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000100:00100000:1.0:1746143781.496188:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5719 00010000:00010000:3.0:1746143781.496278:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73a9b63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5c6 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.496288:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622633344:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14674us (15425us total) trans 0 rc 2097152/2097152 00010000:00010000:3.0:1746143781.496296:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a9b6a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5c6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.496296:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3527 00010000:00010000:3.0:1746143781.496303:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00002000:00100000:1.0:1746143781.496304:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091d4fb80 x1830963622633344/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143781.496306:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143781.496309:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3600, rc 0) 00002000:00100000:1.0:1746143781.496314:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4fb80 with x1830963622633344 ext(2097152->4194303) 00002000:00010000:1.0:1746143781.496318:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4fb80 00000100:00100000:3.0:1746143781.496347:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32289:x1830963622633984:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 7314us (7719us total) trans 8589943689 rc 0/0 00000100:00100000:3.0:1746143781.496353:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12928 00000100:00100000:2.0:1746143781.496546:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2009:x1830963622633600:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11714us (12410us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143781.496553:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1467 00002000:00100000:2.0:1746143781.496559:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880093726300 x1830963622633600/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.496566:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093726300 with x1830963622633600 ext(3145728->4194303) 00010000:00010000:2.0:1746143781.496573:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.496586:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143781.496592:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093726300 00000100:00100000:3.0:1746143781.497076:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2008:x1830963622633728:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5639us (8541us total) trans 21474840381 rc 0/0 00000100:00100000:3.0:1746143781.497082:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1468 00002000:00100000:3.0:1746143781.497087:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->2322431) req@ffff880093727100 x1830963622633728/t21474840381(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/448 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.497093:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093727100 with x1830963622633728 ext(2097152->2322431) 00010000:00010000:3.0:1746143781.497098:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 31 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.497107:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 31 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143781.497112:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093727100 00000100:00100000:3.0:1746143781.499723:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.499782:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622634368 00000100:00100000:0.0:1746143781.499792:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622634368 00000100:00100000:0.0:1746143781.499850:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12929 00000100:00100000:0.0:1746143781.499860:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32289:x1830963622634368:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143781.499895:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143781.499898:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143781.499946:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73a9b6a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5c6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.499966:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143781.499970:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143781.499981:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9b78 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5cd expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.500079:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143781.500092:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143781.500099:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746143781.500109:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:0.0:1746143781.500197:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9b78 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5cd expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.500207:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5cd expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.500218:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143781.500220:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143781.500222:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c800, rc 0) 00000100:00100000:0.0:1746143781.500262:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32289:x1830963622634368:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 404us (550us total) trans 8589943690 rc 0/0 00000100:00100000:0.0:1746143781.500269:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12929 00000100:00100000:0.0:1746143781.502024:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.502073:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.502135:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622634496 00000100:00100000:2.0:1746143781.502143:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622634496 00010000:00010000:2.0:1746143781.502180:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 31 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.502211:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5720 00000100:00100000:2.0:1746143781.502218:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2010:x1830963622634496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.502231:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143781.502233:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622634624 00000100:00100000:3.0:1746143781.502237:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622634624 00010000:00010000:2.0:1746143781.502251:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 32 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.502261:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12106 00010000:00010000:2.0:1746143781.502262:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 32 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.502266:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:32286:x1830963622634624:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.502277:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.502280:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73a9b0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b587 expref: 32 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.502288:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5d4 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.502296:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.502298:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.502306:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 40 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.502313:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 40 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.502427:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.502429:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.502433:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.502444:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.502451:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2e00, rc 0) 00010000:00010000:2.0:1746143781.502459:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 40 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.502470:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626789760:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143781.502496:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:32286:x1830963622634624:12345-192.168.202.3@tcp:101:cat.0 Request processed in 229us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.502501:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12106 00000100:00100000:2.0:1746143781.502936:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.503333:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.503394:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622634752 00000100:00100000:2.0:1746143781.503397:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622634752 00000100:00100000:2.0:1746143781.503452:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12930 00000100:00100000:2.0:1746143781.503457:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32289:x1830963622634752:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143781.503472:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.503483:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9b94 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5db expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.503530:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9b94 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5db expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.503541:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9b94 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5db expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.503558:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.503561:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143781.503563:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55aa00, rc 0) 00000100:00100000:2.0:1746143781.503597:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32289:x1830963622634752:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 139us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.503602:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12930 00000100:00100000:2.0:1746143781.506764:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626789760:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143781.506788:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.506844:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2010:x1830963622634496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4625us (4769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.506856:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5720 00000100:00100000:1.0:1746143781.507115:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.507148:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.507180:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.507197:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.507210:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.507222:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.507250:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.507268:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622635520 00000100:00100000:1.0:1746143781.507274:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622635520 00000100:00100000:1.0:1746143781.507303:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622635776 00000100:00100000:1.0:1746143781.507305:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622635776 00000100:00100000:1.0:1746143781.507316:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622636032 00000100:00100000:1.0:1746143781.507318:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622636032 00000100:00100000:1.0:1746143781.507327:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622635392 00000100:00100000:1.0:1746143781.507328:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622635392 00000100:00100000:1.0:1746143781.507336:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622635648 00000100:00100000:1.0:1746143781.507338:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622635648 00000100:00100000:1.0:1746143781.507348:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12107 00000100:00100000:1.0:1746143781.507354:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2009:x1830963622635520:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143781.507395:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507411:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a998e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ae expref: 20 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.507419:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a9a98 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b517 expref: 42 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507426:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a9a8a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b509 expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507431:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.507433:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.507435:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507461:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a9a8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b509 expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507471:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a9a8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b509 expref: 21 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.507482:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093070700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626789888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.507539:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a9a98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b517 expref: 42 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507547:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a9a98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b517 expref: 42 pid: 3135 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.507553:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093071880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626790016:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.507571:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a998e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ae expref: 20 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.507578:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a998e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ae expref: 20 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143781.507584:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626790144:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.507595:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.507609:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12108 00000100:00100000:1.0:1746143781.507613:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622635776:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143781.507630:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507639:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507645:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9b55 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5aa expref: 17 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.507648:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.507650:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.507652:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507666:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5aa expref: 17 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.507672:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9b55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5aa expref: 17 pid: 1945 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143781.507679:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626790272:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.507697:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507704:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 40 pid: 13436 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.507710:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626790400:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.507720:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226666c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.507731:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12109 00000100:00100000:1.0:1746143781.507735:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2009:x1830963622636032:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143781.507747:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507755:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507766:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a9b4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b8 expref: 20 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.507771:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.507772:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.507774:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507784:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a9b4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b8 expref: 20 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.507790:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a9b4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b8 expref: 20 pid: 13436 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143781.507798:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626790528:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.507822:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507830:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 21 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.507837:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626790656:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.507852:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.507867:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12110 00000100:00100000:1.0:1746143781.507872:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622635392:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143781.507893:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507903:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a9979 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a7 expref: 17 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.507909:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a9a83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b502 expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507932:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a9a36 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4e6 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507937:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.507938:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.507940:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507953:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a9a36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4e6 expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.507959:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a9a36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4e6 expref: 30 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.507966:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626790784:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.507997:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a9a83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b502 expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.508008:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a9a83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b502 expref: 40 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.508014:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626790912:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.508043:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a9979 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a7 expref: 17 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.508049:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a9979 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a7 expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143781.508054:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626791040:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.508063:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.508111:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.508250:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622635904 00000100:00100000:3.0:1746143781.508255:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622635904 00000100:00100000:3.0:1746143781.508275:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12111 00000100:00100000:3.0:1746143781.508279:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2009:x1830963622635648:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143781.508295:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508303:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73a9980 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4b5 expref: 20 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.508310:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73a9aa6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b525 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508315:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a9a9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b51e expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508321:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.508322:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.508324:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508338:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a9a9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b51e expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508346:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a9a9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b51e expref: 21 pid: 3135 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.508354:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626791168:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.508383:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73a9aa6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b525 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508391:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73a9aa6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b525 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.508398:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626791296:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.508420:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73a9980 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4b5 expref: 20 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.508427:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73a9980 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4b5 expref: 20 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143781.508435:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626791424:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.508450:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.508466:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12112 00000100:00100000:3.0:1746143781.508471:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2009:x1830963622635904:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143781.508486:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508495:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 40 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508501:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508506:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.508507:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.508508:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 5/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508523:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508530:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 30 pid: 1945 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.508537:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626791552:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.508561:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 40 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.508569:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 40 pid: 1945 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.508577:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626791680:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.508593:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.508612:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622635008 00000100:00100000:3.0:1746143781.508616:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622635008 00002000:00100000:3.0:1746143781.508638:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092b4aa00 x1830963622635008/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.508647:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4aa00 with x1830963622635008 ext(3145728->4194303) 00010000:00010000:3.0:1746143781.508653:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 31 pid: 1945 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.508662:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 31 pid: 1945 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143781.508667:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b4aa00 00000100:00100000:3.0:1746143781.508679:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622635264 00000100:00100000:3.0:1746143781.508681:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622635264 00002000:00100000:3.0:1746143781.508692:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88012b7a9c00 x1830963622635264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.508698:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9c00 with x1830963622635264 ext(2097152->3145727) 00010000:00010000:3.0:1746143781.508703:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 41 pid: 1945 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.508709:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 41 pid: 1945 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143781.508719:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7a9c00 00000100:00100000:3.0:1746143781.508729:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1469 00000100:00100000:3.0:1746143781.508733:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2008:x1830963622635008:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143781.509419:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1470 00000100:00100000:1.0:1746143781.509427:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622635264:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143781.515769:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.515801:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.515826:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622636160 00000100:00100000:3.0:1746143781.515833:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622636544 00000100:00100000:0.0:1746143781.515834:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622636160 00000100:00100000:3.0:1746143781.515838:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622636544 00010000:00010000:0.0:1746143781.515878:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a9a8a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b509 expref: 22 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.515941:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5721 00000100:00100000:0.0:1746143781.515949:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963622636160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143781.515963:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143781.515983:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a9a8a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b509 expref: 22 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.515995:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a9a8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b509 expref: 22 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.516022:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143781.516063:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2010:x1830963622636160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 115us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.516069:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5721 00000100:00100000:2.0:1746143781.516141:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626790272:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.516150:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a998e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ae expref: 21 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.516152:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626790400:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.516170:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5722 00000100:00100000:3.0:1746143781.516175:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+21:2009:x1830963622636544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.516178:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.516182:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.516190:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a998e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ae expref: 21 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.516198:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a998e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ae expref: 21 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143781.516210:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.516212:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.516229:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+21:2009:x1830963622636544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 53us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.516241:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5722 00000100:00100000:3.0:1746143781.516252:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622636288 00000100:00100000:3.0:1746143781.516254:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622636288 00010000:00010000:3.0:1746143781.516263:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a9a98 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b517 expref: 43 pid: 3135 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.516282:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5723 00000100:00100000:3.0:1746143781.516286:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963622636288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.516286:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73a9a8a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b509 expref: 22 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.516293:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.516299:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a9a98 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b517 expref: 43 pid: 3135 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.516303:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093070700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626789888:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.516306:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a9a98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b517 expref: 43 pid: 3135 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.516311:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093071880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626790016:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.516317:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097369800/0x87925e4cb73a9a98 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b517 expref: 43 pid: 3135 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.516319:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73a998e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4ae expref: 20 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143781.516332:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626790144:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.516337:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.516339:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.516344:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.516352:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.516421:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.516432:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622636416 00000100:00100000:2.0:1746143781.516435:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622636416 00010000:00010000:2.0:1746143781.516449:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9b55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5aa expref: 19 pid: 1945 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.516464:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5724 00000100:00100000:2.0:1746143781.516469:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2010:x1830963622636416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.516477:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.516490:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9b55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5aa expref: 19 pid: 1945 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.516499:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5aa expref: 19 pid: 1945 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.516510:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73a9b55 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5aa expref: 19 pid: 1945 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.516523:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.516539:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2010:x1830963622636416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.516545:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5724 00000100:00100000:2.0:1746143781.516675:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626790784:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.516705:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626790912:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.516726:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626791040:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.516748:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.516771:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.516780:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622636928 00000100:00100000:2.0:1746143781.516783:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622636928 00010000:00010000:2.0:1746143781.516794:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a9a36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4e6 expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.516807:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5725 00000100:00100000:2.0:1746143781.516811:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2011:x1830963622636928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.516818:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.516827:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a9a36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4e6 expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.516834:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a9a36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4e6 expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.516845:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d75e00/0x87925e4cb73a9a36 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4e6 expref: 33 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.516854:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.516871:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2011:x1830963622636928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 59us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.516879:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5725 00000100:00100000:2.0:1746143781.516940:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.516950:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622637184 00000100:00100000:2.0:1746143781.516953:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622637184 00010000:00010000:2.0:1746143781.516962:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a9979 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a7 expref: 18 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143781.516975:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5726 00000100:00100000:2.0:1746143781.516979:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2011:x1830963622637184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.516985:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.516991:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a9979 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a7 expref: 18 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.516997:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a9979 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a7 expref: 18 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.517006:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73a9979 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4a7 expref: 18 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143781.517014:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.517029:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622637184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 50us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.517034:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5726 00000100:00100000:2.0:1746143781.517062:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.517069:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622636800 00000100:00100000:2.0:1746143781.517072:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622636800 00010000:00010000:2.0:1746143781.517083:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 43 pid: 13436 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.517096:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5727 00000100:00100000:2.0:1746143781.517100:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963622636800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.517106:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.517113:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 43 pid: 13436 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.517121:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 43 pid: 13436 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.517131:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73a9ae5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b55d expref: 43 pid: 13436 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.517139:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.517140:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.517143:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517149:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517163:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.517177:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963622636800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 77us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.517182:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5727 00010000:00010000:2.0:1746143781.517196:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517203:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517218:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517226:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517232:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517239:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090fc2600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143781.517242:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517250:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517259:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517264:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73a9ba2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.517302:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2009:x1830963622635776:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 9687us (10104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.517310:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12108 00000100:00100000:2.0:1746143781.517379:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.517389:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622637056 00000100:00100000:2.0:1746143781.517392:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622637056 00010000:00010000:2.0:1746143781.517402:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a9a83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b502 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.517415:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5728 00000100:00100000:2.0:1746143781.517419:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963622637056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.517425:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.517431:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a9a83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b502 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.517438:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a9a83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b502 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.517448:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73a9a83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b502 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.517456:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.517457:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.517460:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517466:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517481:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.517494:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622637056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.517499:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5728 00010000:00010000:2.0:1746143781.517513:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517520:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517531:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517537:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517542:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517547:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082085400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143781.517550:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517555:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517568:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.517573:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085400/0x87925e4cb73a9bb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.517604:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622635392:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 9732us (10380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.517610:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12110 00010000:00010000:3.0:1746143781.517789:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.517810:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963622636288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1523us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.517816:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5723 00010000:00010000:1.0:1746143781.518002:0:9839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.518010:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.518015:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.518029:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.518035:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.518041:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.518046:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7c800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143781.518049:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.518054:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.518068:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.518074:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9b9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.518128:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2009:x1830963622635520:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 10774us (10947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.518135:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12107 00000100:00100000:1.0:1746143781.518182:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626790528:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.518192:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626790656:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.518211:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.520720:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.520752:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.520795:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622636672 00000100:00100000:1.0:1746143781.520808:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622636672 00010000:00010000:1.0:1746143781.520850:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a9b4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b8 expref: 19 pid: 13436 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143781.520898:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622637312 00000100:00100000:1.0:1746143781.520901:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622637312 00010000:00010000:1.0:1746143781.520934:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 21 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.520948:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5729 00000100:00100000:1.0:1746143781.520955:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5730 00000100:00100000:0.0:1746143781.520960:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2009:x1830963622636672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143781.520963:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622637312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.520976:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143781.520976:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.520995:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 21 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.521000:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a9b4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b8 expref: 19 pid: 13436 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.521005:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 21 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.521137:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626791168:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.521148:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626791296:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143781.521188:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a9b4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b8 expref: 19 pid: 13436 timeout: 940 lvb_type: 1 00010000:00010000:0.0:1746143781.521208:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73a9b4e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5b8 expref: 19 pid: 13436 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143781.521236:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090fc2800/0x87925e4cb73a9b16 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b58e expref: 21 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.521256:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.521258:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.521262:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.521270:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.521296:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.521354:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2009:x1830963622637312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 390us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.521360:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5730 00010000:00010000:1.0:1746143781.521385:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.521393:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.521414:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.521421:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.521427:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.521432:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d467400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143781.521436:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.521442:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.521452:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.521457:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73a9ba9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.521493:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2009:x1830963622636032:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 13756us (14280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.521499:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12109 00010000:00010000:0.0:1746143781.521954:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.522050:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.522071:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622637568 00000100:00100000:1.0:1746143781.522076:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622637568 00010000:00010000:1.0:1746143781.522093:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73a9aa6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b525 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.522109:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5731 00000100:00100000:1.0:1746143781.522114:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963622637568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.522124:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.522133:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73a9aa6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b525 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.522140:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73a9aa6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b525 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.522153:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73a9aa6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b525 expref: 42 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.522158:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143781.522164:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.522172:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622637440 00000100:00100000:3.0:1746143781.522178:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622637440 00000100:00100000:1.0:1746143781.522181:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622637568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.522186:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5731 00010000:00010000:3.0:1746143781.522199:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a9a9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b51e expref: 20 pid: 3135 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.522229:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5732 00000100:00100000:1.0:1746143781.522236:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622637440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.522244:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.522250:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a9a9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b51e expref: 20 pid: 3135 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.522263:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a9a9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b51e expref: 20 pid: 3135 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.522273:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2800/0x87925e4cb73a9a9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b51e expref: 20 pid: 3135 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.522282:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.522294:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622637440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 59us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.522383:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622636672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1045us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.522529:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5732 00000100:00100000:0.0:1746143781.522616:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5729 00000100:00100000:3.0:1746143781.523068:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.523105:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626791552:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.523129:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626791680:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.523146:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.523211:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626791424:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.523229:0:1947:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.523244:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622635008:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14509us (16129us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143781.523251:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1469 00002000:00100000:3.0:1746143781.523258:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880092b4aa00 x1830963622635008/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.523267:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4aa00 with x1830963622635008 ext(3145728->4194303) 00010000:00010000:3.0:1746143781.523273:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 30 pid: 1945 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.523282:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 30 pid: 1945 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143781.523292:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b4aa00 00000100:00100000:0.0:1746143781.523514:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622637696 00000100:00100000:0.0:1746143781.523518:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622637696 00010000:00010000:0.0:1746143781.523532:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73a9980 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4b5 expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00000100:00100000:0.0:1746143781.523557:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5733 00000100:00100000:0.0:1746143781.523563:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2010:x1830963622637696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143781.523573:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143781.523587:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73a9980 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4b5 expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:0.0:1746143781.523595:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73a9980 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4b5 expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:0.0:1746143781.523610:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73a9980 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b4b5 expref: 17 pid: 12327 timeout: 940 lvb_type: 1 00010000:00010000:0.0:1746143781.523621:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.523623:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.523626:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.523633:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.523659:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143781.523677:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2010:x1830963622637696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 115us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.523682:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5733 00010000:00010000:2.0:1746143781.523702:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.523710:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.523724:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.523730:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.523741:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.523747:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012224fa00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143781.523750:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.523757:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.523766:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.523772:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73a9bb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.523809:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2009:x1830963622635648:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 15529us (16558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.523817:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12111 00000100:00100000:1.0:1746143781.524907:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622635264:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15474us (17750us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.525757:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1470 00002000:00100000:1.0:1746143781.525770:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88012b7a9c00 x1830963622635264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.525779:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7a9c00 with x1830963622635264 ext(2097152->3145727) 00010000:00010000:1.0:1746143781.525788:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 39 pid: 1945 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.525801:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 39 pid: 1945 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143781.525806:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7a9c00 00000100:00100000:0.0:1746143781.534536:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.534587:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.535037:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622637952 00000100:00100000:2.0:1746143781.535048:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622637952 00000100:00100000:2.0:1746143781.535104:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12113 00000100:00100000:2.0:1746143781.535113:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32286:x1830963622637952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.535128:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.535144:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1600/0x87925e4cb73a9bc5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5e2 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143781.535166:0:1947:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x1008 00010000:00010000:2.0:1746143781.535185:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.535187:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.535194:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1600/0x87925e4cb73a9bc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e2 expref: 20 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.535207:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1600/0x87925e4cb73a9bc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e2 expref: 20 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.535217:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1600, rc 0) 00000100:00100000:2.0:1746143781.535277:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:32286:x1830963622637952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 166us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.535283:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12113 00000100:00100000:1.0:1746143781.535695:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622637824 00000100:00100000:1.0:1746143781.535704:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622637824 00010000:00010000:1.0:1746143781.535738:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 30 pid: 1945 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.535784:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5734 00000100:00100000:1.0:1746143781.535792:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622637824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.535804:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.535823:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 30 pid: 1945 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.535835:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 30 pid: 1945 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.535856:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73a9b8d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5d4 expref: 30 pid: 1945 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.535876:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.535949:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2009:x1830963622637824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 158us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.535956:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5734 00000100:00100000:0.0:1746143781.537206:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.537279:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622638080 00000100:00100000:2.0:1746143781.537285:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622638080 00000100:00100000:2.0:1746143781.537318:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12114 00000100:00100000:2.0:1746143781.537323:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+41:32287:x1830963622638080:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.537334:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.537344:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c0600/0x87925e4cb73a9bcc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5e9 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.537358:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.537359:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.537363:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0600/0x87925e4cb73a9bcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e9 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.537379:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0600/0x87925e4cb73a9bcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e9 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.537387:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0600, rc 0) 00000100:00100000:2.0:1746143781.537426:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:32287:x1830963622638080:12345-192.168.202.3@tcp:101:cat.0 Request processed in 102us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.537431:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12114 00000100:00100000:0.0:1746143781.540266:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.540296:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.540360:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622638464 00000100:00100000:2.0:1746143781.540367:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622638464 00010000:00010000:2.0:1746143781.540399:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 39 pid: 1945 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.540411:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622638336 00000100:00100000:1.0:1746143781.540421:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622638336 00000100:00100000:2.0:1746143781.540430:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5735 00000100:00100000:2.0:1746143781.540436:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963622638464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.540448:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.540465:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 39 pid: 1945 timeout: 940 lvb_type: 0 00002000:00100000:1.0:1746143781.540470:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880091d4f800 x1830963622638336/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143781.540476:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 39 pid: 1945 timeout: 940 lvb_type: 0 00002000:00100000:1.0:1746143781.540480:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4f800 with x1830963622638336 ext(3145728->4194303) 00002000:00010000:1.0:1746143781.540485:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4f800 00010000:00010000:2.0:1746143781.540494:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73a9b5c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5bf expref: 39 pid: 1945 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.540519:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3528 00010000:00010000:2.0:1746143781.540520:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.540522:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.540526:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.540527:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622638336:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143781.540533:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.540552:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.540585:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622638464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 148us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.540591:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5735 00010000:00010000:3.0:1746143781.540712:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.540721:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.540734:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.540740:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.540746:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.540751:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e77600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143781.540754:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.540761:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.540769:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.540778:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73a9bbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.540825:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622635904:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 32352us (32712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.540832:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12112 00000100:00100000:0.0:1746143781.546865:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.546935:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.546954:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622638976 00000100:00100000:0.0:1746143781.546961:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622638976 00000100:00100000:0.0:1746143781.547007:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12931 00000100:00100000:0.0:1746143781.547014:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32289:x1830963622638976:12345-192.168.202.3@tcp:36:mirror_io.0 00010000:00010000:0.0:1746143781.547055:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143781.547076:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55aa00/0x87925e4cb73a9b94 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5db expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.547092:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143781.547096:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143781.547117:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143781.547127:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b52c expref: 262 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.547134:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.547139:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.547145:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143781.547169:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.547183:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 262 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.547621:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622638720 00000100:00100000:3.0:1746143781.547625:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622638720 00002000:00100000:3.0:1746143781.547647:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880091d4dc00 x1830963622638720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.547654:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4dc00 with x1830963622638720 ext(2097152->3145727) 00002000:00010000:3.0:1746143781.547657:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4dc00 00000100:00100000:0.0:1746143781.547659:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626791808:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.547669:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3529 00000100:00100000:3.0:1746143781.547673:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622638720:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:0.0:1746143781.547733:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.547740:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 8 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.547747:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626791936:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143781.547764:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b52c expref: 262 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143781.547770:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b52c expref: 262 pid: 7245 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.547775:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626792064:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143781.547787:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.549008:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622638336:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8472us (8737us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.549020:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3528 00002000:00100000:1.0:1746143781.549031:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880091d4f800 x1830963622638336/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.549041:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4f800 with x1830963622638336 ext(3145728->4194303) 00002000:00010000:1.0:1746143781.549046:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4f800 00000100:00100000:0.0:1746143781.550656:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.550680:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.550714:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622639232 00000100:00100000:1.0:1746143781.550724:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622639232 00010000:00010000:1.0:1746143781.550758:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 9 pid: 6587 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.550792:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622639104 00000100:00100000:1.0:1746143781.550794:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622639104 00010000:00010000:1.0:1746143781.550805:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 263 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.551087:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5736 00000100:00100000:1.0:1746143781.551096:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5737 00000100:00100000:3.0:1746143781.551099:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622639232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143781.551104:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626791808:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.551104:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:2010:x1830963622639104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.551113:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143781.551113:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626791936:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.551115:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143781.551121:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626792064:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.551121:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 263 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.551122:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 9 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.551132:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 263 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.551146:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 9 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.551166:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73a9ad0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b548 expref: 263 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.551177:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73a9ac2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b53a expref: 9 pid: 6587 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.551184:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.551189:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.551199:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.551199:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143781.551203:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.551210:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.551236:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:2010:x1830963622639104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 132us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.551243:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622639232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 147us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.551243:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5737 00000100:00100000:3.0:1746143781.551250:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5736 00000100:00100000:0.0:1746143781.551618:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.551643:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622639360 00000100:00100000:0.0:1746143781.551648:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622639360 00010000:00010000:0.0:1746143781.551663:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b52c expref: 262 pid: 7245 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.551690:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5738 00000100:00100000:0.0:1746143781.551694:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:2010:x1830963622639360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143781.551700:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143781.551703:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b52c expref: 262 pid: 7245 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.551711:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b52c expref: 262 pid: 7245 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.551722:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9ab4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b52c expref: 262 pid: 7245 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.551730:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143781.551733:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143781.551739:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143781.551744:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143781.551753:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143781.551766:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+261:2010:x1830963622639360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.551770:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5738 00010000:00010000:2.0:1746143781.551982:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.551990:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.551995:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000040:00080000:2.0:1746143781.552213:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2690, 88 off224440 00000004:00080000:2.0:1746143781.552219:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840776306435ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.552313:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2650, 88 off221272 00000004:00080000:2.0:1746143781.552317:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840776405025ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.552329:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2651, 88 off221360 00000004:00080000:2.0:1746143781.552332:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840776419859ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.552340:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2691, 88 off224528 00000004:00080000:2.0:1746143781.552342:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840776429876ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.552348:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2692, 88 off224616 00000004:00080000:2.0:1746143781.552350:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840776437798ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.552355:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2652, 88 off221448 00000004:00080000:2.0:1746143781.552357:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840776445216ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.552362:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2653, 88 off221536 00000004:00080000:2.0:1746143781.552364:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840776452261ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.552369:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2654, 88 off221624 00000004:00080000:2.0:1746143781.552371:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840776459078ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.552376:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2693, 88 off224704 00000004:00080000:2.0:1746143781.552378:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840776466218ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.552383:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2655, 88 off221712 00000004:00080000:2.0:1746143781.552385:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840776473421ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.552391:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2694, 88 off224792 00000004:00080000:2.0:1746143781.552393:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840776480873ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.552398:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2656, 88 off221800 00000004:00080000:2.0:1746143781.552401:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840776488578ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.552406:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2695, 88 off224880 00000004:00080000:2.0:1746143781.552408:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840776496156ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.552413:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2696, 88 off224968 00000004:00080000:2.0:1746143781.552415:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840776503076ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.552420:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2697, 88 off225056 00000004:00080000:2.0:1746143781.552422:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840776510386ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.552428:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2698, 88 off225144 00000004:00080000:2.0:1746143781.552429:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840776517369ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.552434:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2657, 88 off221888 00000004:00080000:2.0:1746143781.552437:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840776524626ns, next at 770855090093ns, rc = 0 00000001:00080000:2.0:1746143781.554192:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943691 is committed 00000004:00080000:2.0:1746143781.554201:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1886 committed 00000004:00080000:2.0:1746143781.554215:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1925 committed 00000004:00080000:2.0:1746143781.554219:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1924 committed 00000004:00080000:2.0:1746143781.554221:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1923 committed 00000004:00080000:2.0:1746143781.554223:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1922 committed 00000004:00080000:2.0:1746143781.554224:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1885 committed 00000004:00080000:2.0:1746143781.554226:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1921 committed 00000004:00080000:2.0:1746143781.554227:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1884 committed 00000004:00080000:2.0:1746143781.554229:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1920 committed 00000004:00080000:2.0:1746143781.554230:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1883 committed 00000004:00080000:2.0:1746143781.554231:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1882 committed 00000004:00080000:2.0:1746143781.554233:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1881 committed 00000004:00080000:2.0:1746143781.554234:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1919 committed 00000004:00080000:2.0:1746143781.554236:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1918 committed 00000004:00080000:2.0:1746143781.554237:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1880 committed 00000004:00080000:2.0:1746143781.554239:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1879 committed 00000004:00080000:2.0:1746143781.554240:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1917 committed 00000001:00080000:2.0:1746143781.554248:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943688 is committed 00000001:00080000:2.0:1746143781.554250:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943687 is committed 00000100:00100000:3.0:1746143781.554363:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626792448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.554378:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626792320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.554412:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.554412:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626792192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.554430:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.554435:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626793088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.554449:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626792448 00000100:00100000:2.0:1746143781.554454:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626792448 00000100:00100000:3.0:1746143781.554457:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.554460:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626792960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.554469:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626793600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.554479:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.554494:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626793088 00000100:00100000:2.0:1746143781.554494:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626792320 00000100:00100000:3.0:1746143781.554496:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626793088 00000100:00100000:2.0:1746143781.554496:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626792320 00000100:00100000:1.0:1746143781.554499:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626793472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.554507:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626792960 00000100:00100000:2.0:1746143781.554509:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626792960 00000100:00100000:3.0:1746143781.554513:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12115 00000100:00100000:1.0:1746143781.554515:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.554519:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3772:x1830963626792448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.554529:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626793856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.554542:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.554625:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3772:x1830963626792448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (212us total) trans 21474840382 rc 0/0 00000100:00100000:3.0:1746143781.554631:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12115 00000100:00100000:2.0:1746143781.554742:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626793472 00000100:00100000:2.0:1746143781.554746:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626793472 00000100:00100000:2.0:1746143781.554768:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12116 00000100:00100000:2.0:1746143781.554773:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3774:x1830963626792320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.554810:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626792576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.554829:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.554843:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626792832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.554859:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.554860:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3774:x1830963626792320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (431us total) trans 17179873049 rc 0/0 00000100:00100000:2.0:1746143781.554866:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12116 00000100:00100000:1.0:1746143781.554867:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626793344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.554875:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626793856 00000100:00100000:2.0:1746143781.554878:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626793856 00000100:00100000:1.0:1746143781.554895:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.554898:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626792576 00000100:00100000:2.0:1746143781.554900:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626792576 00000100:00100000:1.0:1746143781.554904:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626793984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.554907:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626792832 00000100:00100000:2.0:1746143781.554909:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626792832 00000100:00100000:2.0:1746143781.554941:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626793344 00000100:00100000:2.0:1746143781.554944:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626793344 00000100:00100000:1.0:1746143781.554944:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.554951:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626793984 00000100:00100000:2.0:1746143781.554952:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626793984 00000100:00100000:1.0:1746143781.554956:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746143781.554960:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12117 00000100:00100000:1.0:1746143781.554962:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626794112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.554965:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3772:x1830963626793088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.554980:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.555000:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626794112 00000100:00100000:1.0:1746143781.555006:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626794112 00000100:00100000:2.0:1746143781.555022:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3772:x1830963626793088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (563us total) trans 17179873050 rc 0/0 00000100:00100000:2.0:1746143781.555027:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12117 00000100:00100000:1.0:1746143781.555033:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12118 00000100:00100000:1.0:1746143781.555039:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3774:x1830963626792960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.555041:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12119 00000100:00100000:2.0:1746143781.555045:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+63:3774:x1830963626793472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.555101:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+64:3774:x1830963626793472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (585us total) trans 21474840383 rc 0/0 00000100:00100000:2.0:1746143781.555106:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12119 00000100:00100000:2.0:1746143781.555115:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12120 00000100:00100000:2.0:1746143781.555119:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+63:3774:x1830963626793856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.555440:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12121 00000100:00100000:3.0:1746143781.555444:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12122 00000100:00100000:0.0:1746143781.555447:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3771:x1830963626792576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.555449:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3771:x1830963626792832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143781.555457:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143781.555460:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143781.555462:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143781.555463:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143781.555465:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1746143781.555490:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:1.0:1746143781.555493:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3774:x1830963626792960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 453us (1011us total) trans 17179873051 rc 0/0 00002000:00010000:0.0:1746143781.555493:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.555495:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.555497:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.555498:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143781.555500:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12118 00000100:00100000:3.0:1746143781.555507:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+64:3771:x1830963626792832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (647us total) trans 21474840384 rc 0/0 00000100:00100000:3.0:1746143781.555515:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12122 00000100:00100000:0.0:1746143781.555515:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3771:x1830963626792576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (686us total) trans 17179873052 rc 0/0 00000100:00100000:1.0:1746143781.555568:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12123 00000100:00100000:0.0:1746143781.555573:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12121 00000100:00100000:1.0:1746143781.555576:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3771:x1830963626793344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.555585:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12124 00000100:00100000:0.0:1746143781.555590:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3771:x1830963626793984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.555645:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3771:x1830963626793344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (761us total) trans 17179873053 rc 0/0 00000100:00100000:1.0:1746143781.555651:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12123 00000100:00100000:0.0:1746143781.555651:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3771:x1830963626793984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (705us total) trans 17179873054 rc 0/0 00000100:00100000:0.0:1746143781.555657:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12124 00000100:00100000:1.0:1746143781.555664:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12125 00000100:00100000:1.0:1746143781.555669:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+63:3771:x1830963626794112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.555701:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.555735:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+64:3771:x1830963626794112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (755us total) trans 21474840385 rc 0/0 00000100:00100000:1.0:1746143781.555741:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12125 00000004:00080000:1.0:1746143781.555781:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb4e00/2, rc 0, transno 21474840385 00000100:00100000:1.0:1746143781.555802:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626794112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.555807:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622638720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8132us (8948us total) trans 0 rc 1048576/1048576 00000004:00080000:1.0:1746143781.555814:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1dbb80/2, rc 0, transno 17179873052 00000100:00100000:0.0:1746143781.555814:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3529 00000100:00100000:1.0:1746143781.555817:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626792576:0@lo:2:osp-syn-1-0.0 00002000:00100000:0.0:1746143781.555821:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff880091d4dc00 x1830963622638720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000004:00080000:1.0:1746143781.555824:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919e5c00/2, rc 0, transno 21474840384 00002000:00100000:0.0:1746143781.555827:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4dc00 with x1830963622638720 ext(2097152->3145727) 00000100:00100000:1.0:1746143781.555828:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626792832:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143781.555832:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4dc00 00000004:00080000:1.0:1746143781.555833:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d8380/2, rc 0, transno 17179873053 00000100:00100000:1.0:1746143781.555835:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626793344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.555843:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d8700/2, rc 0, transno 17179873054 00000100:00100000:1.0:1746143781.555845:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626793984:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.555861:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d9c00/2, rc 0, transno 17179873049 00000100:00100000:1.0:1746143781.555864:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626792320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.555871:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d9180/2, rc 0, transno 17179873051 00000100:00100000:1.0:1746143781.555873:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626792960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.555892:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919e7480/2, rc 0, transno 21474840383 00000100:00100000:1.0:1746143781.555896:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626793472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.555901:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746143781.555906:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626794240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.555944:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.555961:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626794240 00000100:00100000:1.0:1746143781.555965:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626794240 00000100:00100000:1.0:1746143781.555980:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12126 00000100:00100000:1.0:1746143781.555985:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3774:x1830963626794240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.556040:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3774:x1830963626794240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (96us total) trans 21474840386 rc 0/0 00000100:00100000:1.0:1746143781.556046:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12126 00000100:00100000:3.0:1746143781.556061:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143781.556064:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb5180/2, rc 0, transno 21474840386 00000100:00100000:1.0:1746143781.556068:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626794240:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143781.556072:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143781.556075:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143781.556077:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143781.556078:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00000100:00100000:1.0:1746143781.556078:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626793600 00002000:00010000:2.0:1746143781.556080:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143781.556081:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626793600 00000100:00100000:1.0:1746143781.556097:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12127 00000004:00080000:3.0:1746143781.556099:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919e4380/2, rc 0, transno 21474840382 00000100:00100000:2.0:1746143781.556102:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3774:x1830963626793856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 982us (1559us total) trans 21474840387 rc 0/0 00000100:00100000:1.0:1746143781.556102:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3772:x1830963626793600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.556103:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626792448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.556108:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12120 00000004:00080000:3.0:1746143781.556113:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d9500/2, rc 0, transno 17179873050 00000100:00100000:3.0:1746143781.556116:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626793088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.556126:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.556139:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626792704:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746143781.556151:0:7244:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880091d4f480 reply state ffff880090e43c00 transno 8589943691 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746143781.556159:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143781.556165:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746143781.556168:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626793216:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143781.556175:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.556178:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746143781.556179:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3772:x1830963626793600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (118us total) trans 21474840388 rc 0/0 00000100:00100000:3.0:1746143781.556181:0:7244:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143781.556181:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.556185:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12127 00000100:00100000:2.0:1746143781.556189:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626793728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.556195:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626792192 00000100:00100000:1.0:1746143781.556197:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626792192 00000004:00080000:3.0:1746143781.556201:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919e7800/2, rc 0, transno 21474840388 00000100:00100000:2.0:1746143781.556202:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.556203:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626793600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.556428:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626792704 00000100:00100000:1.0:1746143781.556431:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626792704 00000100:00100000:1.0:1746143781.556441:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626793216 00000100:00100000:1.0:1746143781.556443:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626793216 00000100:00100000:1.0:1746143781.556449:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626793728 00000100:00100000:1.0:1746143781.556451:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626793728 00000100:00100000:1.0:1746143781.556460:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12128 00000100:00100000:1.0:1746143781.556465:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3773:x1830963626792192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.556532:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3773:x1830963626792192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (406us total) trans 17179873055 rc 0/0 00000100:00100000:1.0:1746143781.556537:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12128 00000100:00100000:1.0:1746143781.556546:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12129 00000100:00100000:1.0:1746143781.556551:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3773:x1830963626792704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143781.556588:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143781.556590:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143781.556592:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:1.0:1746143781.556594:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143781.556595:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143781.556612:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3773:x1830963626792704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (451us total) trans 17179873056 rc 0/0 00000100:00100000:1.0:1746143781.556616:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12129 00000100:00100000:1.0:1746143781.556624:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12130 00000100:00100000:1.0:1746143781.556628:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3773:x1830963626793216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.556645:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12131 00000100:00100000:0.0:1746143781.556651:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3773:x1830963626793728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.556677:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3773:x1830963626793216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (495us total) trans 21474840389 rc 0/0 00000100:00100000:1.0:1746143781.556682:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12130 00000004:00080000:1.0:1746143781.556706:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919e5f80/2, rc 0, transno 21474840387 00000100:00100000:1.0:1746143781.556710:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626793856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.556715:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3773:x1830963626793728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (511us total) trans 21474840390 rc 0/0 00000100:00100000:0.0:1746143781.556721:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12131 00000004:00080000:2.0:1746143781.556877:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1db100/2, rc 0, transno 17179873055 00000100:00100000:2.0:1746143781.556880:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626792192:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143781.556898:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1db800/2, rc 0, transno 17179873056 00000100:00100000:2.0:1746143781.556900:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626792704:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143781.556908:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919e6300/2, rc 0, transno 21474840389 00010000:00080000:3.0:1746143781.556928:0:7244:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143781.556938:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32289:x1830963622638976:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 9924us (10026us total) trans 8589943691 rc 0/0 00000100:00100000:3.0:1746143781.556944:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12931 00010000:00010000:3.0:1746143781.556961:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.556968:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.556974:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.556982:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96c00 already unused, calling callback (ffffffffa0f2a690) 00000100:00100000:2.0:1746143781.556984:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626793216:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143781.556986:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.556991:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00000004:00080000:2.0:1746143781.556994:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919e7100/2, rc 0, transno 21474840390 00000100:00100000:2.0:1746143781.556996:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626793728:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143781.557000:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.557002:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143781.557004:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.557008:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73a9bd3 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143781.557022:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622639488 00000100:00100000:3.0:1746143781.557026:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622639488 00000100:00100000:3.0:1746143781.557050:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12932 00000100:00100000:3.0:1746143781.557055:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:32286:x1830963622639488:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.557066:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.557075:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a9bda lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5f0 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.557100:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a9bda lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5f0 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.557110:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a9bda lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5f0 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.557129:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.557131:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143781.557133:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504600, rc 0) 00000100:00100000:3.0:1746143781.557149:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32286:x1830963622639488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 94us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.557273:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12932 00000100:00100000:2.0:1746143781.557575:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.557610:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622639744 00000100:00100000:3.0:1746143781.557613:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622639744 00000100:00100000:3.0:1746143781.557629:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12933 00000100:00100000:3.0:1746143781.557633:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+260:32292:x1830963622639744:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143781.557643:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.557650:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73a9be1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5f7 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.557687:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.557694:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.557701:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.557710:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a9bef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.557715:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a9bef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.557719:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a9bef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.557774:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.557782:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5cd expref: 6 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.557788:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.557807:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5cd expref: 6 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.557817:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5cd expref: 6 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.557825:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626794368:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.558182:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.559707:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.559850:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622639872 00000100:00100000:3.0:1746143781.559856:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622639872 00000100:00100000:2.0:1746143781.560012:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12132 00000100:00100000:2.0:1746143781.560020:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+38:32287:x1830963622639872:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.560032:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.560097:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9bfd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b5fe expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143781.560190:0:13430:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4964768, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x15f0 00010000:00010000:2.0:1746143781.560207:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.560209:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.560215:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9bfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5fe expref: 39 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.560228:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9bfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5fe expref: 39 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.560236:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0c00, rc 0) 00000100:00100000:2.0:1746143781.560270:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+39:32287:x1830963622639872:12345-192.168.202.3@tcp:101:cat.0 Request processed in 250us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.560276:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12132 00000100:00100000:0.0:1746143781.561008:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.561079:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622640000 00000100:00100000:2.0:1746143781.561083:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622640000 00000100:00100000:2.0:1746143781.561215:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12934 00000100:00100000:2.0:1746143781.561222:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32289:x1830963622640000:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143781.561234:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.561244:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9c04 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b605 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.561280:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9c04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b605 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.561293:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9c04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b605 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.561304:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.561307:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143781.561309:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0400, rc 0) 00000100:00100000:2.0:1746143781.561342:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32289:x1830963622640000:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 121us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.561347:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12934 00000100:00100000:0.0:1746143781.561713:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.561903:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622640128 00000100:00100000:3.0:1746143781.561907:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622640128 00000100:00100000:3.0:1746143781.561940:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12935 00000100:00100000:3.0:1746143781.561945:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32287:x1830963622640128:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.561952:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.561960:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a9c0b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b60c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.561981:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a9c0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b60c expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.561990:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a9c0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b60c expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.561999:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.562002:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143781.562003:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e522c00, rc 0) 00000100:00100000:2.0:1746143781.562100:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626794368:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.562115:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143781.562647:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:32287:x1830963622640128:12345-192.168.202.3@tcp:101:cat.0 Request processed in 700us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.562652:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12935 00000100:00100000:0.0:1746143781.563057:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.563125:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622640256 00000100:00100000:1.0:1746143781.563129:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622640256 00010000:00010000:1.0:1746143781.563147:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5cd expref: 8 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.563166:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5739 00000100:00100000:1.0:1746143781.563171:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622640256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.563180:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.563184:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5cd expref: 8 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.563198:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5cd expref: 8 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.563212:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73a9b7f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5cd expref: 8 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.563225:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.563229:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.563235:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.563241:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.563694:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.563726:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2010:x1830963622640256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 554us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.563732:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5739 00000100:00100000:0.0:1746143781.564225:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.564291:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622640512 00000100:00100000:3.0:1746143781.564296:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622640512 00010000:00010000:2.0:1746143781.564304:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564310:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143781.564317:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4749 00000100:00100000:3.0:1746143781.564321:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32289:x1830963622640512:12345-192.168.202.3@tcp:35:mirror_io.0 00000004:00200000:2.0:1746143781.564323:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143781.564394:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564400:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564405:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564409:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e0ca00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.564413:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564418:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143781.564430:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32289:x1830963622640512:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 108us (205us total) trans 8589943693 rc 0/0 00000100:00100000:3.0:1746143781.564435:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4749 00010000:00010000:2.0:1746143781.564664:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.564667:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143781.564670:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564675:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0ca00/0x87925e4cb73a9bf6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564746:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564751:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564755:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564759:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564762:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e505c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.564764:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564769:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564775:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143781.564777:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143781.564780:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564784:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505c00/0x87925e4cb73a9be8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564791:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a9bef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564795:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a9bef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564799:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a9bef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564803:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e0de00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.564804:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a9bef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564808:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a9bef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564812:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5b9d300) 00010000:00010000:2.0:1746143781.564814:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143781.564816:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a9bef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564820:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73a9bef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.564847:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73a9be1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5f7 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.564853:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73a9be1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5f7 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.564861:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504e00, rc 0) 00000100:00100000:2.0:1746143781.565237:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32292:x1830963622639744:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7601us (7660us total) trans 8589943692 rc 301/301 00000100:00100000:2.0:1746143781.565243:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12933 00000100:00100000:0.0:1746143781.565933:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.566046:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622640640 00000100:00100000:2.0:1746143781.566051:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622640640 00000100:00100000:2.0:1746143781.566085:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12133 00000100:00100000:2.0:1746143781.566090:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32286:x1830963622640640:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.566101:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.566112:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9c19 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b613 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.566130:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.566131:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.566137:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9c19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b613 expref: 30 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.566147:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9c19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b613 expref: 30 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.566155:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1a00, rc 0) 00000100:00100000:2.0:1746143781.566193:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32286:x1830963622640640:12345-192.168.202.3@tcp:101:cat.0 Request processed in 103us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.566199:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12133 00000100:00100000:0.0:1746143781.576282:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.576367:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.576425:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622640896 00000100:00100000:1.0:1746143781.576433:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622640896 00000100:00100000:2.0:1746143781.576435:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622641152 00000100:00100000:2.0:1746143781.576438:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622641152 00002000:00100000:2.0:1746143781.576468:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff88012e35b800 x1830963622641152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.576468:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff88012e35b100 x1830963622640896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.576477:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b800 with x1830963622641152 ext(3145728->4194303) 00002000:00100000:1.0:1746143781.576477:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b100 with x1830963622640896 ext(3145728->4194303) 00002000:00010000:1.0:1746143781.576482:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35b100 00002000:00010000:2.0:1746143781.576492:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35b800 00000100:00100000:1.0:1746143781.576510:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3530 00000100:00100000:2.0:1746143781.576516:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3531 00000100:00100000:1.0:1746143781.576518:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622640896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.576520:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622641152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143781.578022:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.578094:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622641408 00000100:00100000:2.0:1746143781.578099:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622641408 00000100:00100000:2.0:1746143781.578361:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4750 00000100:00100000:2.0:1746143781.578369:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32289:x1830963622641408:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143781.579231:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32289:x1830963622641408:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 860us (1211us total) trans 8589943694 rc 0/0 00000100:00100000:2.0:1746143781.579238:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4750 00000100:00100000:0.0:1746143781.585149:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.585323:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.585403:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.585510:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.585631:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622641536 00000100:00100000:3.0:1746143781.585639:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622641536 00000100:00100000:3.0:1746143781.585675:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622641792 00000100:00100000:3.0:1746143781.585678:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622641792 00000100:00100000:3.0:1746143781.585690:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622641664 00000100:00100000:3.0:1746143781.585691:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622641664 00000100:00100000:3.0:1746143781.585704:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12134 00000100:00100000:3.0:1746143781.585710:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2009:x1830963622641536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.585725:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.585741:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9c20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b61a expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143781.585759:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x7d8 00010000:00010000:3.0:1746143781.585775:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.585777:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.585784:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9c20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b61a expref: 31 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.585797:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9c20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b61a expref: 31 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.585806:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e522e00, rc 0) 00000100:00100000:3.0:1746143781.585855:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622641536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 144us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.585860:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12134 00000100:00100000:3.0:1746143781.585873:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12135 00000100:00100000:3.0:1746143781.585877:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622641792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.585894:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.585903:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a9c27 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b628 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143781.585938:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x800 00010000:00010000:3.0:1746143781.585946:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.585948:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.585951:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a9c27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b628 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.585960:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a9c27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b628 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.585970:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523000, rc 0) 00000100:00100000:3.0:1746143781.585985:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622641792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 107us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.585989:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12135 00000100:00100000:3.0:1746143781.585998:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12136 00000100:00100000:3.0:1746143781.586002:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:2009:x1830963622641664:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.586007:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.586013:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e523800/0x87925e4cb73a9c2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b621 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143781.586021:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x808 00010000:00010000:3.0:1746143781.586028:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.586029:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.586033:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523800/0x87925e4cb73a9c2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b621 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.586040:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e523800/0x87925e4cb73a9c2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b621 expref: 22 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.586047:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523800, rc 0) 00000100:00100000:0.0:1746143781.586100:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622641920 00000100:00100000:0.0:1746143781.586103:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622641920 00000100:00100000:0.0:1746143781.586123:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12137 00000100:00100000:0.0:1746143781.586128:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622641920:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143781.586133:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143781.586141:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c529c00/0x87925e4cb73a9c35 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b62f expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143781.586150:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x808 00010000:00010000:0.0:1746143781.586157:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.586159:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143781.586162:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c529c00/0x87925e4cb73a9c35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b62f expref: 32 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143781.586175:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c529c00/0x87925e4cb73a9c35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b62f expref: 32 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143781.586181:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c529c00, rc 0) 00000100:00100000:0.0:1746143781.586199:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622641920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 71us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.586204:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12137 00000100:00100000:3.0:1746143781.586523:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622641664:12345-192.168.202.3@tcp:101:cat.0 Request processed in 519us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.586529:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12136 00000100:00100000:2.0:1746143781.594762:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622641152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18232us (18387us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143781.594772:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3531 00002000:00100000:2.0:1746143781.594781:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff88012e35b800 x1830963622641152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.594789:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b800 with x1830963622641152 ext(3145728->4194303) 00002000:00010000:2.0:1746143781.594793:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35b800 00000100:00100000:1.0:1746143781.596040:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622640896:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19520us (19763us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143781.596048:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3530 00002000:00100000:1.0:1746143781.596054:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff88012e35b100 x1830963622640896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.596062:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b100 with x1830963622640896 ext(3145728->4194303) 00002000:00010000:1.0:1746143781.596065:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35b100 00000100:00100000:0.0:1746143781.596601:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.596672:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622642176 00000100:00100000:2.0:1746143781.596681:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622642176 00000100:00100000:2.0:1746143781.597027:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12936 00000100:00100000:2.0:1746143781.597034:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32294:x1830963622642176:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143781.597052:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.597068:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a9c3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b636 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.597127:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597138:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597146:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597156:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a9c4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597161:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a9c4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597166:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a9c4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597247:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a9c51 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597254:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a9c51 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597259:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a9c51 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143781.597266:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143781.597318:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597326:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597330:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597334:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597338:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7de00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.597341:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597345:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597352:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143781.597354:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143781.597357:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597361:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7de00/0x87925e4cb73a9c43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597597:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a9c4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597602:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a9c4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597606:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a9c4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597610:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7cc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.597612:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a9c4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597616:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a9c4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597622:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5be3100) 00010000:00010000:2.0:1746143781.597624:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143781.597626:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a9c4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597629:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73a9c4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.597657:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73a9c3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b636 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.597665:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a9c51 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b636 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.597669:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.597671:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143781.597673:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ca00, rc 0) 00000100:00100000:2.0:1746143781.597716:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32294:x1830963622642176:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 683us (1122us total) trans 8589943695 rc 0/0 00000100:00100000:2.0:1746143781.597722:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12936 00000100:00100000:0.0:1746143781.601992:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.602027:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.602034:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622642432 00000100:00100000:1.0:1746143781.602043:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622642432 00000100:00100000:0.0:1746143781.602051:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.602062:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:1.0:1746143781.602080:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff88012e359c00 x1830963622642432/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143781.602080:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:1.0:1746143781.602089:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359c00 with x1830963622642432 ext(4194304->4968447) 00002000:00010000:1.0:1746143781.602093:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e359c00 00000100:00100000:1.0:1746143781.602111:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3532 00000100:00100000:1.0:1746143781.602118:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2008:x1830963622642432:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.602133:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622642688 00000100:00100000:2.0:1746143781.602137:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622642688 00000100:00100000:2.0:1746143781.602157:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622642944 00000100:00100000:2.0:1746143781.602159:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622642944 00000100:00100000:2.0:1746143781.602168:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622642560 00000100:00100000:2.0:1746143781.602170:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622642560 00000100:00100000:2.0:1746143781.602184:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622642816 00000100:00100000:2.0:1746143781.602186:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622642816 00000100:00100000:2.0:1746143781.602201:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12138 00000100:00100000:2.0:1746143781.602205:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963622642688:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.602215:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.602228:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a9c5f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b644 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.602245:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.602247:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.602253:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a9c5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b644 expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.602265:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a9c5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b644 expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.602272:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c000, rc 0) 00000100:00100000:2.0:1746143781.602307:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622642688:12345-192.168.202.3@tcp:101:cat.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.602312:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12138 00000100:00100000:2.0:1746143781.602326:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12139 00000100:00100000:2.0:1746143781.602331:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622642944:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.602338:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.602346:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a9c66 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b652 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.602357:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.602371:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.602375:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a9c66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b652 expref: 41 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.602384:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a9c66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b652 expref: 41 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.602390:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d600, rc 0) 00000100:00100000:2.0:1746143781.602404:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622642944:12345-192.168.202.3@tcp:101:cat.0 Request processed in 74us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.602409:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12139 00000100:00100000:2.0:1746143781.602417:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12140 00000100:00100000:2.0:1746143781.602421:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622642560:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.602427:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.602433:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9c6d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b63d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.602441:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.602442:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.602446:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9c6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b63d expref: 41 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.602454:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9c6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b63d expref: 41 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.602460:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d400, rc 0) 00000100:00100000:2.0:1746143781.602471:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622642560:12345-192.168.202.3@tcp:101:cat.0 Request processed in 50us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.602479:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12140 00000100:00100000:2.0:1746143781.602486:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12141 00000100:00100000:2.0:1746143781.602490:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963622642816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.602495:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.602499:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a9c74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b64b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.602508:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.602509:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.602512:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a9c74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b64b expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.602519:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a9c74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b64b expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.602524:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7da00, rc 0) 00000100:00100000:2.0:1746143781.602537:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622642816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 46us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.602541:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12141 00000100:00100000:1.0:1746143781.608880:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2008:x1830963622642432:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6743us (6876us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143781.608904:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3532 00002000:00100000:1.0:1746143781.608948:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff88012e359c00 x1830963622642432/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.608957:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359c00 with x1830963622642432 ext(4194304->4968447) 00002000:00010000:1.0:1746143781.608963:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e359c00 00000100:00100000:0.0:1746143781.614549:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.614634:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622643200 00000100:00100000:1.0:1746143781.614645:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622643200 00002000:00100000:1.0:1746143781.614689:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff88012e358700 x1830963622643200/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.614699:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358700 with x1830963622643200 ext(4194304->4968447) 00002000:00010000:1.0:1746143781.614706:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e358700 00000100:00100000:1.0:1746143781.614724:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3533 00000100:00100000:1.0:1746143781.614731:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622643200:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143781.618318:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.618737:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622643456 00000100:00100000:2.0:1746143781.618751:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622643456 00000100:00100000:2.0:1746143781.618811:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4751 00000100:00100000:2.0:1746143781.618820:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32286:x1830963622643456:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143781.619085:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32286:x1830963622643456:12345-192.168.202.3@tcp:35:cat.0 Request processed in 266us (779us total) trans 8589943696 rc 0/0 00000100:00100000:2.0:1746143781.619092:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4751 00000100:00100000:1.0:1746143781.621429:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622643200:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6688us (6880us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143781.621440:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3533 00002000:00100000:1.0:1746143781.621453:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff88012e358700 x1830963622643200/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.621463:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358700 with x1830963622643200 ext(4194304->4968447) 00002000:00010000:1.0:1746143781.621470:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e358700 00000100:00100000:0.0:1746143781.627847:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.628078:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622643712 00000100:00100000:2.0:1746143781.628090:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622643712 00000100:00100000:2.0:1746143781.628156:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4752 00000100:00100000:2.0:1746143781.628165:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:32287:x1830963622643712:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143781.628401:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+263:32287:x1830963622643712:12345-192.168.202.3@tcp:35:cat.0 Request processed in 237us (566us total) trans 8589943697 rc 0/0 00000100:00100000:2.0:1746143781.628409:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4752 00000100:00100000:0.0:1746143781.684044:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.684146:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622643968 00000100:00100000:2.0:1746143781.684157:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622643968 00000100:00100000:1.0:1746143781.684199:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.684240:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622644224 00000100:00100000:2.0:1746143781.684243:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622644224 00000100:00100000:2.0:1746143781.684269:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12937 00000100:00100000:2.0:1746143781.684277:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:32292:x1830963622643968:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143781.684304:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.684308:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143781.684335:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522c00/0x87925e4cb73a9c0b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b60c expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.684355:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.684359:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143781.684369:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47a200/0x87925e4cb73a9c7b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b659 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.684417:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.684428:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a9c51 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b636 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.684441:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a9bda lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5f0 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.684448:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9c04 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b605 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.684453:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.684480:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9c04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b605 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.684490:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9c04 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b605 expref: 8 pid: 7245 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.684501:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626794496:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.684586:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a9bda lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5f0 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.684593:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a9bda lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5f0 expref: 11 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.684601:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626794624:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.684621:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a9c51 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b636 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.684628:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a9c51 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b636 expref: 11 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.684635:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626794752:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.684649:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.684665:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12938 00000100:00100000:3.0:1746143781.684675:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32294:x1830963622644224:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143781.684687:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.684689:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746143781.684697:0:14991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a9bda lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5f0 expref: 11 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.684711:0:14991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a9c51 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b636 expref: 11 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.684719:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.684722:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.684728:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.684733:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143781.684740:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9c89 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b660 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.684933:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.684941:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.684947:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.684958:0:14991:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143781.684968:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:2.0:1746143781.686115:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626794496:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.686126:0:7244:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from blocking AST (req@ffff880093725880 x1830963626794624) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a9bda lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5f0 expref: 12 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.686136:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504600/0x87925e4cb73a9bda lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5f0 expref: 12 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.686147:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626794624:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143781.686433:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143781.686487:0:7244:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from blocking AST (req@ffff880093724a80 x1830963626794752) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a9c51 lrc: 1/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b636 expref: 11 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.686496:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73a9c51 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b636 expref: 11 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.686504:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626794752:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.686526:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.686530:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.686541:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.686547:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143781.686599:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622644352 00000100:00100000:1.0:1746143781.686605:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622644352 00010000:00010000:1.0:1746143781.686635:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9c04 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b605 expref: 9 pid: 7245 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.686654:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5740 00000100:00100000:1.0:1746143781.686659:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622644352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.686669:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.686673:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9c04 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b605 expref: 9 pid: 7245 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.686682:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9c04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b605 expref: 9 pid: 7245 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.686696:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73a9c04 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b605 expref: 9 pid: 7245 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.686718:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.686722:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.686728:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.686733:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143781.686740:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.686744:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.686756:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143781.687100:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143781.687107:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000040:00080000:2.0:1746143781.687341:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2699, 88 off225232 00000004:00080000:2.0:1746143781.687347:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840911434385ns, next at 775898816462ns, rc = 0 00000100:00100000:1.0:1746143781.687713:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622644352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1051us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.687721:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5740 00000040:00080000:2.0:1746143781.688223:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2658, 88 off221976 00000004:00080000:2.0:1746143781.688228:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840912315357ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.688248:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2659, 88 off222064 00000004:00080000:2.0:1746143781.688251:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840912338515ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.688353:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2700, 88 off225320 00000004:00080000:2.0:1746143781.688357:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840912444585ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.688366:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2701, 88 off225408 00000004:00080000:2.0:1746143781.688369:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840912456505ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.688377:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2660, 88 off222152 00000004:00080000:2.0:1746143781.688379:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840912466985ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.688387:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2661, 88 off222240 00000004:00080000:2.0:1746143781.688389:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840912477053ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.688396:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2662, 88 off222328 00000004:00080000:2.0:1746143781.688399:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840912486798ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.688405:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2702, 88 off225496 00000004:00080000:2.0:1746143781.688407:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840912495360ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.688414:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2663, 88 off222416 00000004:00080000:2.0:1746143781.688416:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840912504366ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.688423:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2703, 88 off225584 00000004:00080000:2.0:1746143781.688427:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840912514472ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.688433:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2664, 88 off222504 00000004:00080000:2.0:1746143781.688437:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840912524500ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.688443:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2704, 88 off225672 00000004:00080000:2.0:1746143781.688445:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840912532975ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.688451:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2705, 88 off225760 00000004:00080000:2.0:1746143781.688454:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840912541470ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.688459:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2706, 88 off225848 00000004:00080000:2.0:1746143781.688461:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840912549396ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.688468:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2707, 88 off225936 00000004:00080000:2.0:1746143781.688470:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840912558003ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.688477:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2665, 88 off222592 00000004:00080000:2.0:1746143781.688479:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840912566695ns, next at 770855090093ns, rc = 0 00000001:00080000:3.0:1746143781.692093:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943698 is committed 00000004:00080000:3.0:1746143781.692105:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1894 committed 00000004:00080000:3.0:1746143781.692213:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1934 committed 00000004:00080000:3.0:1746143781.692219:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1933 committed 00000004:00080000:3.0:1746143781.692220:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1932 committed 00000004:00080000:3.0:1746143781.692222:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1931 committed 00000004:00080000:3.0:1746143781.692224:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1893 committed 00000004:00080000:3.0:1746143781.692225:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1930 committed 00000004:00080000:3.0:1746143781.692227:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1892 committed 00000004:00080000:3.0:1746143781.692228:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1929 committed 00000004:00080000:3.0:1746143781.692230:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1891 committed 00000004:00080000:3.0:1746143781.692231:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1890 committed 00000004:00080000:3.0:1746143781.692232:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1889 committed 00000004:00080000:3.0:1746143781.692234:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1928 committed 00000004:00080000:3.0:1746143781.692235:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1927 committed 00000004:00080000:3.0:1746143781.692236:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1888 committed 00000004:00080000:3.0:1746143781.692238:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1887 committed 00000004:00080000:3.0:1746143781.692239:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1926 committed 00000001:00080000:3.0:1746143781.692247:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943696 is committed 00000001:00080000:3.0:1746143781.692251:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943694 is committed 00000100:00100000:3.0:1746143781.692433:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626795136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.692500:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.692536:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746143781.692540:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626795008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.692557:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143781.692647:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.692660:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.692663:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143781.692666:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.692675:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.692680:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.692706:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.692723:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 262 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.692733:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626795392:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.692993:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626795776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.693305:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626795136 00000100:00100000:0.0:1746143781.693314:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626795136 00000100:00100000:0.0:1746143781.693350:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626795008 00000100:00100000:0.0:1746143781.693353:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626795008 00000100:00100000:0.0:1746143781.693368:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12142 00000100:00100000:0.0:1746143781.693376:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+62:3772:x1830963626795136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.693488:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626795264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.693495:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.693513:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746143781.693513:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746143781.693514:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626796160:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143781.693516:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.693519:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.693521:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.693523:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746143781.693529:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626795904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.693531:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.693547:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.693549:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626796672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.693556:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:3772:x1830963626795136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (1056us total) trans 17179873057 rc 0/0 00000100:00100000:2.0:1746143781.693560:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626796416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.693562:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12142 00000100:00100000:1.0:1746143781.693566:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.693574:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.693576:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626795776 00000100:00100000:1.0:1746143781.693580:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746143781.693580:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626795776 00000100:00100000:1.0:1746143781.693585:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626795648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.693588:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626796928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.693593:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626795264 00000100:00100000:0.0:1746143781.693594:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626795264 00000100:00100000:1.0:1746143781.693603:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.693604:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626796160 00000100:00100000:0.0:1746143781.693605:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626796160 00000100:00100000:2.0:1746143781.693608:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626795904 00000100:00100000:0.0:1746143781.693611:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626796672 00000100:00100000:2.0:1746143781.693612:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626795904 00000100:00100000:0.0:1746143781.693613:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626796672 00000100:00100000:1.0:1746143781.693615:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626796288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.693620:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626796416 00000100:00100000:0.0:1746143781.693621:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626796416 00000100:00100000:2.0:1746143781.693627:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626795648 00000100:00100000:1.0:1746143781.693628:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.693629:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626795648 00000100:00100000:0.0:1746143781.693630:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12143 00000100:00100000:1.0:1746143781.693634:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626796800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.693634:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3772:x1830963626795008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.693637:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626796288 00000100:00100000:2.0:1746143781.693639:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626796288 00000100:00100000:2.0:1746143781.693647:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12144 00000100:00100000:1.0:1746143781.693648:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.693652:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3771:x1830963626795776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.693663:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626794880:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143781.693675:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143781.693677:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00000100:00100000:1.0:1746143781.693678:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746143781.693679:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.693680:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.693682:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143781.693684:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626795520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.693697:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.693700:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3772:x1830963626795008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1143us total) trans 17179873058 rc 0/0 00000100:00100000:1.0:1746143781.693704:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626796032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.693706:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12143 00000100:00100000:0.0:1746143781.693714:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626796800 00000100:00100000:1.0:1746143781.693716:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.693716:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626796800 00000100:00100000:1.0:1746143781.693722:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626796544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.693723:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626794880 00000100:00100000:0.0:1746143781.693726:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626794880 00000100:00100000:0.0:1746143781.693731:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626795520 00000100:00100000:0.0:1746143781.693733:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626795520 00000100:00100000:1.0:1746143781.693736:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.693738:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626796032 00000100:00100000:0.0:1746143781.693739:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626796032 00000100:00100000:0.0:1746143781.693746:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626796544 00000100:00100000:0.0:1746143781.693747:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626796544 00000100:00100000:0.0:1746143781.693755:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12145 00000100:00100000:1.0:1746143781.693759:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12146 00000100:00100000:0.0:1746143781.693760:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3773:x1830963626795264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.693766:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3771:x1830963626796160:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143781.693782:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e1880/2, rc 0, transno 17179873058 00000100:00100000:3.0:1746143781.693788:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626795008:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143781.693796:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e0700/2, rc 0, transno 17179873057 00000100:00100000:3.0:1746143781.693799:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626795136:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143781.693799:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143781.693801:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.693803:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.693805:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.693806:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143781.693825:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:3773:x1830963626795264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (311us total) trans 17179873059 rc 0/0 00000100:00100000:0.0:1746143781.693830:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12145 00000100:00100000:3.0:1746143781.693838:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12147 00000100:00100000:1.0:1746143781.693839:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+69:3771:x1830963626796160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (306us total) trans 17179873060 rc 0/0 00000100:00100000:0.0:1746143781.693842:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12148 00000100:00100000:3.0:1746143781.693845:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+74:3771:x1830963626796672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.693845:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12146 00000100:00100000:0.0:1746143781.693846:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3773:x1830963626795904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.693856:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12149 00000100:00100000:1.0:1746143781.693861:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3773:x1830963626796416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.693930:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:3773:x1830963626795904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (361us total) trans 17179873061 rc 0/0 00000100:00100000:0.0:1746143781.693937:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12148 00000100:00100000:1.0:1746143781.693945:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3773:x1830963626796416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (368us total) trans 17179873062 rc 0/0 00000100:00100000:0.0:1746143781.693950:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12150 00000100:00100000:1.0:1746143781.693953:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12149 00000100:00100000:0.0:1746143781.693955:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:3771:x1830963626795648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.693959:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3771:x1830963626796672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (392us total) trans 21474840391 rc 0/0 00000100:00100000:1.0:1746143781.693964:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12151 00000100:00100000:1.0:1746143781.693968:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+75:3771:x1830963626796288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143781.693996:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143781.693998:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.694000:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.694002:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.694004:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143781.694025:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3771:x1830963626796288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (396us total) trans 21474840393 rc 0/0 00000100:00100000:0.0:1746143781.694025:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:3771:x1830963626795648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (420us total) trans 21474840392 rc 0/0 00002000:00010000:2.0:1746143781.694327:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143781.694330:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143781.694332:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143781.694333:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143781.694335:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746143781.694357:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+69:3771:x1830963626795776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 704us (864us total) trans 17179873063 rc 0/0 00000100:00100000:3.0:1746143781.694393:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12147 00000100:00100000:0.0:1746143781.694398:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12150 00000100:00100000:3.0:1746143781.694406:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12152 00000100:00100000:0.0:1746143781.694411:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12153 00000100:00100000:3.0:1746143781.694412:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3771:x1830963626796800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.694417:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:3774:x1830963626794880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143781.694457:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143781.694459:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143781.694460:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143781.694461:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.694462:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143781.694463:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143781.694463:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.694465:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00002000:00010000:0.0:1746143781.694465:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.694466:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:3.0:1746143781.694487:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3771:x1830963626796800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (838us total) trans 21474840394 rc 0/0 00000100:00100000:3.0:1746143781.694493:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12152 00000100:00100000:3.0:1746143781.694502:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12154 00000100:00100000:3.0:1746143781.694507:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+69:3774:x1830963626795520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.694508:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3774:x1830963626794880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (828us total) trans 21474840395 rc 0/0 00000100:00100000:0.0:1746143781.694513:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12153 00000100:00100000:0.0:1746143781.694521:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12155 00000100:00100000:0.0:1746143781.694525:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:3774:x1830963626796032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143781.694546:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143781.694549:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143781.694551:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:3.0:1746143781.694552:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143781.694554:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00002000:00010000:0.0:1746143781.694562:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:0.0:1746143781.694564:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.694566:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.694568:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.694569:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00000100:00100000:3.0:1746143781.694572:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+70:3774:x1830963626795520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (874us total) trans 17179873064 rc 0/0 00000100:00100000:3.0:1746143781.694581:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12154 00000100:00100000:0.0:1746143781.694587:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3774:x1830963626796032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (869us total) trans 21474840396 rc 0/0 00000100:00100000:3.0:1746143781.694590:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12156 00000100:00100000:0.0:1746143781.694593:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12155 00000100:00100000:3.0:1746143781.694595:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3774:x1830963626796544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.694654:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3774:x1830963626796544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (918us total) trans 21474840397 rc 0/0 00000100:00100000:3.0:1746143781.694659:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12156 00000100:00100000:3.0:1746143781.694688:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143781.694713:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e3b80/2, rc 0, transno 17179873059 00000100:00100000:3.0:1746143781.694717:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626795264:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143781.694724:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e2680/2, rc 0, transno 17179873061 00000100:00100000:3.0:1746143781.694727:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626795904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143781.694733:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e0380/2, rc 0, transno 17179873062 00000100:00100000:3.0:1746143781.694735:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626796416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.694951:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12151 00000100:00100000:1.0:1746143781.694965:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626796928 00000100:00100000:1.0:1746143781.694970:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626796928 00000004:00080000:0.0:1746143781.695006:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e493480/2, rc 0, transno 21474840395 00000100:00100000:0.0:1746143781.695014:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626794880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143781.695022:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e3800/2, rc 0, transno 17179873064 00000100:00100000:0.0:1746143781.695024:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626795520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143781.695030:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e490700/2, rc 0, transno 21474840396 00000100:00100000:0.0:1746143781.695032:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626796032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143781.695037:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e492a00/2, rc 0, transno 21474840397 00000100:00100000:2.0:1746143781.695054:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12144 00000100:00100000:1.0:1746143781.695068:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12157 00000100:00100000:1.0:1746143781.695074:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+75:3773:x1830963626796928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.695108:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226666c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.695137:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3773:x1830963626796928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (447us total) trans 21474840398 rc 0/0 00000100:00100000:1.0:1746143781.695142:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12157 00000100:00100000:0.0:1746143781.695292:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626796544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.695303:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626797056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.695327:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.695360:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626797056 00000100:00100000:0.0:1746143781.695363:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626797056 00000100:00100000:0.0:1746143781.695380:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12158 00000100:00100000:0.0:1746143781.695385:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3774:x1830963626797056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.695447:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3774:x1830963626797056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (120us total) trans 21474840399 rc 0/0 00000100:00100000:0.0:1746143781.695453:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12158 00000004:00080000:0.0:1746143781.695470:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093727480/2, rc 0, transno 21474840399 00000100:00100000:0.0:1746143781.695473:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626797056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143781.695488:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e490000/2, rc 0, transno 21474840392 00000100:00100000:0.0:1746143781.695491:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626795648:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143781.695498:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e490a80/2, rc 0, transno 21474840393 00000100:00100000:0.0:1746143781.695500:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626796288:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143781.695506:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e58380/2, rc 0, transno 21474840394 00000100:00100000:0.0:1746143781.695509:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626796800:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143781.695516:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e493b80/2, rc 0, transno 21474840391 00000100:00100000:0.0:1746143781.695518:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626796672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143781.695525:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e0e00/2, rc 0, transno 17179873063 00000100:00100000:0.0:1746143781.695527:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626795776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143781.695534:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e1f80/2, rc 0, transno 17179873060 00000100:00100000:0.0:1746143781.695536:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626796160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143781.695741:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e59c00/2, rc 0, transno 21474840398 00000100:00100000:3.0:1746143781.695744:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626796928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.698327:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626795392:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.698379:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47a200/0x87925e4cb73a9c7b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 262 pid: 7244 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746143781.698401:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 261 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.698409:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 261 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.698439:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012224fa00, rc 0) 00000100:00100000:2.0:1746143781.698499:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+261:32292:x1830963622643968:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 14221us (14466us total) trans 8589943698 rc 0/0 00000100:00100000:2.0:1746143781.698506:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12937 00000100:00100000:2.0:1746143781.700606:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.700637:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622644608 00000100:00100000:1.0:1746143781.700650:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622644608 00010000:00010000:1.0:1746143781.700687:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 261 pid: 7244 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.700692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.700770:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622644480 00000100:00100000:3.0:1746143781.700774:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622644480 00000100:00100000:3.0:1746143781.700802:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12939 00000100:00100000:3.0:1746143781.700809:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32292:x1830963622644480:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143781.700830:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.700845:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b667 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.701013:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5741 00000100:00100000:1.0:1746143781.701020:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:2008:x1830963622644608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.701033:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.701039:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 263 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.701056:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 263 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.701073:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012224fa00/0x87925e4cb73a9c82 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b659 expref: 263 pid: 7244 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.701097:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.701102:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.701111:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.701117:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.701296:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.701306:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.701320:0:7244:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 5/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.701330:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.701331:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143781.701341:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.701343:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143781.701346:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.701352:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137a00, rc 0) 00000100:00100000:1.0:1746143781.701383:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:2008:x1830963622644608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 362us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.701389:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5741 00010000:00010000:2.0:1746143781.701403:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.701410:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143781.701430:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+261:32292:x1830963622644480:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 620us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.701436:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12939 00000040:00080000:2.0:1746143781.701736:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2708, 88 off226024 00000004:00080000:2.0:1746143781.701742:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840925829421ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.701777:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2666, 88 off222680 00000004:00080000:2.0:1746143781.701781:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840925868328ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.701806:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2667, 88 off222768 00000004:00080000:2.0:1746143781.701809:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840925896729ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.701817:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2709, 88 off226112 00000004:00080000:2.0:1746143781.701820:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840925907993ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.701827:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2710, 88 off226200 00000004:00080000:2.0:1746143781.701830:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840925917540ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.701838:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2668, 88 off222856 00000004:00080000:2.0:1746143781.701840:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840925927770ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.701847:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2669, 88 off222944 00000004:00080000:2.0:1746143781.701849:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840925937121ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.701856:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2670, 88 off223032 00000004:00080000:2.0:1746143781.701858:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840925946280ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.701865:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2711, 88 off226288 00000004:00080000:2.0:1746143781.701868:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840925955513ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.701874:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2671, 88 off223120 00000004:00080000:2.0:1746143781.701877:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840925964970ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.701895:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2712, 88 off226376 00000004:00080000:2.0:1746143781.701898:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840925985909ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.701906:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2672, 88 off223208 00000004:00080000:2.0:1746143781.701908:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840925996168ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143781.701937:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2713, 88 off226464 00000004:00080000:2.0:1746143781.701941:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840926028519ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.701951:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2714, 88 off226552 00000004:00080000:2.0:1746143781.701954:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840926041851ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.702599:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2715, 88 off226640 00000004:00080000:2.0:1746143781.702605:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840926692479ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.702631:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2716, 88 off226728 00000004:00080000:2.0:1746143781.702635:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 840926722526ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143781.702645:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2673, 88 off223296 00000004:00080000:2.0:1746143781.702647:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 840926734981ns, next at 770855090093ns, rc = 0 00000001:00080000:3.0:1746143781.710637:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943699 is committed 00000004:00080000:3.0:1746143781.710653:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1902 committed 00000004:00080000:3.0:1746143781.710672:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1943 committed 00000100:00100000:2.0:1746143781.711031:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626797312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.711069:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626797568:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143781.711099:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1942 committed 00000004:00080000:3.0:1746143781.711102:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1941 committed 00000004:00080000:3.0:1746143781.711103:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1940 committed 00000004:00080000:3.0:1746143781.711106:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1901 committed 00000004:00080000:3.0:1746143781.711107:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1939 committed 00000004:00080000:3.0:1746143781.711109:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1900 committed 00000004:00080000:3.0:1746143781.711111:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1938 committed 00000004:00080000:3.0:1746143781.711113:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1899 committed 00000004:00080000:3.0:1746143781.711115:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1898 committed 00000004:00080000:3.0:1746143781.711117:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1897 committed 00000004:00080000:3.0:1746143781.711118:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1937 committed 00000004:00080000:3.0:1746143781.711119:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1936 committed 00000004:00080000:3.0:1746143781.711120:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1896 committed 00000004:00080000:3.0:1746143781.711122:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1895 committed 00000004:00080000:3.0:1746143781.711123:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1935 committed 00000100:00100000:3.0:1746143781.711138:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626797440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.712163:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626797184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.712678:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.712742:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626798080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.712770:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.712794:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626798592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.712810:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.712821:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626799104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.712833:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.712845:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143781.712849:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626798976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.712864:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143781.712901:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626797568 00000100:00100000:0.0:1746143781.712908:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626797568 00000100:00100000:0.0:1746143781.712958:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626798080 00000100:00100000:0.0:1746143781.712960:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626798080 00000100:00100000:0.0:1746143781.712971:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626798592 00000100:00100000:0.0:1746143781.712973:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626798592 00000100:00100000:0.0:1746143781.712983:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626799104 00000100:00100000:0.0:1746143781.712985:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626799104 00000100:00100000:0.0:1746143781.712994:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626798976 00000100:00100000:0.0:1746143781.712995:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626798976 00000100:00100000:0.0:1746143781.713008:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12159 00000100:00100000:0.0:1746143781.713014:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+78:3774:x1830963626797568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143781.713156:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:0.0:1746143781.713160:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.713162:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.713164:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.713165:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00000100:00100000:0.0:1746143781.713196:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+79:3774:x1830963626797568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (521us total) trans 21474840400 rc 0/0 00000100:00100000:0.0:1746143781.713202:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12159 00000100:00100000:0.0:1746143781.713215:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12160 00000100:00100000:0.0:1746143781.713220:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+78:3774:x1830963626798080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143781.713262:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143781.713264:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143781.713266:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143781.713267:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143781.713269:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143781.713286:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+79:3774:x1830963626798080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (515us total) trans 21474840401 rc 0/0 00000100:00100000:0.0:1746143781.713291:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12160 00000100:00100000:0.0:1746143781.713300:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12161 00000100:00100000:0.0:1746143781.713304:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:3774:x1830963626798592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143781.713374:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143781.713377:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143781.713379:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:0.0:1746143781.713381:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143781.713382:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143781.713400:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:3774:x1830963626798592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (588us total) trans 17179873065 rc 0/0 00000100:00100000:0.0:1746143781.713405:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12161 00000100:00100000:0.0:1746143781.713414:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12162 00000100:00100000:0.0:1746143781.713417:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:3774:x1830963626799104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.713463:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:3774:x1830963626799104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (629us total) trans 17179873066 rc 0/0 00000100:00100000:0.0:1746143781.713468:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12162 00000100:00100000:0.0:1746143781.713475:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12163 00000100:00100000:0.0:1746143781.713479:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:3774:x1830963626798976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143781.713520:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:3774:x1830963626798976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (656us total) trans 17179873067 rc 0/0 00000100:00100000:0.0:1746143781.713525:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12163 00000004:00080000:0.0:1746143781.713563:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c31f80/2, rc 0, transno 17179873067 00000100:00100000:0.0:1746143781.713567:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626798976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143781.713574:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c32d80/2, rc 0, transno 17179873065 00000100:00100000:0.0:1746143781.713576:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626798592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143781.713581:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c32680/2, rc 0, transno 17179873066 00000100:00100000:0.0:1746143781.713583:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626799104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143781.713590:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5ad80/2, rc 0, transno 21474840400 00000100:00100000:0.0:1746143781.713595:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626797568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143781.713601:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e59500/2, rc 0, transno 21474840401 00000100:00100000:0.0:1746143781.713603:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626798080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.713936:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.713951:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.713955:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626797952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.713976:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143781.713978:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626797824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.713987:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626798464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.713998:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.714010:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626797440 00000100:00100000:3.0:1746143781.714013:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626797440 00000100:00100000:2.0:1746143781.714013:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626798336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.714026:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.714032:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626797312 00000100:00100000:3.0:1746143781.714033:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626797312 00000100:00100000:2.0:1746143781.714034:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626798848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.714043:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626797952 00000100:00100000:3.0:1746143781.714044:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626797952 00000100:00100000:2.0:1746143781.714045:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.714051:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626797824 00000100:00100000:3.0:1746143781.714052:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626797824 00000100:00100000:2.0:1746143781.714052:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746143781.714057:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626799232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.714059:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626798336 00000100:00100000:3.0:1746143781.714060:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626798336 00000100:00100000:3.0:1746143781.714066:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626798848 00000100:00100000:3.0:1746143781.714067:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626798848 00000100:00100000:2.0:1746143781.714068:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143781.714073:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626799232 00000100:00100000:3.0:1746143781.714075:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626799232 00000100:00100000:3.0:1746143781.714084:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12164 00000100:00100000:3.0:1746143781.714089:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:3773:x1830963626797440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.714089:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12165 00000100:00100000:2.0:1746143781.714096:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+83:3772:x1830963626797312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143781.714140:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143781.714143:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.714144:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.714146:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.714148:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:2.0:1746143781.714152:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143781.714155:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.714157:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.714159:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.714161:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:3.0:1746143781.714169:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3773:x1830963626797440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (234us total) trans 21474840402 rc 0/0 00000100:00100000:3.0:1746143781.714175:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12164 00000100:00100000:2.0:1746143781.714182:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3772:x1830963626797312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (231us total) trans 21474840403 rc 0/0 00000100:00100000:3.0:1746143781.714187:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12166 00000100:00100000:3.0:1746143781.714192:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3773:x1830963626797952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.714214:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.714227:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626797696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143781.714242:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.714250:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626798208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143781.714252:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3773:x1830963626797952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (275us total) trans 21474840404 rc 0/0 00000100:00100000:1.0:1746143781.714262:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.714268:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626798720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143781.714281:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143781.714298:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626797184 00000100:00100000:1.0:1746143781.714301:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626797184 00000100:00100000:2.0:1746143781.714329:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12165 00000100:00100000:2.0:1746143781.714340:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626797696 00000100:00100000:2.0:1746143781.714343:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626797696 00000100:00100000:2.0:1746143781.714351:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626798208 00000100:00100000:2.0:1746143781.714353:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626798208 00000100:00100000:2.0:1746143781.714359:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626798720 00000100:00100000:2.0:1746143781.714361:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626798720 00000100:00100000:2.0:1746143781.714368:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12167 00000100:00100000:2.0:1746143781.714372:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:3772:x1830963626797824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.714424:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+87:3772:x1830963626797824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (425us total) trans 21474840405 rc 0/0 00000100:00100000:2.0:1746143781.714430:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12167 00000100:00100000:2.0:1746143781.714439:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12168 00000100:00100000:2.0:1746143781.714443:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3772:x1830963626798336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143781.714479:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143781.714481:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.714483:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.714485:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:2.0:1746143781.714487:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746143781.714503:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3772:x1830963626798336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (475us total) trans 17179873068 rc 0/0 00000100:00100000:2.0:1746143781.714508:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12168 00000100:00100000:2.0:1746143781.714516:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12169 00000100:00100000:2.0:1746143781.714520:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3772:x1830963626798848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.714565:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3772:x1830963626798848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (519us total) trans 17179873069 rc 0/0 00000100:00100000:2.0:1746143781.714570:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12169 00000100:00100000:2.0:1746143781.714579:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12170 00000100:00100000:2.0:1746143781.714583:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:3772:x1830963626799232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.714626:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+87:3772:x1830963626799232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (557us total) trans 21474840406 rc 0/0 00000100:00100000:2.0:1746143781.714631:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12170 00000100:00100000:2.0:1746143781.714640:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12171 00000100:00100000:2.0:1746143781.714643:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:3771:x1830963626797696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.714692:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+87:3771:x1830963626797696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (448us total) trans 21474840407 rc 0/0 00000100:00100000:2.0:1746143781.714697:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12171 00000100:00100000:2.0:1746143781.714708:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12172 00000100:00100000:2.0:1746143781.714712:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:3771:x1830963626798208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.714756:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+87:3771:x1830963626798208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (493us total) trans 21474840408 rc 0/0 00000100:00100000:2.0:1746143781.714761:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12172 00000100:00100000:2.0:1746143781.714770:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12173 00000100:00100000:2.0:1746143781.714774:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3771:x1830963626798720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143781.714810:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143781.714812:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143781.714814:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143781.714815:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143781.714817:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746143781.714834:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3771:x1830963626798720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (552us total) trans 17179873070 rc 0/0 00000100:00100000:2.0:1746143781.714839:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12173 00010000:00010000:2.0:1746143781.714928:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b660 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.715043:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12166 00000100:00100000:3.0:1746143781.715055:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12174 00000100:00100000:3.0:1746143781.715059:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3771:x1830963626797184:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143781.715087:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5aa00/2, rc 0, transno 21474840407 00000100:00100000:1.0:1746143781.715092:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626797696:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143781.715097:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00000004:00080000:1.0:1746143781.715099:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e58000/2, rc 0, transno 21474840408 00002000:00010000:3.0:1746143781.715100:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.715101:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00000100:00100000:1.0:1746143781.715102:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626798208:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143781.715103:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143781.715105:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000004:00080000:1.0:1746143781.715108:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c33b80/2, rc 0, transno 17179873070 00000100:00100000:1.0:1746143781.715111:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626798720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.715201:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3771:x1830963626797184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (985us total) trans 17179873071 rc 0/0 00000100:00100000:3.0:1746143781.715206:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12174 00000004:00080000:1.0:1746143781.715219:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c31880/2, rc 0, transno 17179873071 00000100:00100000:1.0:1746143781.715223:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626797184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143781.715229:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143781.715261:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5bb80/2, rc 0, transno 21474840402 00000100:00100000:3.0:1746143781.715264:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626797440:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143781.715276:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5b800/2, rc 0, transno 21474840404 00000100:00100000:3.0:1746143781.715278:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626797952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143781.715320:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626798464 00000100:00100000:0.0:1746143781.715324:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626798464 00010000:00010000:2.0:1746143781.715330:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.715333:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143781.715338:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 260 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.715342:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12175 00000100:00100000:0.0:1746143781.715347:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3773:x1830963626798464:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143781.715348:0:14991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 260 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.715355:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 260 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.715381:0:14991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 260 pid: 7244 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143781.715391:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:2.0:1746143781.715392:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626799360:192.168.202.3@tcp:105: 00002000:00010000:0.0:1746143781.715393:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.715395:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.715397:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143781.715398:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143781.715434:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:3773:x1830963626798464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (204us total) trans 17179873072 rc 0/0 00000100:00100000:0.0:1746143781.715439:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12175 00000004:00080000:3.0:1746143781.715496:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c30380/2, rc 0, transno 17179873072 00000100:00100000:3.0:1746143781.715500:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626798464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143781.716495:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000004:00080000:2.0:1746143781.716536:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e59180/2, rc 0, transno 21474840406 00000100:00100000:2.0:1746143781.716541:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626799232:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143781.716548:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5a300/2, rc 0, transno 21474840405 00000100:00100000:2.0:1746143781.716551:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626797824:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143781.716559:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c32a00/2, rc 0, transno 17179873068 00000100:00100000:2.0:1746143781.716561:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626798336:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143781.716569:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c33800/2, rc 0, transno 17179873069 00000100:00100000:2.0:1746143781.716571:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626798848:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143781.716579:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e59f80/2, rc 0, transno 21474840403 00000100:00100000:2.0:1746143781.716583:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626797312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143781.719318:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626799360:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143781.719366:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522200/0x87925e4cb73a9c89 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b660 expref: 9 pid: 14991 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746143781.720086:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143781.720190:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b660 expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.720228:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189dc00, rc 0) 00000100:00100000:3.0:1746143781.720229:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622644736 00000100:00100000:3.0:1746143781.720237:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622644736 00000100:00100000:2.0:1746143781.720278:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32294:x1830963622644224:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 35604us (36077us total) trans 8589943699 rc 0/0 00000100:00100000:3.0:1746143781.720284:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4753 00000100:00100000:2.0:1746143781.720286:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12938 00000100:00100000:3.0:1746143781.720292:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b497850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+261:32292:x1830963622644736:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:3.0:1746143781.720630:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b497850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+261:32292:x1830963622644736:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 338us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.720636:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4753 00000100:00100000:0.0:1746143781.723897:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.723977:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622644864 00000100:00100000:2.0:1746143781.723985:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622644864 00000100:00100000:2.0:1746143781.724031:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12176 00000100:00100000:2.0:1746143781.724038:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:32294:x1830963622644864:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143781.724057:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.724074:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b66e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.724103:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1600/0x87925e4cb73a9bc5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e2 expref: 23 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.724112:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0600/0x87925e4cb73a9bcc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e9 expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.724118:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.724121:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.724124:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3506176->4157439] (req 3506176->4157439) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.724153:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c0600/0x87925e4cb73a9bcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e9 expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.724164:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0600/0x87925e4cb73a9bcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e9 expref: 43 pid: 13430 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.724174:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626799488:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.724254:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c1600/0x87925e4cb73a9bc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e2 expref: 23 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.724261:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1600/0x87925e4cb73a9bc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e2 expref: 23 pid: 1947 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.724269:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626799616:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.724285:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.728516:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626799488:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.728529:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626799616:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.728563:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3506176->4157439] (req 3506176->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.728580:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7800, rc 0) 00000100:00100000:2.0:1746143781.728636:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32294:x1830963622644864:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4597us (4760us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.728646:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12176 00000100:00100000:1.0:1746143781.730581:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.730645:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622644992 00000100:00100000:2.0:1746143781.730653:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622644992 00010000:00010000:2.0:1746143781.730695:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0600/0x87925e4cb73a9bcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e9 expref: 44 pid: 13430 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.730715:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.732076:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622645120 00000100:00100000:2.0:1746143781.732081:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622645120 00010000:00010000:2.0:1746143781.732100:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1600/0x87925e4cb73a9bc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e2 expref: 23 pid: 1947 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.732148:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.732200:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5742 00000100:00100000:3.0:1746143781.732212:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622644992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.732226:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.732247:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c0600/0x87925e4cb73a9bcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e9 expref: 44 pid: 13430 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.732258:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c0600/0x87925e4cb73a9bcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e9 expref: 44 pid: 13430 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.732282:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0600/0x87925e4cb73a9bcc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e9 expref: 44 pid: 13430 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.732302:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.732351:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963622644992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 142us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.732358:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5742 00000100:00100000:3.0:1746143781.732374:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5743 00000100:00100000:3.0:1746143781.732379:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622645120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143781.732385:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143781.732391:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1600/0x87925e4cb73a9bc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e2 expref: 23 pid: 1947 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.732401:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c1600/0x87925e4cb73a9bc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e2 expref: 23 pid: 1947 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.732412:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1600/0x87925e4cb73a9bc5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5e2 expref: 23 pid: 1947 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143781.732421:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.732423:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143781.732430:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.732438:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.732616:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622645248 00000100:00100000:2.0:1746143781.732619:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622645248 00000100:00100000:2.0:1746143781.732656:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12177 00000100:00100000:2.0:1746143781.732661:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:32292:x1830963622645248:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143781.732677:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.732691:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b675 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.732712:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9bfd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5fe expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.732720:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9c19 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b613 expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.732726:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.732727:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.732732:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4046848->4194303] (req 4046848->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.732754:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9c19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b613 expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.732764:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9c19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b613 expref: 31 pid: 13430 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.732776:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626799744:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.733054:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.733064:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626799872:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143781.733191:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9bfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5fe expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.733200:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9bfd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5fe expref: 42 pid: 13430 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.733208:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626800000:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.733282:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.733455:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.735286:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.735306:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626799744:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143781.735311:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.735316:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963626800000:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.735344:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4046848->4194303] (req 4046848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.735355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143781.735359:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6600, rc 0) 00000100:00100000:0.0:1746143781.735375:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622645376 00000100:00100000:0.0:1746143781.735381:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622645376 00000100:00100000:2.0:1746143781.735392:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:32292:x1830963622645248:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2730us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.735404:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12177 00010000:00010000:0.0:1746143781.735407:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9c19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b613 expref: 32 pid: 13430 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.735430:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622645760 00000100:00100000:0.0:1746143781.735432:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622645760 00000100:00100000:2.0:1746143781.735437:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5744 00010000:00010000:0.0:1746143781.735442:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9bfd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5fe expref: 42 pid: 13430 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143781.735444:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622645376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143781.735454:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5745 00010000:00010000:2.0:1746143781.735455:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143781.735459:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622645760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143781.735465:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.735474:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9c19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b613 expref: 32 pid: 13430 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.735474:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9bfd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5fe expref: 42 pid: 13430 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.735482:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9bfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5fe expref: 42 pid: 13430 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.735538:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963626799872:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143781.735548:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143781.735563:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2011:x1830963622645120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3184us (4849us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.735570:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5743 00000100:00100000:1.0:1746143781.735627:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622645632 00000100:00100000:1.0:1746143781.735631:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622645632 00002000:00100000:1.0:1746143781.735660:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3506176->3510271) req@ffff880129dc1180 x1830963622645632/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.735668:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1180 with x1830963622645632 ext(3506176->3510271) 00002000:00010000:1.0:1746143781.735672:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1180 00000100:00100000:1.0:1746143781.735694:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3534 00000100:00100000:1.0:1746143781.735699:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622645632:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143781.735805:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622645632:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 105us (493us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143781.735814:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3534 00002000:00100000:1.0:1746143781.735819:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (3506176->3510271) req@ffff880129dc1180 x1830963622645632/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.735826:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1180 with x1830963622645632 ext(3506176->3510271) 00002000:00010000:1.0:1746143781.735828:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1180 00010000:00010000:2.0:1746143781.736122:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9c19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b613 expref: 32 pid: 13430 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143781.736145:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9bfd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b5fe expref: 42 pid: 13430 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.736161:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9c19 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b613 expref: 32 pid: 13430 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.736181:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.736183:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.736189:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.736196:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.736241:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.736252:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626800128:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143781.736314:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.736373:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.736430:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622645760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 969us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143781.736436:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5745 00000100:00100000:2.0:1746143781.740539:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626800128:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143781.740566:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.740621:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622645376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5176us (5341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.740630:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5744 00000100:00100000:0.0:1746143781.741476:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.741871:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622646016 00000100:00100000:1.0:1746143781.741887:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622646016 00002000:00100000:1.0:1746143781.741955:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4046848->4050943) req@ffff880129dc0a80 x1830963622646016/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.741965:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0a80 with x1830963622646016 ext(4046848->4050943) 00002000:00010000:1.0:1746143781.741970:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc0a80 00000100:00100000:1.0:1746143781.742715:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3535 00000100:00100000:1.0:1746143781.742723:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622646016:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143781.743373:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622646016:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 649us (1898us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143781.743380:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3535 00002000:00100000:1.0:1746143781.743387:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4046848->4050943) req@ffff880129dc0a80 x1830963622646016/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.743395:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0a80 with x1830963622646016 ext(4046848->4050943) 00002000:00010000:1.0:1746143781.743400:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc0a80 00000100:00100000:0.0:1746143781.748432:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.748541:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622646272 00000100:00100000:1.0:1746143781.748552:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622646272 00002000:00100000:1.0:1746143781.748602:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (4153344->4157439) req@ffff880129dc2300 x1830963622646272/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.748618:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2300 with x1830963622646272 ext(4153344->4157439) 00002000:00010000:1.0:1746143781.748625:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc2300 00000100:00100000:2.0:1746143781.749253:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3536 00000100:00100000:2.0:1746143781.749266:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622646272:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143781.749438:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622646272:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 175us (1017us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143781.749445:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3536 00002000:00100000:2.0:1746143781.749450:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (4153344->4157439) req@ffff880129dc2300 x1830963622646272/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.749458:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2300 with x1830963622646272 ext(4153344->4157439) 00002000:00010000:2.0:1746143781.749461:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc2300 00000100:00100000:2.0:1746143781.749520:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.749520:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.749675:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622646656 00000100:00100000:3.0:1746143781.749793:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622646656 00000100:00100000:3.0:1746143781.749837:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12940 00000100:00100000:3.0:1746143781.750175:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+261:32301:x1830963622646656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.750190:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.750210:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73a9cac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b683 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.750279:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750291:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750305:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750317:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9cba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750322:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750327:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750422:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750430:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750435:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143781.750442:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143781.750512:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750517:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750522:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750527:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750531:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd87000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143781.750534:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750539:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750548:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143781.750550:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143781.750554:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750558:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73a9cb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750589:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750593:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9cba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750597:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9cba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750600:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c1a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143781.750602:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9cba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750606:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9cba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750610:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e624800) 00010000:00010000:3.0:1746143781.750611:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143781.750613:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9cba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750616:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73a9cba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.750645:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73a9cac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b683 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.750654:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b683 expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.750659:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.750661:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143781.750663:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0c00, rc 0) 00000100:00100000:3.0:1746143781.750699:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+263:32301:x1830963622646656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 856us (1179us total) trans 8589943700 rc 0/0 00000100:00100000:3.0:1746143781.750705:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12940 00000100:00100000:3.0:1746143781.750733:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622646400 00000100:00100000:3.0:1746143781.750736:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622646400 00000100:00100000:3.0:1746143781.750764:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12178 00000100:00100000:3.0:1746143781.750769:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:32292:x1830963622646400:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143781.750777:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.751177:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b67c expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.751200:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.751207:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.751209:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.751212:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->3727359] (req 3145728->3727359) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 44 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.751242:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.751255:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 21 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143781.751268:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626800256:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.751486:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.752843:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626800256:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.752867:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->3727359] (req 3145728->3727359) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 44 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.752892:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd86600, rc 0) 00000100:00100000:3.0:1746143781.752978:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:32292:x1830963622646400:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2208us (3457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.752985:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12178 00000100:00100000:0.0:1746143781.753447:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.753502:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622646784 00000100:00100000:3.0:1746143781.753508:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622646784 00000100:00100000:3.0:1746143781.753553:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12179 00000100:00100000:3.0:1746143781.753560:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622646784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.753574:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.753585:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9cd6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b68a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.753625:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626800384:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143781.753715:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143781.754666:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.754799:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622647168 00000100:00100000:3.0:1746143781.754804:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622647168 00002000:00010000:2.0:1746143781.754826:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143781 -> 1746143782 00002000:00010000:2.0:1746143781.754830:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143781 -> 1746143782 00000100:00100000:3.0:1746143781.754846:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4754 00000100:00100000:2.0:1746143781.754848:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626800384:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143781.754852:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32294:x1830963622647168:12345-192.168.202.3@tcp:35:multiop.0 00010000:00010000:2.0:1746143781.754867:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9cd6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b68a expref: 45 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.754877:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9cd6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b68a expref: 45 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.754926:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb5600, rc 0) 00000100:00100000:2.0:1746143781.754953:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622646784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1394us (1507us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143781.754958:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12179 00000100:00100000:3.0:1746143781.755283:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32294:x1830963622647168:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 431us (617us total) trans 8589943701 rc 0/0 00000100:00100000:3.0:1746143781.755293:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4754 00000100:00100000:0.0:1746143781.755551:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.755600:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622647296 00000100:00100000:2.0:1746143781.755602:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622647296 00002000:00100000:2.0:1746143781.755626:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (3506176->4157439) req@ffff880129dc2680 x1830963622647296/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.755633:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2680 with x1830963622647296 ext(3506176->4157439) 00010000:00010000:2.0:1746143781.755639:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 22 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.755647:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 22 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143781.755651:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129dc2680 00000100:00100000:2.0:1746143781.755768:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1471 00000100:00100000:2.0:1746143781.755773:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622647296:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143781.764191:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622647296:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8405us (8627us total) trans 17179873073 rc 0/0 00000100:00100000:2.0:1746143781.764204:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1471 00002000:00100000:2.0:1746143781.764217:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (3506176->4157439) req@ffff880129dc2680 x1830963622647296/t17179873073(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/448 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.764228:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2680 with x1830963622647296 ext(3506176->4157439) 00010000:00010000:2.0:1746143781.764238:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 24 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143781.764258:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 24 pid: 9586 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143781.764264:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129dc2680 00000100:00100000:0.0:1746143781.767994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.768029:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.768065:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622647552 00000100:00100000:1.0:1746143781.768076:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622647552 00002000:00100000:1.0:1746143781.768124:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880129dc0000 x1830963622647552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.768134:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0000 with x1830963622647552 ext(0->1048575) 00002000:00010000:1.0:1746143781.768139:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc0000 00000100:00100000:1.0:1746143781.768166:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622647808 00000100:00100000:1.0:1746143781.768169:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622647808 00002000:00100000:1.0:1746143781.768180:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880129dc2a00 x1830963622647808/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143781.768186:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2a00 with x1830963622647808 ext(1048576->2097151) 00002000:00010000:1.0:1746143781.768189:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc2a00 00000100:00100000:1.0:1746143781.768201:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3537 00000100:00100000:1.0:1746143781.768207:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622647552:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.768213:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3538 00000100:00100000:2.0:1746143781.768222:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622647808:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143781.768967:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.768989:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622647936 00000100:00100000:1.0:1746143781.768993:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622647936 00010000:00010000:1.0:1746143781.769011:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 24 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143781.769030:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5746 00000100:00100000:1.0:1746143781.769035:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2011:x1830963622647936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.769048:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.769064:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 24 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.769077:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 24 pid: 9586 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143781.769094:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143781.769098:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7800/0x87925e4cb73a9c9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->4157439) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b66e expref: 24 pid: 9586 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143781.769124:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143781.769126:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143781.769148:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622648320 00000100:00100000:3.0:1746143781.769152:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622648320 00010000:00010000:1.0:1746143781.769173:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143781.769174:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880129dc0380 x1830963622648320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143781.769182:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143781.769187:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0380 with x1830963622648320 ext(1048576->2097151) 00002000:00010000:3.0:1746143781.769191:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc0380 00000100:00100000:3.0:1746143781.769213:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3539 00000100:00100000:3.0:1746143781.769218:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963622648320:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:1.0:1746143781.769229:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143781.769237:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.769250:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093070700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626800512:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143781.769260:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622648576 00000100:00100000:2.0:1746143781.769264:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622648576 00002000:00100000:2.0:1746143781.769282:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880129dc1880 x1830963622648576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.769289:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1880 with x1830963622648576 ext(1048576->2097151) 00002000:00010000:2.0:1746143781.769293:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc1880 00000100:00100000:2.0:1746143781.769313:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3540 00000100:00100000:2.0:1746143781.769318:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963622648576:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143781.769331:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffafe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.777520:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093070700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626800512:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143781.777547:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.777612:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2011:x1830963622647936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8575us (8645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.777613:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963622647552:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9403us (9632us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143781.777624:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3537 00000100:00100000:1.0:1746143781.777624:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5746 00002000:00100000:2.0:1746143781.777635:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880129dc0000 x1830963622647552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.777646:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0000 with x1830963622647552 ext(0->1048575) 00002000:00010000:2.0:1746143781.777651:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc0000 00000100:00100000:0.0:1746143781.780833:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.780969:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622648832 00000100:00100000:2.0:1746143781.780980:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622648832 00002000:00100000:2.0:1746143781.781028:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3723264->3727359) req@ffff880129dc1c00 x1830963622648832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.781039:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1c00 with x1830963622648832 ext(3723264->3727359) 00002000:00010000:2.0:1746143781.781044:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1c00 00000100:00100000:2.0:1746143781.781067:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3541 00000100:00100000:2.0:1746143781.781076:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963622648832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.781241:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963622648832:12345-192.168.202.3@tcp:3:cat.0 Request processed in 165us (418us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143781.781248:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3541 00002000:00100000:2.0:1746143781.781253:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3723264->3727359) req@ffff880129dc1c00 x1830963622648832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.781259:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1c00 with x1830963622648832 ext(3723264->3727359) 00002000:00010000:2.0:1746143781.781262:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1c00 00000100:00100000:3.0:1746143781.781439:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963622647808:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13219us (13408us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143781.781445:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3538 00002000:00100000:3.0:1746143781.781450:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880129dc2a00 x1830963622647808/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.781456:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2a00 with x1830963622647808 ext(1048576->2097151) 00002000:00010000:3.0:1746143781.781460:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc2a00 00000100:00100000:3.0:1746143781.784254:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622648320:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15025us (15150us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143781.784478:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3539 00002000:00100000:3.0:1746143781.784495:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880129dc0380 x1830963622648320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.784505:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0380 with x1830963622648320 ext(1048576->2097151) 00002000:00010000:3.0:1746143781.784510:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc0380 00000100:00100000:2.0:1746143781.784676:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963622648576:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15356us (15437us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143781.784684:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3540 00002000:00100000:2.0:1746143781.784689:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880129dc1880 x1830963622648576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.784696:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1880 with x1830963622648576 ext(1048576->2097151) 00002000:00010000:2.0:1746143781.784700:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc1880 00000100:00100000:0.0:1746143781.788697:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.788817:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622649088 00000100:00100000:3.0:1746143781.788828:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622649088 00000100:00100000:3.0:1746143781.788876:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4755 00000100:00100000:3.0:1746143781.788936:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:32292:x1830963622649088:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143781.789827:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:32292:x1830963622649088:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 911us (1412us total) trans 8589943702 rc 0/0 00000100:00100000:3.0:1746143781.789836:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4755 00000100:00100000:0.0:1746143781.811120:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.813105:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.813684:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622649472 00000100:00100000:2.0:1746143781.813695:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622649472 00002000:00100000:2.0:1746143781.813742:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4046847) req@ffff880129dc0e00 x1830963622649472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.813759:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0e00 with x1830963622649472 ext(2097152->4046847) 00002000:00010000:2.0:1746143781.813764:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc0e00 00000100:00100000:2.0:1746143781.813783:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622649600 00000100:00100000:2.0:1746143781.813785:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622649600 00002000:00100000:2.0:1746143781.813796:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8801368e9500 x1830963622649600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 504/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.813802:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9500 with x1830963622649600 ext(2097152->4194303) 00002000:00010000:2.0:1746143781.813805:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e9500 00000100:00100000:2.0:1746143781.813817:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3542 00000100:00100000:2.0:1746143781.813823:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622649472:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143781.814002:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3543 00000100:00100000:0.0:1746143781.814009:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622649600:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143781.835186:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143781.839170:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622649472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25334us (28051us total) trans 0 rc 1949696/1949696 00000100:00100000:2.0:1746143781.839590:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3542 00002000:00100000:2.0:1746143781.839606:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4046847) req@ffff880129dc0e00 x1830963622649472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1949696/1949696 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.839616:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0e00 with x1830963622649472 ext(2097152->4046847) 00002000:00010000:2.0:1746143781.839622:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc0e00 00000100:00100000:3.0:1746143781.842359:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622649600:12345-192.168.202.3@tcp:3:cat.0 Request processed in 28338us (29250us total) trans 0 rc 1515520/1515520 00000100:00100000:3.0:1746143781.842373:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3543 00002000:00100000:3.0:1746143781.842385:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8801368e9500 x1830963622649600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 504/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1515520/1515520 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.842394:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9500 with x1830963622649600 ext(2097152->4194303) 00002000:00010000:3.0:1746143781.842399:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e9500 00000100:00100000:0.0:1746143781.859773:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.862646:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622649856 00000100:00100000:3.0:1746143781.862663:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622649856 00002000:00100000:3.0:1746143781.862722:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8801368e8700 x1830963622649856/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.862732:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8700 with x1830963622649856 ext(4194304->4968447) 00002000:00010000:3.0:1746143781.862739:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e8700 00000100:00100000:3.0:1746143781.862785:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3544 00000100:00100000:3.0:1746143781.862794:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622649856:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143781.864638:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.865988:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622650112 00000100:00100000:3.0:1746143781.866000:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622650112 00000100:00100000:2.0:1746143781.866135:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12941 00000100:00100000:2.0:1746143781.866143:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32307:x1830963622650112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.866168:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.866188:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9cdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b691 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.866269:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.866281:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.866292:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.866303:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7800/0x87925e4cb73a9ceb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.866308:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7800/0x87925e4cb73a9ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.866313:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7800/0x87925e4cb73a9ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.866412:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.866419:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.866424:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143781.866432:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143781.866991:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.866999:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867007:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867012:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867017:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b7400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.867020:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867027:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867038:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143781.867041:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143781.867044:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867049:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9ce4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867079:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7800/0x87925e4cb73a9ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867085:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7800/0x87925e4cb73a9ceb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867090:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7800/0x87925e4cb73a9ceb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867093:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b7800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143781.867095:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7800/0x87925e4cb73a9ceb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867103:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7800/0x87925e4cb73a9ceb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867109:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fee7c00) 00010000:00010000:2.0:1746143781.867111:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143781.867113:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7800/0x87925e4cb73a9ceb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867118:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7800/0x87925e4cb73a9ceb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.867164:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9cdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b691 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.867175:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b691 expref: 11 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.867181:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143781.867182:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143781.867184:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7000, rc 0) 00000100:00100000:2.0:1746143781.867402:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32307:x1830963622650112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1259us (2770us total) trans 8589943703 rc 0/0 00000100:00100000:2.0:1746143781.867411:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12941 00000100:00100000:3.0:1746143781.870548:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622649856:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7746us (10776us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143781.870559:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3544 00002000:00100000:3.0:1746143781.870570:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8801368e8700 x1830963622649856/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.870579:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8700 with x1830963622649856 ext(4194304->4968447) 00002000:00010000:3.0:1746143781.870584:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e8700 00000100:00100000:0.0:1746143781.871596:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.871738:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.872649:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622650240 00000100:00100000:1.0:1746143781.872650:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622650368 00000100:00100000:3.0:1746143781.872660:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622650240 00000100:00100000:1.0:1746143781.872660:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622650368 00000100:00100000:3.0:1746143781.872711:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12180 00000100:00100000:1.0:1746143781.872718:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12181 00000100:00100000:3.0:1746143781.872719:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2011:x1830963622650240:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143781.872725:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622650368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.872733:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.872740:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.872749:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9d00 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b698 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.872753:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0b200/0x87925e4cb73a9d07 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b69f expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.872804:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626800640:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143781.872895:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.873033:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626800768:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143781.873342:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d240 going to sleep for 11 seconds 00002000:00010000:3.0:1746143781.875643:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143781 -> 1746143782 00002000:00010000:1.0:1746143781.875644:0:12327:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143781 -> 1746143782 00002000:00010000:3.0:1746143781.875648:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143781 -> 1746143782 00002000:00010000:3.0:1746143781.875649:0:9585:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143781 -> 1746143782 00000100:00100000:3.0:1746143781.875664:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626800768:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143781.875667:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626800640:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143781.875685:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9d00 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b698 expref: 32 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.875694:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73a9d00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b698 expref: 32 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.875696:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d0b200/0x87925e4cb73a9d07 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b69f expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.875708:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb5600, rc 0) 00010000:00010000:1.0:1746143781.875709:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0b200/0x87925e4cb73a9d07 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b69f expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.875727:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b200, rc 0) 00000100:00100000:3.0:1746143781.875738:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2011:x1830963622650240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3019us (4148us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143781.875745:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12180 00000100:00100000:1.0:1746143781.875765:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2010:x1830963622650368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3039us (4026us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143781.875772:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12181 00000100:00100000:0.0:1746143781.879075:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.879153:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622650624 00000100:00100000:3.0:1746143781.879161:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622650624 00000100:00100000:3.0:1746143781.879207:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4756 00000100:00100000:3.0:1746143781.879214:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:32301:x1830963622650624:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143781.879362:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:32301:x1830963622650624:12345-192.168.202.3@tcp:35:cat.0 Request processed in 148us (293us total) trans 8589943704 rc 0/0 00000100:00100000:3.0:1746143781.879368:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4756 00000100:00100000:0.0:1746143781.884624:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.884734:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622650880 00000100:00100000:2.0:1746143781.884744:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622650880 00000100:00100000:2.0:1746143781.884798:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12942 00000100:00100000:2.0:1746143781.884808:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32309:x1830963622650880:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143781.884896:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.885048:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9d0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6a6 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.885158:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.885174:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b683 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.885181:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b691 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.885189:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143781.885221:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b691 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.885233:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b691 expref: 12 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143781.885246:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626800896:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143781.887959:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b683 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.887977:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b683 expref: 264 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143781.887991:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626801024:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143781.888089:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.888717:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626800896:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143781.889981:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.890080:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622651008 00000100:00100000:1.0:1746143781.890089:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622651008 00010000:00010000:1.0:1746143781.890127:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b691 expref: 13 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143781.890505:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5747 00000100:00100000:1.0:1746143781.890515:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622651008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.890529:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.890535:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b691 expref: 13 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143781.890546:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b691 expref: 13 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143781.890569:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9cf2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b691 expref: 13 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143781.891386:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.891393:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.891401:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.891405:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.891457:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622651008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 942us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.891465:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5747 00000100:00100000:3.0:1746143781.892293:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093724700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963626801024:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.892329:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143781.892379:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.892489:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622651136 00000100:00100000:1.0:1746143781.892495:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622651136 00010000:00010000:1.0:1746143781.892517:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b683 expref: 265 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143781.892549:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5748 00000100:00100000:1.0:1746143781.892555:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+265:2008:x1830963622651136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143781.892566:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143781.892570:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b683 expref: 265 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143781.892580:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b683 expref: 265 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143781.892599:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9cc1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b683 expref: 265 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143781.892609:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143781.892612:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.892618:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.892625:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143781.892655:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143781.892677:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+264:2008:x1830963622651136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 122us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143781.892683:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5748 00010000:00010000:3.0:1746143781.892825:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143781.892831:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143781.892853:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143781.893017:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73a9d0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6a6 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.893038:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6a6 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.893044:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143781.893047:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143781.893049:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6000, rc 0) 00000100:00100000:3.0:1746143781.893087:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32309:x1830963622650880:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8281us (8476us total) trans 8589943705 rc 0/0 00000100:00100000:3.0:1746143781.893092:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12942 00000100:00100000:0.0:1746143781.894513:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.894706:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622651392 00000100:00100000:3.0:1746143781.894713:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622651392 00002000:00100000:3.0:1746143781.894755:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880136acbb80 x1830963622651392/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.894764:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acbb80 with x1830963622651392 ext(0->1048575) 00002000:00010000:3.0:1746143781.894769:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136acbb80 00000100:00100000:3.0:1746143781.894798:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3545 00000100:00100000:3.0:1746143781.894805:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622651392:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143781.895770:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.895935:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622651648 00000100:00100000:2.0:1746143781.895940:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622651648 00002000:00100000:2.0:1746143781.895969:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880136ac8000 x1830963622651648/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.895978:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8000 with x1830963622651648 ext(1048576->2097151) 00002000:00010000:2.0:1746143781.895982:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac8000 00000100:00100000:2.0:1746143781.895996:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3546 00000100:00100000:2.0:1746143781.896002:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622651648:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143781.896760:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.896794:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.896823:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622652032 00000100:00100000:3.0:1746143781.896828:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622652032 00000100:00100000:2.0:1746143781.896832:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622652160 00000100:00100000:2.0:1746143781.896836:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622652160 00002000:00100000:3.0:1746143781.896851:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093070e00 x1830963622652032/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.896854:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880093070700 x1830963622652160/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.896860:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070e00 with x1830963622652032 ext(1048576->2097151) 00002000:00100000:2.0:1746143781.896861:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070700 with x1830963622652160 ext(1048576->2097151) 00002000:00010000:3.0:1746143781.896864:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093070e00 00002000:00010000:2.0:1746143781.896865:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093070700 00000100:00100000:3.0:1746143781.896895:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3547 00000100:00100000:2.0:1746143781.897080:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3548 00000100:00100000:3.0:1746143781.897083:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622652032:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.897085:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2008:x1830963622652160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143781.906414:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2009:x1830963622651392:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11596us (11892us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143781.906427:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3545 00002000:00100000:3.0:1746143781.906441:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880136acbb80 x1830963622651392/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.906451:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acbb80 with x1830963622651392 ext(0->1048575) 00002000:00010000:3.0:1746143781.906458:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136acbb80 00000100:00100000:2.0:1746143781.909341:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622651648:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13328us (13562us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143781.909352:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3546 00002000:00100000:2.0:1746143781.909363:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880136ac8000 x1830963622651648/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.909373:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8000 with x1830963622651648 ext(1048576->2097151) 00002000:00010000:2.0:1746143781.909379:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac8000 00000100:00100000:3.0:1746143781.909705:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2008:x1830963622652160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12618us (12909us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143781.909711:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3548 00002000:00100000:3.0:1746143781.909717:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880093070700 x1830963622652160/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.909724:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070700 with x1830963622652160 ext(1048576->2097151) 00002000:00010000:3.0:1746143781.909727:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093070700 00000100:00100000:3.0:1746143781.912794:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622652032:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15703us (16025us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143781.912804:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3547 00002000:00100000:3.0:1746143781.912815:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093070e00 x1830963622652032/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.912824:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093070e00 with x1830963622652032 ext(1048576->2097151) 00002000:00010000:3.0:1746143781.912829:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093070e00 00000100:00100000:0.0:1746143781.923637:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.927219:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.927266:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143781.927359:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622652288 00000100:00100000:1.0:1746143781.927370:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622652288 00000100:00100000:1.0:1746143781.927411:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622652416 00000100:00100000:1.0:1746143781.927413:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622652416 00000100:00100000:1.0:1746143781.927424:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622652544 00000100:00100000:1.0:1746143781.927425:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622652544 00000100:00100000:1.0:1746143781.927439:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12182 00000100:00100000:1.0:1746143781.927448:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32309:x1830963622652288:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143781.927467:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.927485:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6ad expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.927514:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 43 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.927521:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143781.927523:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143781.927526:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [4005888->4194303] (req 4005888->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.927554:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 43 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143781.927567:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 43 pid: 9586 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143781.927579:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093071880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626801152:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143781.927656:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.927753:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12183 00000100:00100000:1.0:1746143781.927759:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622652416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143781.927768:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143781.927777:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9d2a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6b4 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143781.927806:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626801280:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143781.927828:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.927841:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12184 00000100:00100000:2.0:1746143781.927851:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622652544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143781.927859:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143781.927865:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a9d31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6bb expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.927900:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626801408:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143781.927957:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.929305:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626801280:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143781.929332:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9d2a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6b4 expref: 32 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143781.929345:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9d2a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6b4 expref: 32 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143781.929428:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626801408:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143781.929444:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a9d31 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6bb expref: 26 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.929453:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73a9d31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6bb expref: 26 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143781.929464:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3c400, rc 0) 00000100:00100000:2.0:1746143781.929496:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622652544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1647us (2229us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143781.929503:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12184 00000100:00100000:2.0:1746143781.929591:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093071880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626801152:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143781.929689:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2c00, rc 0) 00000100:00100000:1.0:1746143781.929712:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622652416:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1953us (2502us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143781.929718:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12183 00010000:00010000:2.0:1746143781.932155:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [4005888->4194303] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 24 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.932174:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5aa000, rc 0) 00000100:00100000:2.0:1746143781.932236:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32309:x1830963622652288:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4787us (8608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.932247:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12182 00000100:00100000:2.0:1746143781.932544:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.932798:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622652672 00000100:00100000:3.0:1746143781.932806:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622652672 00002000:00100000:3.0:1746143781.932849:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3727359) req@ffff880093724700 x1830963622652672/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.932859:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724700 with x1830963622652672 ext(3145728->3727359) 00010000:00010000:3.0:1746143781.932867:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 44 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143781.932890:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 44 pid: 9586 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143781.932901:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093724700 00000100:00100000:3.0:1746143781.932941:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1472 00000100:00100000:3.0:1746143781.932950:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622652672:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143781.933216:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.933384:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622652800 00000100:00100000:3.0:1746143781.933387:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622652800 00000100:00100000:3.0:1746143781.933407:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12185 00000100:00100000:3.0:1746143781.933412:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:32307:x1830963622652800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.933421:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.933436:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6c2 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.933456:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.933463:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.933465:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.933468:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.933495:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.933504:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 40 pid: 9586 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143781.933514:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626801536:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143781.933570:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143781.937588:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.937726:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626801536:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143781.937759:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.937778:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0c00, rc 0) 00000100:00100000:0.0:1746143781.939459:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622652928 00000100:00100000:0.0:1746143781.939471:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622652928 00002000:00100000:0.0:1746143781.939516:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4046848->4194303) req@ffff88012b1dad80 x1830963622652928/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143781.939525:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1dad80 with x1830963622652928 ext(4046848->4194303) 00010000:00010000:0.0:1746143781.939533:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 41 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143781.939546:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 41 pid: 9586 timeout: 941 lvb_type: 0 00002000:00010000:0.0:1746143781.939553:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1dad80 00000100:00100000:0.0:1746143781.939575:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1473 00000100:00100000:0.0:1746143781.939583:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622652928:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143781.939868:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:32307:x1830963622652800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6452us (6649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.939876:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12185 00000100:00100000:2.0:1746143781.940064:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622652672:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7115us (7519us total) trans 17179873074 rc 0/0 00000100:00100000:2.0:1746143781.940072:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1472 00002000:00100000:2.0:1746143781.940079:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->3727359) req@ffff880093724700 x1830963622652672/t17179873074(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/448 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.940086:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724700 with x1830963622652672 ext(3145728->3727359) 00010000:00010000:2.0:1746143781.940092:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143781.940101:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143781.940107:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093724700 00000100:00100000:2.0:1746143781.946418:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622652928:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6824us (8828us total) trans 21474840409 rc 0/0 00000100:00100000:2.0:1746143781.946431:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1473 00002000:00100000:2.0:1746143781.946442:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4046848->4194303) req@ffff88012b1dad80 x1830963622652928/t21474840409(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:177/0 lens 488/448 e 0 to 0 dl 1746143792 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.946452:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1dad80 with x1830963622652928 ext(4046848->4194303) 00010000:00010000:2.0:1746143781.946463:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 43 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143781.946481:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 43 pid: 9586 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143781.946488:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1dad80 00000100:00100000:0.0:1746143781.946802:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.947010:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622653056 00000100:00100000:2.0:1746143781.947018:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622653056 00010000:00010000:2.0:1746143781.947051:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143781.947074:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5749 00000100:00100000:2.0:1746143781.947081:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622653056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.947094:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.947112:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143781.947122:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143781.947145:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73a9ccf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3727359) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b67c expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143781.947169:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.947172:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.947179:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.947191:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.947225:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.947237:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626801664:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143781.947313:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.948631:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626801664:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143781.948649:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.949185:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622653056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2094us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.949197:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5749 00000100:00100000:0.0:1746143781.949282:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.949470:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622653312 00000100:00100000:2.0:1746143781.949477:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622653312 00002000:00100000:2.0:1746143781.949565:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (4005888->4009983) req@ffff88009c4d7800 x1830963622653312/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.949577:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7800 with x1830963622653312 ext(4005888->4009983) 00002000:00010000:2.0:1746143781.949584:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7800 00000100:00100000:2.0:1746143781.949612:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3549 00000100:00100000:2.0:1746143781.949619:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622653312:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.950399:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622653312:12345-192.168.202.3@tcp:3:cat.0 Request processed in 779us (1117us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143781.950409:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3549 00002000:00100000:2.0:1746143781.950415:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (4005888->4009983) req@ffff88009c4d7800 x1830963622653312/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.950422:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7800 with x1830963622653312 ext(4005888->4009983) 00002000:00010000:2.0:1746143781.950424:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7800 00000100:00100000:0.0:1746143781.954789:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.954894:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.954962:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622653568 00000100:00100000:3.0:1746143781.954972:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622653568 00000100:00100000:3.0:1746143781.955025:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12186 00000100:00100000:3.0:1746143781.955034:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:32309:x1830963622653568:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143781.955053:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.955072:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6c9 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.955098:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622653440 00000100:00100000:2.0:1746143781.955102:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622653440 00010000:00010000:3.0:1746143781.955106:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.955109:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143781.955114:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4194304->4390911] (req 4194304->4390911) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 33 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.955122:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 43 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143781.955126:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->4390911] (req 4194304->4390911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 33 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143781.955137:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7000, rc 0) 00000100:00100000:2.0:1746143781.955149:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5750 00000100:00100000:2.0:1746143781.955155:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622653440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143781.955164:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143781.955184:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 43 pid: 9586 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143781.955200:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:32309:x1830963622653568:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 167us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143781.955206:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12186 00010000:00010000:2.0:1746143781.955398:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 43 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143781.955435:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9ca5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b675 expref: 43 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143781.955460:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.955461:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.955467:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.955480:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.955487:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.955488:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143781.955490:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.955497:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143781.955530:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.955542:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626801792:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143781.955642:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143781.955650:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093071880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626801920:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143781.955671:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143781.957893:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093071880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626801920:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143781.958320:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093724a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626801792:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143781.958347:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143781.958394:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622653440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3239us (3657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143781.958405:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5750 00000100:00100000:0.0:1746143781.962260:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143781.962965:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622653824 00000100:00100000:2.0:1746143781.962975:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622653824 00002000:00100000:2.0:1746143781.963036:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4386816->4390911) req@ffff88009c4d5180 x1830963622653824/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.963047:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5180 with x1830963622653824 ext(4386816->4390911) 00002000:00010000:2.0:1746143781.963053:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5180 00000100:00100000:2.0:1746143781.963092:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3550 00000100:00100000:2.0:1746143781.963104:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2008:x1830963622653824:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143781.963262:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2008:x1830963622653824:12345-192.168.202.3@tcp:3:cat.0 Request processed in 158us (1012us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143781.963268:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3550 00002000:00100000:2.0:1746143781.963274:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4386816->4390911) req@ffff88009c4d5180 x1830963622653824/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/4536 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.963281:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5180 with x1830963622653824 ext(4386816->4390911) 00002000:00010000:2.0:1746143781.963284:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5180 00000100:00100000:0.0:1746143781.968181:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143781.968233:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.968324:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622654080 00000100:00100000:3.0:1746143781.968335:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622654080 00002000:00100000:3.0:1746143781.968383:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88009c4d5880 x1830963622654080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.968393:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5880 with x1830963622654080 ext(2097152->4194303) 00002000:00010000:3.0:1746143781.968398:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5880 00000100:00100000:3.0:1746143781.968432:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3551 00000100:00100000:3.0:1746143781.968440:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2009:x1830963622654080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143781.968641:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622654336 00000100:00100000:0.0:1746143781.968645:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622654336 00002000:00100000:0.0:1746143781.968665:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4005887) req@ffff88009c4d4a80 x1830963622654336/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/0 e 0 to 0 dl 1746143792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143781.968672:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4a80 with x1830963622654336 ext(2097152->4005887) 00002000:00010000:0.0:1746143781.968676:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d4a80 00000100:00100000:0.0:1746143781.968691:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3552 00000100:00100000:0.0:1746143781.968697:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622654336:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143781.986043:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2009:x1830963622654080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17595us (17862us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143781.986055:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3551 00002000:00100000:3.0:1746143781.986066:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88009c4d5880 x1830963622654080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143781.986080:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5880 with x1830963622654080 ext(2097152->4194303) 00002000:00010000:3.0:1746143781.986085:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5880 00000100:00100000:2.0:1746143781.986990:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622654336:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18291us (18755us total) trans 0 rc 1908736/1908736 00000100:00100000:2.0:1746143781.986996:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3552 00002000:00100000:2.0:1746143781.987002:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4005887) req@ffff88009c4d4a80 x1830963622654336/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:177/0 lens 488/440 e 0 to 0 dl 1746143792 ref 1 fl Complete:/200/0 rc 1908736/1908736 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143781.987008:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4a80 with x1830963622654336 ext(2097152->4005887) 00002000:00010000:2.0:1746143781.987012:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d4a80 00000100:00100000:0.0:1746143781.995544:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143781.995786:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622654464 00000100:00100000:3.0:1746143781.995795:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622654464 00000100:00100000:3.0:1746143781.995842:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12187 00000100:00100000:3.0:1746143781.995849:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2011:x1830963622654464:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143781.995864:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143781.995889:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b7a00/0x87925e4cb73a9d46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6d0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143781.995960:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626802048:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143781.996235:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143781.999131:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963626802048:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143781.999160:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b7a00/0x87925e4cb73a9d46 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d0 expref: 34 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.999174:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b7a00/0x87925e4cb73a9d46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d0 expref: 34 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143781.999188:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7a00, rc 0) 00000100:00100000:3.0:1746143781.999227:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2011:x1830963622654464:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3377us (3694us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143781.999235:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12187 00000100:00100000:0.0:1746143782.005278:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.005336:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622654720 00000100:00100000:2.0:1746143782.005343:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622654720 00002000:00100000:2.0:1746143782.005387:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (4390912->4968447) req@ffff88009c4d4380 x1830963622654720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:178/0 lens 488/0 e 0 to 0 dl 1746143793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143782.005397:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4380 with x1830963622654720 ext(4390912->4968447) 00002000:00010000:2.0:1746143782.005402:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4380 00000100:00100000:2.0:1746143782.005430:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3553 00000100:00100000:2.0:1746143782.005437:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2010:x1830963622654720:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143782.012742:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.012819:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622654976 00000100:00100000:2.0:1746143782.012826:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622654976 00000100:00100000:2.0:1746143782.012865:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12943 00000100:00100000:2.0:1746143782.012872:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+264:32317:x1830963622654976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143782.012900:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143782.012935:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e59e000/0x87925e4cb73a9d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6d7 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.012993:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013004:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013013:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013024:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a9d5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013028:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a9d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013033:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a9d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013106:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013114:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013118:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143782.013126:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143782.013180:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013185:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013189:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013193:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013197:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096f6d600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143782.013200:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013205:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013213:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143782.013215:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143782.013218:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013222:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73a9d54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013246:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a9d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013250:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a9d5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013254:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a9d5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013257:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133566200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143782.013259:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a9d5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013264:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a9d5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013269:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fee7300) 00010000:00010000:2.0:1746143782.013270:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143782.013272:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a9d5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013276:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73a9d5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143782.013303:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e59e000/0x87925e4cb73a9d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d7 expref: 267 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.013321:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d7 expref: 266 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.013327:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143782.013329:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143782.013331:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5aa400, rc 0) 00000100:00100000:2.0:1746143782.013385:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+266:32317:x1830963622654976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 512us (649us total) trans 8589943706 rc 0/0 00000100:00100000:2.0:1746143782.013390:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12943 00000100:00100000:3.0:1746143782.013490:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2010:x1830963622654720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8051us (8218us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143782.013498:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3553 00002000:00100000:3.0:1746143782.013506:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3b6:0x0] (4390912->4968447) req@ffff88009c4d4380 x1830963622654720/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:178/0 lens 488/440 e 0 to 0 dl 1746143793 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143782.013515:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4380 with x1830963622654720 ext(4390912->4968447) 00002000:00010000:3.0:1746143782.013518:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4380 00000100:00100000:0.0:1746143782.020390:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.020498:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.020538:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.020727:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622655232 00000100:00100000:1.0:1746143782.020737:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622655232 00000100:00100000:3.0:1746143782.020779:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622655360 00000100:00100000:3.0:1746143782.020789:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622655360 00000100:00100000:3.0:1746143782.020833:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622655488 00000100:00100000:3.0:1746143782.020836:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622655488 00000100:00100000:3.0:1746143782.020862:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12188 00000100:00100000:3.0:1746143782.020870:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622655360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143782.020896:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143782.020901:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12944 00000100:00100000:1.0:1746143782.020908:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:32316:x1830963622655232:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143782.020936:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9d70 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6e5 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.020960:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143782.020977:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9d77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6de expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143782.020981:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626802176:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143782.021052:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143782.021052:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.021065:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.021076:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.021088:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9d85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.021094:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9d85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.021099:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9d85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746143782.021558:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12189 00000100:00100000:2.0:1746143782.021571:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622655488:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143782.021582:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143782.021596:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a9d8c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6ec expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.021630:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626802304:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143782.021731:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.021747:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622655616 00000100:00100000:0.0:1746143782.021751:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622655616 00000100:00100000:0.0:1746143782.021781:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12190 00000100:00100000:0.0:1746143782.021787:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2011:x1830963622655616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143782.021795:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143782.021804:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a9d93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6f3 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143782.021829:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626802432:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143782.021859:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143782.021979:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00010000:00010000:1.0:1746143782.022117:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a9d9a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022128:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a9d9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022136:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a9d9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143782.022147:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143782.022227:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022234:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022243:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022249:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022255:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a3000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143782.022258:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022265:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022275:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143782.022278:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143782.022282:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022286:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9d7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022301:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9d85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022305:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9d85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022309:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9d85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022313:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a3800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143782.022315:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9d85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022323:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9d85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022328:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880136815000) 00010000:00010000:1.0:1746143782.022330:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143782.022332:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9d85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022336:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9d85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.022372:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9d77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6de expref: 269 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.022381:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a9d9a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6de expref: 268 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.022387:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143782.022389:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143782.022391:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2e00, rc 0) 00000100:00100000:1.0:1746143782.022423:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:32316:x1830963622655232:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1515us (2045us total) trans 8589943707 rc 0/0 00000100:00100000:1.0:1746143782.022429:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12944 00000100:00100000:3.0:1746143782.025270:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626802176:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143782.025309:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9d70 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6e5 expref: 43 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.025325:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73a9d70 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6e5 expref: 43 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.025346:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6600, rc 0) 00000100:00100000:3.0:1746143782.025389:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622655360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4520us (4892us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143782.025397:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12188 00000100:00100000:1.0:1746143782.025576:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626802432:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143782.025593:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a9d93 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6f3 expref: 34 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.025601:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ee00/0x87925e4cb73a9d93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6f3 expref: 34 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.025609:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ee00, rc 0) 00000100:00100000:1.0:1746143782.025629:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2011:x1830963622655616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3843us (3899us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143782.025634:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12190 00000100:00100000:0.0:1746143782.026021:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.026107:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626802304:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143782.026127:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a9d8c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ec expref: 46 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.026136:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e59f000/0x87925e4cb73a9d8c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ec expref: 46 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.026159:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e59f000, rc 0) 00000100:00100000:2.0:1746143782.026182:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622655488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4617us (5643us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143782.026187:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12189 00000100:00100000:2.0:1746143782.026325:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622655744 00000100:00100000:2.0:1746143782.026331:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622655744 00000100:00100000:2.0:1746143782.026378:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 760 00000100:00100000:2.0:1746143782.026385:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+268:2011:x1830963622655744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.026398:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143782.026484:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143782.026494:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73a9d9a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6de expref: 268 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.026513:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143782.026517:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143782.026569:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+267:2011:x1830963622655744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 183us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.026570:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622655872 00000100:00100000:3.0:1746143782.026573:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622655872 00000100:00100000:2.0:1746143782.026578:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 760 00000100:00100000:3.0:1746143782.026589:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12191 00000100:00100000:3.0:1746143782.026595:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+45:32316:x1830963622655872:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143782.026610:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.026621:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b6fa expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.026898:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.026907:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143782.026909:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143782.026936:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3284992->3366911] (req 3284992->3366911) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.026965:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.026976:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 23 pid: 12327 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.026988:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626802560:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143782.027276:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143782.030136:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.030490:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622656000 00000100:00100000:1.0:1746143782.030501:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622656000 00000100:00100000:1.0:1746143782.030562:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12192 00000100:00100000:1.0:1746143782.030571:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2010:x1830963622656000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143782.030591:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143782.030609:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9daf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b701 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143782.030669:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626802688:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143782.030754:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143782.031761:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.031947:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622656128 00000100:00100000:3.0:1746143782.031953:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622656128 00002000:00100000:3.0:1746143782.031993:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (4005888->4194303) req@ffff8800972e9c00 x1830963622656128/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:178/0 lens 488/0 e 0 to 0 dl 1746143793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143782.032001:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9c00 with x1830963622656128 ext(4005888->4194303) 00010000:00010000:3.0:1746143782.032009:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 24 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.032022:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 24 pid: 12327 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143782.032029:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972e9c00 00000100:00100000:3.0:1746143782.032061:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1474 00000100:00100000:3.0:1746143782.032067:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2009:x1830963622656128:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143782.032207:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626802560:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.032227:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3284992->3366911] (req 3284992->3366911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.032239:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7a00, rc 0) 00000100:00100000:3.0:1746143782.032257:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:32316:x1830963622655872:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5662us (5774us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.032263:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12191 00000100:00100000:1.0:1746143782.037120:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626802688:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143782.037159:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9daf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b701 expref: 34 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.037173:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3800/0x87925e4cb73a9daf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b701 expref: 34 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.037183:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3800, rc 0) 00000100:00100000:1.0:1746143782.038168:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2010:x1830963622656000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7594us (8456us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143782.038180:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12192 00000100:00100000:0.0:1746143782.038487:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622656128:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6412us (6720us total) trans 17179873075 rc 0/0 00000100:00100000:0.0:1746143782.038498:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1474 00002000:00100000:0.0:1746143782.038509:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (4005888->4194303) req@ffff8800972e9c00 x1830963622656128/t17179873075(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:178/0 lens 488/448 e 0 to 0 dl 1746143793 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143782.039000:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9c00 with x1830963622656128 ext(4005888->4194303) 00010000:00010000:0.0:1746143782.039009:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 26 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143782.039023:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 26 pid: 12327 timeout: 941 lvb_type: 0 00002000:00010000:0.0:1746143782.039030:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972e9c00 00000100:00100000:0.0:1746143782.040557:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.040623:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622656256 00000100:00100000:1.0:1746143782.040635:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622656256 00000100:00100000:0.0:1746143782.040638:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.040776:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622656384 00000100:00100000:1.0:1746143782.040781:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622656384 00000100:00100000:1.0:1746143782.040803:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12193 00000100:00100000:1.0:1746143782.040810:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622656256:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143782.040828:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143782.040846:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a3a00/0x87925e4cb73a9db6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b708 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143782.040953:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626802816:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143782.041042:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143782.041105:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12194 00000100:00100000:2.0:1746143782.041113:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622656384:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143782.041122:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143782.041132:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73a9dbd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b70f expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.041159:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626802944:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143782.041184:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143782.042944:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626802944:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143782.042980:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73a9dbd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b70f expref: 47 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.042992:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73a9dbd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b70f expref: 47 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.043012:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4abc00, rc 0) 00000100:00100000:2.0:1746143782.043054:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622656384:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1942us (2415us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143782.043061:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12194 00000100:00100000:1.0:1746143782.043151:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626802816:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143782.043170:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3a00/0x87925e4cb73a9db6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b708 expref: 43 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.043179:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3a00/0x87925e4cb73a9db6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b708 expref: 43 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.043188:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3a00, rc 0) 00000100:00100000:1.0:1746143782.043205:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622656256:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2395us (2651us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143782.043211:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12193 00000100:00100000:0.0:1746143782.045546:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.045707:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622656512 00000100:00100000:2.0:1746143782.045716:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622656512 00010000:00010000:2.0:1746143782.045754:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 26 pid: 12327 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143782.046759:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5751 00000100:00100000:2.0:1746143782.046771:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622656512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.046786:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143782.046790:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143782.046809:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 26 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.046826:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 26 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.046854:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73a9d23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6ad expref: 26 pid: 12327 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.046857:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622656768 00000100:00100000:3.0:1746143782.046862:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622656768 00010000:00010000:2.0:1746143782.046868:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.046870:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.046876:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.046894:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.046943:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.047282:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626803072:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143782.047305:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4757 00000100:00100000:3.0:1746143782.047312:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32307:x1830963622656768:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143782.047664:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32307:x1830963622656768:12345-192.168.202.3@tcp:35:cat.0 Request processed in 351us (874us total) trans 8589943708 rc 0/0 00000100:00100000:3.0:1746143782.047671:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4757 00000100:00100000:2.0:1746143782.047674:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143782.048688:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.049581:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622656896 00000100:00100000:1.0:1746143782.049590:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622656896 00000100:00100000:1.0:1746143782.049646:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12195 00000100:00100000:1.0:1746143782.049653:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:32317:x1830963622656896:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143782.049669:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143782.049687:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9dc4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b716 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.049712:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143782.049714:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143782.049721:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9dc4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b716 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.049736:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9dc4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b716 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.049745:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2c00, rc 0) 00000100:00100000:1.0:1746143782.049781:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+43:32317:x1830963622656896:12345-192.168.202.3@tcp:101:cat.0 Request processed in 129us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143782.049787:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12195 00000100:00100000:0.0:1746143782.053514:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626803072:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143782.053532:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143782.053567:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2009:x1830963622656512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6799us (8032us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143782.053575:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5751 00000100:00100000:0.0:1746143782.055589:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.057703:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622657152 00000100:00100000:2.0:1746143782.057714:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622657152 00002000:00100000:2.0:1746143782.057756:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (3284992->3289087) req@ffff8800972e9880 x1830963622657152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:178/0 lens 488/0 e 0 to 0 dl 1746143793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143782.057764:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9880 with x1830963622657152 ext(3284992->3289087) 00002000:00010000:2.0:1746143782.057769:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9880 00000100:00100000:2.0:1746143782.057797:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3554 00000100:00100000:2.0:1746143782.057804:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622657152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143782.057960:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622657152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 155us (2374us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143782.057967:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3554 00002000:00100000:2.0:1746143782.057972:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (3284992->3289087) req@ffff8800972e9880 x1830963622657152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:178/0 lens 488/4536 e 0 to 0 dl 1746143793 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143782.057978:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9880 with x1830963622657152 ext(3284992->3289087) 00002000:00010000:2.0:1746143782.057981:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9880 00000100:00100000:0.0:1746143782.063591:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.063636:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.063673:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622657408 00000100:00100000:1.0:1746143782.063687:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622657408 00000100:00100000:2.0:1746143782.063705:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622657664 00000100:00100000:2.0:1746143782.063714:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622657664 00002000:00100000:1.0:1746143782.063741:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800972e8a80 x1830963622657408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:178/0 lens 488/0 e 0 to 0 dl 1746143793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143782.063751:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88009391f480 x1830963622657664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:178/0 lens 504/0 e 0 to 0 dl 1746143793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143782.063752:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8a80 with x1830963622657408 ext(2097152->4194303) 00002000:00010000:1.0:1746143782.063757:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8a80 00002000:00100000:2.0:1746143782.063759:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f480 with x1830963622657664 ext(2097152->4194303) 00002000:00010000:2.0:1746143782.063764:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391f480 00000100:00100000:1.0:1746143782.063783:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3555 00000100:00100000:1.0:1746143782.063790:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622657408:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143782.063893:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3556 00000100:00100000:2.0:1746143782.063901:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622657664:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143782.085638:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622657664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21729us (21993us total) trans 0 rc 2093056/2093056 00000100:00100000:2.0:1746143782.085650:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3556 00002000:00100000:2.0:1746143782.085659:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88009391f480 x1830963622657664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:178/0 lens 504/440 e 0 to 0 dl 1746143793 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143782.085667:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f480 with x1830963622657664 ext(2097152->4194303) 00002000:00010000:2.0:1746143782.085673:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391f480 00000100:00100000:1.0:1746143782.086722:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622657408:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22927us (23134us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143782.086730:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3555 00002000:00100000:1.0:1746143782.086737:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800972e8a80 x1830963622657408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:178/0 lens 488/440 e 0 to 0 dl 1746143793 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143782.086744:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8a80 with x1830963622657408 ext(2097152->4194303) 00002000:00010000:1.0:1746143782.087184:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8a80 00000100:00100000:0.0:1746143782.091345:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.091422:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622657920 00000100:00100000:3.0:1746143782.091430:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622657920 00000100:00100000:3.0:1746143782.091496:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4758 00000100:00100000:3.0:1746143782.091505:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+267:32316:x1830963622657920:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143782.091665:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:32316:x1830963622657920:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 161us (326us total) trans 8589943709 rc 0/0 00000100:00100000:3.0:1746143782.091671:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4758 00000100:00100000:0.0:1746143782.095130:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.095238:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622658048 00000100:00100000:3.0:1746143782.095246:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622658048 00000100:00100000:3.0:1746143782.095453:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12196 00000100:00100000:3.0:1746143782.095461:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622658048:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143782.095476:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.095492:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a9dcb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b71d expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143782.095535:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626803200:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143782.098087:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143782.103031:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626803200:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143782.103062:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a9dcb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b71d expref: 44 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.103073:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73a9dcb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b71d expref: 44 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.103109:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52c00, rc 0) 00000100:00100000:3.0:1746143782.103170:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622658048:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7709us (8045us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143782.103177:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12196 00000100:00100000:2.0:1746143782.108492:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.108558:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622658176 00000100:00100000:3.0:1746143782.108565:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622658176 00000100:00100000:3.0:1746143782.108643:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12197 00000100:00100000:3.0:1746143782.108650:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+43:32317:x1830963622658176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143782.108665:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.108679:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b724 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.108701:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.108708:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143782.108709:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143782.108712:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->4968447] (req 4194304->4968447) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 44 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.108735:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.108745:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 32 pid: 12327 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.108759:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626803328:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143782.109560:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143782.116340:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.116785:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622658304 00000100:00100000:1.0:1746143782.116792:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622658304 00002000:00100000:1.0:1746143782.116828:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4390911) req@ffff88009391c000 x1830963622658304/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:178/0 lens 488/0 e 0 to 0 dl 1746143793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143782.116837:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c000 with x1830963622658304 ext(4194304->4390911) 00010000:00010000:1.0:1746143782.116845:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 33 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143782.116858:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 33 pid: 12327 timeout: 941 lvb_type: 0 00002000:00010000:1.0:1746143782.116864:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391c000 00000100:00100000:1.0:1746143782.117382:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1475 00000100:00100000:1.0:1746143782.117390:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2009:x1830963622658304:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143782.117995:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626803328:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.118016:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->4968447] (req 4194304->4968447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 44 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.118028:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24200, rc 0) 00000100:00100000:3.0:1746143782.118051:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:32317:x1830963622658176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9402us (9565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.118058:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12197 00000100:00100000:0.0:1746143782.122581:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:2009:x1830963622658304:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5180us (6237us total) trans 21474840410 rc 0/0 00000100:00100000:0.0:1746143782.122593:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1475 00002000:00100000:0.0:1746143782.122605:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4390911) req@ffff88009391c000 x1830963622658304/t21474840410(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:178/0 lens 488/448 e 0 to 0 dl 1746143793 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143782.122614:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c000 with x1830963622658304 ext(4194304->4390911) 00010000:00010000:0.0:1746143782.122625:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 35 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143782.122640:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 35 pid: 12327 timeout: 941 lvb_type: 0 00002000:00010000:0.0:1746143782.122647:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391c000 00000100:00100000:0.0:1746143782.127043:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.127108:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622658432 00000100:00100000:2.0:1746143782.127119:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622658432 00010000:00010000:2.0:1746143782.127163:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 35 pid: 12327 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143782.127204:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5752 00000100:00100000:2.0:1746143782.127214:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:2011:x1830963622658432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.127230:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.127252:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 35 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.127264:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 35 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.127289:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b7000/0x87925e4cb73a9d3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4390911) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c9 expref: 35 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.127316:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.127317:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.127325:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.127334:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.127370:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.127383:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626803456:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143782.127473:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143782.130249:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626803456:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143782.130279:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143782.130336:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2011:x1830963622658432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3122us (3304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.130347:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5752 00000100:00100000:0.0:1746143782.131695:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.131779:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622658688 00000100:00100000:2.0:1746143782.131786:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622658688 00002000:00100000:2.0:1746143782.131827:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff88009391f100 x1830963622658688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:178/0 lens 488/0 e 0 to 0 dl 1746143793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143782.131838:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f100 with x1830963622658688 ext(4194304->4968447) 00002000:00010000:2.0:1746143782.131842:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391f100 00000100:00100000:2.0:1746143782.131859:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3557 00000100:00100000:2.0:1746143782.131866:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622658688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143782.135505:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143782.135530:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626803584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746143782.135605:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143782.135693:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626803584 00000100:00100000:2.0:1746143782.135702:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626803584 00000100:00100000:2.0:1746143782.135753:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1746143782.135762:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963626803584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746143782.135785:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 1020252224 pending 8159232 free 3914395648 avail 3682873344 00000100:00080000:0.0:1746143782.135785:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143782.135832:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963626803584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.135841:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1746143782.135943:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963626803584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746143782.138419:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622658688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6542us (6718us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143782.138428:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3557 00002000:00100000:2.0:1746143782.138440:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff88009391f100 x1830963622658688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:178/0 lens 488/440 e 0 to 0 dl 1746143793 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143782.138449:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f100 with x1830963622658688 ext(4194304->4968447) 00002000:00010000:2.0:1746143782.138454:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391f100 00000100:00100000:0.0:1746143782.144468:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.144529:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622658944 00000100:00100000:2.0:1746143782.144538:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622658944 00000100:00100000:2.0:1746143782.144596:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4759 00000100:00100000:2.0:1746143782.144604:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b497450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+268:32317:x1830963622658944:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143782.145055:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b497450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+269:32317:x1830963622658944:12345-192.168.202.3@tcp:35:cat.0 Request processed in 449us (597us total) trans 8589943710 rc 0/0 00000100:00100000:2.0:1746143782.145062:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4759 00000100:00100000:0.0:1746143782.152539:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.152661:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622659072 00000100:00100000:1.0:1746143782.152671:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622659072 00000100:00100000:1.0:1746143782.152742:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12945 00000100:00100000:1.0:1746143782.152751:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:32321:x1830963622659072:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143782.152781:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143782.152801:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b000/0x87925e4cb73a9dd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b72b expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.152864:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.152886:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.152896:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.152934:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9de7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.152941:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9de7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.152946:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9de7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.153019:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.153030:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6a6 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.153037:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.153069:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6a6 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.153085:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6a6 expref: 12 pid: 14991 timeout: 941 lvb_type: 0 00000100:00080000:0.0:1746143782.153099:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143782.153101:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626803712:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143782.153701:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143782.155491:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626803712:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143782.155514:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143782.155647:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.155703:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622659328 00000100:00100000:2.0:1746143782.155710:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622659328 00000100:00100000:2.0:1746143782.155759:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4760 00000100:00100000:2.0:1746143782.155766:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:30501:x1830963622659328:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143782.156690:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:30501:x1830963622659328:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 920us (1039us total) trans 8589943711 rc 0/0 00000100:00100000:2.0:1746143782.156698:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4760 00000100:00100000:1.0:1746143782.159063:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.159201:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622659456 00000100:00100000:2.0:1746143782.159211:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622659456 00010000:00010000:2.0:1746143782.159249:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6a6 expref: 14 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143782.159289:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5753 00000100:00100000:2.0:1746143782.159298:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622659456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.159318:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.159323:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6a6 expref: 14 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.159334:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6a6 expref: 14 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.159357:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73a9d15 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6a6 expref: 14 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.159369:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143782.159374:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143782.159383:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143782.159390:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143782.159424:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143782.159471:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622659456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 173us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.159477:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5753 00010000:00010000:0.0:1746143782.159571:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159579:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746143782.159643:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:0.0:1746143782.159649:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143782.159668:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159679:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159690:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159695:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159700:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159706:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159711:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0b200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143782.159716:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159722:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159730:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143782.159733:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143782.159736:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159740:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73a9de0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159754:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9de7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159758:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9de7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159762:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9de7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159766:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0ba00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143782.159768:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9de7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159776:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9de7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159781:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880136815200) 00010000:00010000:0.0:1746143782.159783:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143782.159786:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9de7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159790:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9de7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.159826:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b000/0x87925e4cb73a9dd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b72b expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143782.159857:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b72b expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143782.159864:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143782.159866:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143782.159868:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0a600, rc 0) 00000100:00100000:0.0:1746143782.160229:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32321:x1830963622659072:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 7478us (7702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143782.160235:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12945 00000100:00100000:0.0:1746143782.163790:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.163828:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.163855:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.164060:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.164200:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622659584 00000100:00100000:2.0:1746143782.164208:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622659712 00000100:00100000:0.0:1746143782.164212:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.164214:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622659584 00000100:00100000:2.0:1746143782.164216:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622659712 00000100:00100000:3.0:1746143782.164233:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622659840 00000100:00100000:3.0:1746143782.164235:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622659840 00000100:00100000:0.0:1746143782.164248:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.164261:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622659968 00000100:00100000:2.0:1746143782.164263:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622659968 00000100:00100000:3.0:1746143782.164280:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622660096 00000100:00100000:3.0:1746143782.164283:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622660096 00000100:00100000:0.0:1746143782.164285:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622660224 00000100:00100000:0.0:1746143782.164288:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622660224 00000100:00100000:2.0:1746143782.164291:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12198 00000100:00100000:2.0:1746143782.164298:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622659712:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:3.0:1746143782.164311:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12199 00000100:00100000:0.0:1746143782.164316:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12200 00010000:00010000:2.0:1746143782.164317:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143782.164318:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622659840:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:0.0:1746143782.164321:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2011:x1830963622659968:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143782.164328:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.164334:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143782.164337:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097368a00/0x87925e4cb73a9df5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b739 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143782.164337:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a9dfc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b747 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.164349:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24c00/0x87925e4cb73a9e03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b740 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.164360:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143782.164360:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.164361:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143782.164361:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.164370:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.164370:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097368a00/0x87925e4cb73a9df5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b739 expref: 19 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143782.164370:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a9dfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b747 expref: 17 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.164371:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.164379:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24c00/0x87925e4cb73a9e03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b740 expref: 19 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.164386:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097368a00/0x87925e4cb73a9df5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b739 expref: 19 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143782.164386:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a9dfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b747 expref: 17 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.164395:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097368a00, rc 0) 00010000:00010000:0.0:1746143782.164395:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7d800, rc 0) 00010000:00010000:3.0:1746143782.164397:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24c00/0x87925e4cb73a9e03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b740 expref: 19 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.164407:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24c00, rc 0) 00000100:00100000:2.0:1746143782.164434:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2011:x1830963622659712:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 136us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143782.164434:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622659968:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 112us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.164439:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12198 00000100:00100000:0.0:1746143782.164442:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12200 00000100:00100000:3.0:1746143782.164449:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2011:x1830963622659840:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 131us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.164455:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12199 00000100:00100000:2.0:1746143782.164460:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12201 00000100:00100000:0.0:1746143782.164463:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12202 00000100:00100000:2.0:1746143782.164464:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2011:x1830963622660096:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:0.0:1746143782.164467:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622660224:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143782.164470:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143782.164471:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143782.164476:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097368200/0x87925e4cb73a9e0a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b74e expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143782.164478:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73a9e11 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b755 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.164487:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.164488:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143782.164489:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12203 00010000:00010000:2.0:1746143782.164491:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097368200/0x87925e4cb73a9e0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b74e expref: 17 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143782.164495:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622659584:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143782.164502:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143782.164503:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097368200/0x87925e4cb73a9e0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b74e expref: 17 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.164508:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097368200, rc 0) 00010000:00010000:3.0:1746143782.164511:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a9e18 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b732 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143782.164514:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626803840:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143782.164522:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143782.164523:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2011:x1830963622660096:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 59us (311us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143782.164524:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.164528:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a9e18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b732 expref: 18 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143782.164528:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12201 00010000:00010000:3.0:1746143782.164538:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a9e18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b732 expref: 17 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.164545:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25a00, rc 0) 00000100:00100000:3.0:1746143782.164561:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622659584:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 66us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143782.164564:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143782.164567:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12203 00000100:00100000:1.0:1746143782.167024:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626803840:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143782.167060:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73a9e11 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b755 expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.167073:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73a9e11 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b755 expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.167089:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0ac00, rc 0) 00000100:00100000:1.0:1746143782.167130:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622660224:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 2661us (2879us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143782.167138:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12202 00000100:00100000:0.0:1746143782.169781:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.169896:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622660480 00000100:00100000:2.0:1746143782.169907:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622660480 00000100:00100000:2.0:1746143782.170007:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12946 00000100:00100000:2.0:1746143782.170014:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32321:x1830963622660480:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143782.170032:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143782.170049:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b000/0x87925e4cb73a9e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b75c expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.170132:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9e26 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143782.170145:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b72b expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.170152:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9e26 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143782.170177:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b72b expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.170191:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b72b expref: 8 pid: 7244 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143782.170201:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626803968:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143782.170297:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1b93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143782.172148:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.172259:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626803968:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143782.172280:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9e26 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143782.172382:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622660608 00000100:00100000:1.0:1746143782.172390:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622660608 00010000:00010000:1.0:1746143782.172426:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b72b expref: 9 pid: 7244 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143782.172462:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5754 00000100:00100000:1.0:1746143782.172470:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622660608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143782.172483:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143782.172489:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b72b expref: 9 pid: 7244 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143782.172500:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b72b expref: 9 pid: 7244 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143782.172523:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73a9dee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b72b expref: 9 pid: 7244 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143782.172538:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143782.172542:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9e26 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.172551:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9e26 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.172558:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9e26 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.172592:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143782.172648:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622660608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 178us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143782.172655:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5754 00010000:00010000:3.0:1746143782.172770:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9e26 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.172778:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9e26 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143782.172795:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143782.172905:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b000/0x87925e4cb73a9e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b75c expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.172955:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9e26 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b75c expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.172962:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143782.172965:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143782.172967:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0ba00, rc 0) 00000100:00100000:3.0:1746143782.173185:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32321:x1830963622660480:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 3169us (3414us total) trans 8589943712 rc 0/0 00000100:00100000:3.0:1746143782.173193:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12946 00000100:00100000:0.0:1746143782.178357:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.178453:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622660864 00000100:00100000:3.0:1746143782.178465:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622660864 00000100:00100000:3.0:1746143782.178528:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12947 00000100:00100000:3.0:1746143782.178536:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32321:x1830963622660864:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143782.178559:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.178562:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143782.178585:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73a9e26 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b75c expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.178600:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143782.178604:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143782.178614:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a9e34 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b763 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.178688:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097369e00/0x87925e4cb73a9e3b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.178728:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097369e00/0x87925e4cb73a9e3b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.178739:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097369e00/0x87925e4cb73a9e3b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143782.178749:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143782.178823:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73a9e34 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b763 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.178834:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097369e00/0x87925e4cb73a9e3b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b763 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.178840:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143782.178843:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143782.178845:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369e00, rc 0) 00000100:00100000:3.0:1746143782.178941:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32321:x1830963622660864:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 375us (566us total) trans 8589943713 rc 0/0 00000100:00100000:3.0:1746143782.178948:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12947 00000100:00100000:0.0:1746143782.181310:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.182126:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622660992 00000100:00100000:2.0:1746143782.182135:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622660992 00000100:00100000:2.0:1746143782.182184:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12948 00000100:00100000:2.0:1746143782.182191:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32321:x1830963622660992:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143782.182209:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143782.182224:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a9e49 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b76a expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.182270:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a9e49 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b76a expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.182282:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a9e49 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b76a expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.182297:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143782.182299:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143782.182302:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7c600, rc 0) 00000100:00100000:2.0:1746143782.183491:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32321:x1830963622660992:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 1294us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.183498:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12948 00000100:00100000:0.0:1746143782.186215:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.186247:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.186277:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.186288:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.186314:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.186377:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622661248 00000100:00100000:3.0:1746143782.186387:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622661248 00000100:00100000:3.0:1746143782.186401:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622661504 00000100:00100000:3.0:1746143782.186403:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622661504 00000100:00100000:3.0:1746143782.186436:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622661760 00000100:00100000:3.0:1746143782.186438:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622661760 00000100:00100000:3.0:1746143782.186448:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622661120 00000100:00100000:3.0:1746143782.186450:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622661120 00000100:00100000:3.0:1746143782.186465:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622661376 00000100:00100000:3.0:1746143782.186467:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622661376 00000100:00100000:3.0:1746143782.186481:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12204 00000100:00100000:3.0:1746143782.186487:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622661504:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143782.186520:0:13436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.186535:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c529c00/0x87925e4cb73a9c35 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b62f expref: 33 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143782.186538:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12205 00010000:00010000:3.0:1746143782.186542:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a9dfc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b747 expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.186548:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a9c66 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b652 expref: 43 pid: 13436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143782.186550:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2008:x1830963622661760:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143782.186553:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.186554:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.186557:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.186580:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a9c66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b652 expref: 43 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.186589:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a9c66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b652 expref: 43 pid: 13436 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143782.186589:0:12328:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143782.186603:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626804096:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143782.186605:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143782.186613:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143782.186615:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143782.186617:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143782.186642:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 45 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143782.186652:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 45 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.186670:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a9dfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b747 expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143782.186670:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626804224:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.186677:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a9dfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b747 expref: 18 pid: 1945 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143782.186683:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626804352:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143782.186712:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143782.186715:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12206 00000100:00100000:1.0:1746143782.186722:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622661120:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143782.186737:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.186745:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9c20 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b61a expref: 33 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.186750:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a9e18 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b732 expref: 18 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.186755:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9c6d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b63d expref: 43 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.186760:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143782.186761:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143782.187179:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.187199:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9c6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b63d expref: 43 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.187206:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9c6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b63d expref: 43 pid: 13436 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.187214:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626804480:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143782.187270:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12207 00000100:00100000:2.0:1746143782.187278:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2008:x1830963622661376:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143782.187297:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.187307:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a9c27 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b628 expref: 24 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.187314:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b24c00/0x87925e4cb73a9e03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b740 expref: 19 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.187321:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a9c74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b64b expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.187325:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.187326:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.187328:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.187342:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a9c74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b64b expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.187349:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a9c74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b64b expref: 45 pid: 13436 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.187362:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626804608:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.187512:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c529c00/0x87925e4cb73a9c35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b62f expref: 33 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.187520:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c529c00/0x87925e4cb73a9c35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b62f expref: 33 pid: 9585 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143782.187527:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626804736:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143782.187546:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143782.187582:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12208 00000100:00100000:3.0:1746143782.187586:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2008:x1830963622661248:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143782.187601:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.187609:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e523800/0x87925e4cb73a9c2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b621 expref: 24 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.187619:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097368a00/0x87925e4cb73a9df5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b739 expref: 19 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.187625:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a9c5f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b644 expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.187630:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.187631:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.187633:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.187644:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a9c5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b644 expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.187650:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a9c5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b644 expref: 45 pid: 13436 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143782.187657:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626804864:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.187679:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097368a00/0x87925e4cb73a9df5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b739 expref: 19 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.187686:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097368a00/0x87925e4cb73a9df5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b739 expref: 19 pid: 3134 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143782.187691:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626804992:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.187710:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e523800/0x87925e4cb73a9c2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b621 expref: 24 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.187716:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e523800/0x87925e4cb73a9c2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b621 expref: 24 pid: 9587 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143782.187723:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626805120:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143782.187737:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143782.187868:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b24c00/0x87925e4cb73a9e03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b740 expref: 19 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.187885:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b24c00/0x87925e4cb73a9e03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b740 expref: 19 pid: 9839 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.187893:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626805248:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143782.187925:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a9c27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b628 expref: 24 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143782.187933:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a9c27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b628 expref: 24 pid: 9587 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.187940:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626805376:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143782.187952:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1b93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143782.188040:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143782.188103:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a9e18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b732 expref: 18 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.188115:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a9e18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b732 expref: 18 pid: 13430 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.188122:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626805504:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143782.188141:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9c20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b61a expref: 33 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143782.188148:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9c20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b61a expref: 33 pid: 9587 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.188155:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626805632:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143782.188164:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143782.188436:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622661632 00000100:00100000:3.0:1746143782.188441:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622661632 00000100:00100000:3.0:1746143782.188461:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12209 00000100:00100000:3.0:1746143782.188466:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2008:x1830963622661632:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143782.188482:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.188492:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 33 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.188498:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.188504:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097368200/0x87925e4cb73a9e0a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b74e expref: 19 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.188510:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9dc4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b716 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.188519:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143782.188521:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143782.188523:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 7/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.188536:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9dc4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b716 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.188543:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9dc4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b716 expref: 43 pid: 3135 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.188551:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626805760:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.188574:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097368200/0x87925e4cb73a9e0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b74e expref: 19 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.188581:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097368200/0x87925e4cb73a9e0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b74e expref: 19 pid: 3134 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143782.188587:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626805888:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.188603:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.188610:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 43 pid: 13430 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.188622:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626806016:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.188640:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 33 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.188647:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 33 pid: 12327 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.188660:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626806144:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143782.188674:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143782.191750:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626804096:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143782.194113:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963626804224:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143782.194131:0:12328:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143782.195230:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626804480:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143782.195239:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626805504:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143782.195246:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626805632:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143782.195267:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.195326:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626804864:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143782.195335:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626804992:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143782.195344:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626805120:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143782.195356:0:1947:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.195374:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626804608:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143782.195380:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626805248:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143782.195385:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626805376:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143782.195400:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143782.195459:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626804352:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143782.195466:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626804736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.195480:0:13436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143782.201419:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.201452:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.201477:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.201490:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.201514:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.201592:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622662656 00000100:00100000:2.0:1746143782.201599:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622662656 00010000:00010000:2.0:1746143782.201630:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a9c5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b644 expref: 46 pid: 13436 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.201650:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622663168 00000100:00100000:2.0:1746143782.201652:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622663168 00010000:00010000:2.0:1746143782.201661:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a9e18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b732 expref: 20 pid: 13430 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.201669:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622663424 00000100:00100000:2.0:1746143782.201670:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622663424 00010000:00010000:2.0:1746143782.201676:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097368200/0x87925e4cb73a9e0a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b74e expref: 21 pid: 3134 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.201683:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622663040 00000100:00100000:2.0:1746143782.201685:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622663040 00010000:00010000:2.0:1746143782.201691:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9c6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b63d expref: 44 pid: 13436 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.201697:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622663296 00000100:00100000:2.0:1746143782.201698:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622663296 00010000:00010000:2.0:1746143782.201704:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9dc4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b716 expref: 45 pid: 3135 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143782.201713:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5755 00000100:00100000:2.0:1746143782.201719:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963622662656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.201730:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.201752:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a9c5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b644 expref: 46 pid: 13436 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.201761:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a9c5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b644 expref: 46 pid: 13436 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.201779:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73a9c5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b644 expref: 46 pid: 13436 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.201802:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143782.201831:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963622662656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 113us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.201837:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5755 00000100:00100000:2.0:1746143782.201849:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5756 00000100:00100000:2.0:1746143782.201853:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+21:2010:x1830963622663168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.201861:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.201871:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a9e18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b732 expref: 21 pid: 13430 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.201905:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a9e18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b732 expref: 21 pid: 13430 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.201936:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b25a00/0x87925e4cb73a9e18 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b732 expref: 21 pid: 13430 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.201945:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143782.201957:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2010:x1830963622663168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 104us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.201962:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5756 00000100:00100000:2.0:1746143782.201970:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5757 00000100:00100000:2.0:1746143782.201974:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2010:x1830963622663424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.201980:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.201986:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097368200/0x87925e4cb73a9e0a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b74e expref: 19 pid: 3134 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.201993:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097368200/0x87925e4cb73a9e0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b74e expref: 19 pid: 3134 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.202001:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143782.202010:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2010:x1830963622663424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 36us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.202016:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5757 00000100:00100000:2.0:1746143782.202023:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5758 00000100:00100000:2.0:1746143782.202026:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963622663040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.202032:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.202037:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9c6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b63d expref: 45 pid: 13436 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.202044:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9c6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b63d expref: 45 pid: 13436 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.202052:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73a9c6d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b63d expref: 45 pid: 13436 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.202059:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143782.202074:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622663040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 48us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143782.202120:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5759 00000100:00100000:1.0:1746143782.202127:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622663296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143782.202133:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143782.202141:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9dc4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b716 expref: 44 pid: 3135 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143782.202148:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9dc4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b716 expref: 44 pid: 3135 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143782.202157:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143782.202172:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963622663296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 46us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143782.202176:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5759 00010000:00010000:3.0:1746143782.202271:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73a9dc4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b716 expref: 43 pid: 3135 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.202291:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626805760:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.202300:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097368200/0x87925e4cb73a9e0a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b74e expref: 18 pid: 3134 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143782.202307:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626805888:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143782.202314:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626806016:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143782.202319:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626806144:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.202339:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.202394:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5758 00000100:00100000:0.0:1746143782.203384:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.203415:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.203440:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.203450:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.203460:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.203471:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622662272 00000100:00100000:0.0:1746143782.203472:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.203475:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622662272 00000100:00100000:0.0:1746143782.203481:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.203513:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.203519:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622662528 00000100:00100000:1.0:1746143782.203522:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622662528 00000100:00100000:0.0:1746143782.203523:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143782.203534:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523800/0x87925e4cb73a9c2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b621 expref: 25 pid: 9587 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.203546:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622662912 00000100:00100000:1.0:1746143782.203552:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622662912 00010000:00010000:1.0:1746143782.203560:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24c00/0x87925e4cb73a9e03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b740 expref: 20 pid: 9839 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.203568:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622663680 00000100:00100000:1.0:1746143782.203569:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622663680 00000100:00100000:2.0:1746143782.203574:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622661888 00000100:00100000:2.0:1746143782.203576:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622661888 00010000:00010000:1.0:1746143782.203577:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c529c00/0x87925e4cb73a9c35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b62f expref: 34 pid: 9585 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.203585:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622662144 00010000:00010000:2.0:1746143782.203586:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a9c66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b652 expref: 42 pid: 13436 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.203586:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622662144 00010000:00010000:1.0:1746143782.203592:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9c20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b61a expref: 35 pid: 9587 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.203594:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622662400 00000100:00100000:2.0:1746143782.203596:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622662400 00000100:00100000:1.0:1746143782.203599:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622662784 00000100:00100000:1.0:1746143782.203601:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622662784 00010000:00010000:2.0:1746143782.203602:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097368a00/0x87925e4cb73a9df5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b739 expref: 21 pid: 3134 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203608:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a9c74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b64b expref: 45 pid: 13436 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.203616:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5760 00000100:00100000:2.0:1746143782.203620:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:2008:x1830963622662528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143782.203627:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5761 00010000:00010000:2.0:1746143782.203629:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143782.203631:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+21:2008:x1830963622662912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143782.203636:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.203640:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e523800/0x87925e4cb73a9c2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b621 expref: 25 pid: 9587 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203643:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b24c00/0x87925e4cb73a9e03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b740 expref: 21 pid: 9839 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.203647:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e523800/0x87925e4cb73a9c2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b621 expref: 25 pid: 9587 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203649:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b24c00/0x87925e4cb73a9e03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b740 expref: 21 pid: 9839 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203661:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24c00/0x87925e4cb73a9e03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b740 expref: 21 pid: 9839 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203674:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143782.203695:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2008:x1830963622662912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 62us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143782.203700:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5761 00000100:00100000:1.0:1746143782.203711:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5762 00000100:00100000:1.0:1746143782.203715:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+35:2008:x1830963622663680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143782.203721:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143782.203729:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c529c00/0x87925e4cb73a9c35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b62f expref: 35 pid: 9585 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203740:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c529c00/0x87925e4cb73a9c35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b62f expref: 35 pid: 9585 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203750:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c529c00/0x87925e4cb73a9c35 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b62f expref: 35 pid: 9585 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203758:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143782.203772:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+34:2008:x1830963622663680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 57us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143782.203777:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5762 00010000:00010000:2.0:1746143782.203779:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e523800/0x87925e4cb73a9c2e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b621 expref: 25 pid: 9587 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.203785:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5763 00010000:00010000:2.0:1746143782.203787:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143782.203789:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622661888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143782.203794:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143782.203799:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622662528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 179us (359us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143782.203800:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a9c66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b652 expref: 42 pid: 13436 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.203804:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5760 00010000:00010000:1.0:1746143782.203807:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a9c66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b652 expref: 42 pid: 13436 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.203813:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5764 00010000:00010000:1.0:1746143782.203816:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d600/0x87925e4cb73a9c66 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b652 expref: 42 pid: 13436 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.203817:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+33:2008:x1830963622662144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.203822:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143782.203824:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143782.203827:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9c20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b61a expref: 33 pid: 9587 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.203834:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622661888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (362us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143782.203835:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9c20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b61a expref: 33 pid: 9587 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.203842:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5763 00010000:00010000:2.0:1746143782.203848:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e522e00/0x87925e4cb73a9c20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b61a expref: 33 pid: 9587 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143782.203849:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5765 00000100:00100000:1.0:1746143782.203853:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2008:x1830963622662400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.203857:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143782.203857:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.203858:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.203862:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.203862:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097368a00/0x87925e4cb73a9df5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b739 expref: 19 pid: 3134 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.203869:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.203869:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097368a00/0x87925e4cb73a9df5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b739 expref: 19 pid: 3134 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203888:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097368a00/0x87925e4cb73a9df5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b739 expref: 19 pid: 3134 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203895:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143782.203896:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143782.203898:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.203899:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143782.203904:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.203932:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2008:x1830963622662144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 94us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.203937:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5764 00010000:00010000:1.0:1746143782.203937:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143782.203948:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5766 00000100:00100000:1.0:1746143782.203949:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622662400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 96us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.203953:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622662784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143782.203953:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5765 00010000:00010000:2.0:1746143782.203958:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.203964:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a9c74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b64b expref: 45 pid: 13436 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.203971:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a9c74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b64b expref: 45 pid: 13436 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143782.203972:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.203980:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.203982:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73a9c74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b64b expref: 45 pid: 13436 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.203992:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143782.203993:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.203999:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.204003:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622662784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 50us (479us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143782.204006:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.204007:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5766 00010000:00010000:1.0:1746143782.204011:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143782.204015:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.204019:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.204022:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.204024:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.204030:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.204033:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143782.204035:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.204039:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.204043:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.204048:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090fc2200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143782.204050:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.204055:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143782.204063:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622661120:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 17342us (17774us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143782.204066:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143782.204070:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12206 00010000:00010000:2.0:1746143782.204071:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090fc2200/0x87925e4cb73a9e6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.204092:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622661248:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 16504us (17887us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.204097:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12208 00000100:00100000:2.0:1746143782.204112:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622662016 00000100:00100000:2.0:1746143782.204115:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622662016 00010000:00010000:3.0:1746143782.204130:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a9dfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b747 expref: 17 pid: 1945 timeout: 941 lvb_type: 1 00002000:00100000:2.0:1746143782.204134:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (3284992->3366911) req@ffff880091bddf80 x1830963622662016/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:178/0 lens 488/0 e 0 to 0 dl 1746143793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143782.204142:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddf80 with x1830963622662016 ext(3284992->3366911) 00010000:00010000:2.0:1746143782.204149:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 44 pid: 9586 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.204151:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5767 00000100:00100000:3.0:1746143782.204156:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622662272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.204156:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 44 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.204162:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143782.204162:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bddf80 00010000:00010000:3.0:1746143782.204168:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a9dfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b747 expref: 17 pid: 1945 timeout: 941 lvb_type: 1 00010000:00010000:3.0:1746143782.204175:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a9dfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b747 expref: 17 pid: 1945 timeout: 941 lvb_type: 1 00010000:00010000:3.0:1746143782.204186:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73a9dfc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b747 expref: 17 pid: 1945 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.204187:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1476 00000100:00100000:2.0:1746143782.204192:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622662016:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:3.0:1746143782.204193:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.204194:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.204196:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.204205:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.204215:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143782.204225:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2008:x1830963622662272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 70us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.204230:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5767 00010000:00010000:3.0:1746143782.204258:0:13436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.204264:0:13436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.204274:0:13436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.204280:0:13436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.204285:0:13436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.204290:0:13436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143782.204292:0:13436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.204301:0:13436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143782.204302:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143782.204309:0:13436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.204313:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73a9e50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143782.204335:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2008:x1830963622661504:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 17848us (18087us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.204340:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12204 00000100:00100000:2.0:1746143782.204705:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622663552 00000100:00100000:2.0:1746143782.204709:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622663552 00010000:00010000:2.0:1746143782.204721:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a9c27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b628 expref: 24 pid: 9587 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143782.204748:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5768 00000100:00100000:2.0:1746143782.204753:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:2008:x1830963622663552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.204760:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.204767:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a9c27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b628 expref: 24 pid: 9587 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.204773:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a9c27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b628 expref: 24 pid: 9587 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.204782:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e523000/0x87925e4cb73a9c27 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b628 expref: 24 pid: 9587 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143782.204789:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.204790:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.204792:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.204798:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.204809:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143782.205950:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963622663552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1194us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.205958:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5768 00010000:00010000:2.0:1746143782.205980:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.205988:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.206001:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.206007:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.206013:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.206018:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d7c200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143782.206021:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.206027:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.206037:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.206042:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7c200/0x87925e4cb73a9e65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.206077:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2008:x1830963622661376:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 18800us (19762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.206084:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12207 00000100:00100000:1.0:1746143782.206406:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.206889:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622663808 00000100:00100000:3.0:1746143782.206895:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622663808 00010000:00010000:3.0:1746143782.206928:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 41 pid: 13430 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.206946:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5769 00000100:00100000:3.0:1746143782.206951:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963622663808:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143782.206960:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143782.206972:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 41 pid: 13430 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.206980:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 41 pid: 13430 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.206997:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73a9dd2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4968447) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b724 expref: 41 pid: 13430 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.207007:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143782.207026:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622663808:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.207032:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5769 00000100:00100000:1.0:1746143782.207602:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.207641:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622663936 00000100:00100000:3.0:1746143782.207649:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622663936 00010000:00010000:3.0:1746143782.207661:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 32 pid: 12327 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.207677:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5770 00000100:00100000:3.0:1746143782.207682:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622663936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143782.207688:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143782.207694:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 32 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.207701:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 32 pid: 12327 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.207712:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73a9d38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6c2 expref: 32 pid: 12327 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143782.207717:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622662016:12345-192.168.202.3@tcp:4:cat.0 Request processed in 3524us (4335us total) trans 17179873076 rc 0/0 00010000:00010000:3.0:1746143782.207719:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.207721:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143782.207724:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1476 00010000:00010000:3.0:1746143782.207725:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143782.207730:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (3284992->3366911) req@ffff880091bddf80 x1830963622662016/t17179873076(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:178/0 lens 488/448 e 0 to 0 dl 1746143793 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143782.207732:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143782.207738:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddf80 with x1830963622662016 ext(3284992->3366911) 00010000:00010000:2.0:1746143782.207744:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.207747:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143782.207752:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143782.207757:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bddf80 00000100:00100000:3.0:1746143782.207758:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622663936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.207762:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5770 00010000:00010000:3.0:1746143782.207774:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.207781:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.207792:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.207797:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.207804:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.207809:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093716200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143782.207812:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.207822:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.207830:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.207835:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73a9e73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143782.207886:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2008:x1830963622661632:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 19411us (19838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.207893:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12209 00000100:00100000:0.0:1746143782.214756:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.214834:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622664064 00000100:00100000:2.0:1746143782.214842:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622664064 00010000:00010000:2.0:1746143782.214870:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143782.214936:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5771 00000100:00100000:2.0:1746143782.214944:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963622664064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.214955:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.214971:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.214986:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.215003:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73a9da8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3366911) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6fa expref: 46 pid: 9586 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.215017:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.215019:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143782.215022:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.215030:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.215049:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143782.215064:0:12328:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.215071:0:12328:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.215083:0:12328:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.215089:0:12328:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.215100:0:12328:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.215106:0:12328:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7c800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143782.215108:0:12328:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.215114:0:12328:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.215122:0:12328:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143782.215128:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73a9e57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143782.215174:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2008:x1830963622661760:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 28628us (28895us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.215182:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12205 00000100:00100000:2.0:1746143782.215206:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963622664064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 264us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.215211:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5771 00000100:00100000:0.0:1746143782.217814:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.217899:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622664320 00000100:00100000:2.0:1746143782.217909:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622664320 00000100:00100000:3.0:1746143782.218028:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12949 00000100:00100000:3.0:1746143782.218036:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32321:x1830963622664320:12345-192.168.202.3@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143782.218074:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143782.218093:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7c600/0x87925e4cb73a9e49 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b76a expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.218118:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143782.218122:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143782.218143:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.218153:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d7 expref: 268 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.218163:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b660 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.218168:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 268 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.218173:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 6/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.218194:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 268 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.218203:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 268 pid: 7244 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.218213:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626806272:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.219241:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b660 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.219250:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b660 expref: 12 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.219257:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626806400:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.219284:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d7 expref: 268 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.219290:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d7 expref: 268 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.219297:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626806528:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143782.219312:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143782.222960:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.223034:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143782.223098:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143782.223115:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622664448 00000100:00100000:2.0:1746143782.223122:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622664448 00010000:00010000:2.0:1746143782.223152:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 269 pid: 7244 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143782.223468:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622664576 00000100:00100000:2.0:1746143782.223471:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622664576 00010000:00010000:2.0:1746143782.223484:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b660 expref: 13 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143782.223502:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622664704 00000100:00100000:2.0:1746143782.223504:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622664704 00000100:00100000:3.0:1746143782.223507:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5772 00010000:00010000:2.0:1746143782.223512:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d7 expref: 270 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.223515:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+270:2009:x1830963622664448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143782.223534:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5773 00000100:00100000:2.0:1746143782.223538:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622664576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.223545:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143782.223550:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b660 expref: 13 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143782.223550:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5774 00000100:00100000:1.0:1746143782.223556:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+270:2009:x1830963622664704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143782.223558:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b660 expref: 13 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143782.223560:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143782.223564:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d7 expref: 270 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143782.223576:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d7 expref: 270 pid: 14991 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143782.223626:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143782.223631:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143782.223638:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143782.223643:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143782.223645:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143782.223648:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143782.223736:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622664576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 196us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143782.223736:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+270:2009:x1830963622664704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 180us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143782.223742:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5773 00000100:00100000:1.0:1746143782.223820:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5774 00010000:00010000:3.0:1746143782.223968:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143782.223974:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 269 pid: 7244 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.223982:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 269 pid: 7244 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143782.223992:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143782.223995:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.224001:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.224007:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.224022:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143782.224174:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+269:2009:x1830963622664448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 659us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.224180:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5772 00010000:00010000:3.0:1746143782.224232:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73a9c97 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b667 expref: 268 pid: 7244 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.224247:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626806272:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.224255:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73a9c90 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b660 expref: 12 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.224262:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626806400:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.224270:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73a9d62 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b6d7 expref: 267 pid: 14991 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143782.224276:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626806528:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143782.224295:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.224301:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.224306:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000040:00080000:3.0:1746143782.224855:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2717, 88 off226816 00000004:00080000:3.0:1746143782.225149:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841449236159ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143782.225408:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2674, 88 off223384 00000004:00080000:3.0:1746143782.225414:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841449501341ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143782.225587:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2675, 88 off223472 00000004:00080000:3.0:1746143782.225591:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841449678428ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143782.225598:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2718, 88 off226904 00000004:00080000:3.0:1746143782.225600:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841449688138ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143782.225608:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2719, 88 off226992 00000004:00080000:3.0:1746143782.225610:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841449698421ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143782.225616:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2676, 88 off223560 00000004:00080000:3.0:1746143782.225619:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841449706529ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143782.225624:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2677, 88 off223648 00000004:00080000:3.0:1746143782.225626:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841449714422ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143782.225632:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2678, 88 off223736 00000004:00080000:3.0:1746143782.225635:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841449722741ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143782.225640:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2720, 88 off227080 00000004:00080000:3.0:1746143782.225642:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841449730047ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143782.225648:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2679, 88 off223824 00000004:00080000:3.0:1746143782.225649:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841449737338ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143782.225655:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2721, 88 off227168 00000004:00080000:3.0:1746143782.225656:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841449744449ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143782.225662:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2680, 88 off223912 00000004:00080000:3.0:1746143782.225664:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841449751811ns, next at 770855090093ns, rc = 0 00000040:00080000:3.0:1746143782.225669:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2722, 88 off227256 00000004:00080000:3.0:1746143782.225671:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841449759227ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143782.225677:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2723, 88 off227344 00000004:00080000:3.0:1746143782.225679:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841449766581ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143782.225684:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2724, 88 off227432 00000004:00080000:3.0:1746143782.225685:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841449773443ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143782.225691:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2725, 88 off227520 00000004:00080000:3.0:1746143782.225692:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841449780286ns, next at 775898816462ns, rc = 0 00000040:00080000:3.0:1746143782.225698:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2681, 88 off224000 00000004:00080000:3.0:1746143782.225700:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841449787509ns, next at 770855090093ns, rc = 0 00000001:00080000:2.0:1746143782.227488:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943714 is committed 00000004:00080000:2.0:1746143782.227497:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1910 committed 00000004:00080000:2.0:1746143782.227512:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1952 committed 00000004:00080000:2.0:1746143782.227520:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1951 committed 00000004:00080000:2.0:1746143782.227522:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1950 committed 00000004:00080000:2.0:1746143782.227523:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1949 committed 00000004:00080000:2.0:1746143782.227525:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1909 committed 00000004:00080000:2.0:1746143782.227527:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1948 committed 00000004:00080000:2.0:1746143782.227528:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1908 committed 00000004:00080000:2.0:1746143782.227530:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1947 committed 00000004:00080000:2.0:1746143782.227531:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1907 committed 00000004:00080000:2.0:1746143782.227533:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1906 committed 00000004:00080000:2.0:1746143782.227535:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1905 committed 00000004:00080000:2.0:1746143782.227536:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1946 committed 00000004:00080000:2.0:1746143782.227538:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1945 committed 00000004:00080000:2.0:1746143782.227539:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1904 committed 00000004:00080000:2.0:1746143782.227541:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1903 committed 00000004:00080000:2.0:1746143782.227542:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1944 committed 00000001:00080000:2.0:1746143782.227550:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943711 is committed 00000001:00080000:2.0:1746143782.227555:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943710 is committed 00000100:00100000:1.0:1746143782.227714:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626806912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143782.227763:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143782.227786:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626807424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143782.227798:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143782.227812:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746143782.227815:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626807040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143782.227828:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143782.227836:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626807552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143782.227847:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143782.227865:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626806912 00000100:00100000:1.0:1746143782.227870:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626806912 00000100:00100000:1.0:1746143782.227938:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626807424 00000100:00100000:1.0:1746143782.227940:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626807424 00000100:00100000:1.0:1746143782.227949:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626807040 00000100:00100000:1.0:1746143782.227951:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626807040 00000100:00100000:1.0:1746143782.227959:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626807552 00000100:00100000:1.0:1746143782.227961:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626807552 00000100:00100000:1.0:1746143782.227972:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12210 00000100:00100000:1.0:1746143782.227977:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+80:3771:x1830963626806912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143782.228087:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3771:x1830963626806912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (323us total) trans 17179873077 rc 0/0 00000100:00100000:1.0:1746143782.228093:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12210 00000100:00100000:1.0:1746143782.228105:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12211 00000100:00100000:1.0:1746143782.228110:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+80:3771:x1830963626807424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143782.228160:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3771:x1830963626807424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (360us total) trans 17179873078 rc 0/0 00000100:00100000:1.0:1746143782.228165:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12211 00000100:00100000:1.0:1746143782.228173:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12212 00000100:00100000:1.0:1746143782.228176:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+80:3771:x1830963626807040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143782.228210:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143782.228217:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143782.228219:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:1.0:1746143782.228221:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143782.228223:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143782.228237:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3771:x1830963626807040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (408us total) trans 17179873079 rc 0/0 00000100:00100000:0.0:1746143782.228240:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626806784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143782.228241:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12212 00000100:00100000:1.0:1746143782.228249:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12213 00000100:00100000:1.0:1746143782.228253:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+80:3771:x1830963626807552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143782.228264:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143782.228289:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3771:x1830963626807552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 36us (440us total) trans 17179873080 rc 0/0 00000100:00100000:1.0:1746143782.228293:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12213 00000100:00100000:2.0:1746143782.228328:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626806656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143782.228330:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626807296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143782.228347:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143782.228894:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626806784 00000100:00100000:1.0:1746143782.228898:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626806784 00000100:00100000:1.0:1746143782.228933:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12214 00000100:00100000:1.0:1746143782.228937:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3774:x1830963626806784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143782.228998:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+82:3774:x1830963626806784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (733us total) trans 17179873081 rc 0/0 00000100:00100000:1.0:1746143782.229002:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12214 00000100:00100000:1.0:1746143782.229010:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626807296 00000100:00100000:1.0:1746143782.229012:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626807296 00000100:00100000:1.0:1746143782.229023:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12215 00000100:00100000:1.0:1746143782.229027:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+82:3774:x1830963626807296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143782.229047:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626807808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143782.229068:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143782.229076:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626808320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143782.229086:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143782.229104:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e359500/2, rc 0, transno 17179873081 00000100:00100000:0.0:1746143782.229108:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626806784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143782.229114:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143782.229117:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626807680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143782.229130:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143782.229137:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626808192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143782.229148:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143782.229169:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626807808 00000100:00100000:2.0:1746143782.229172:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626807808 00000100:00100000:0.0:1746143782.229183:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626808320 00000100:00100000:0.0:1746143782.229186:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626808320 00000100:00100000:2.0:1746143782.229189:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626807680 00000100:00100000:2.0:1746143782.229191:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626807680 00000100:00100000:0.0:1746143782.229199:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626808192 00000100:00100000:2.0:1746143782.229201:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12216 00000100:00100000:0.0:1746143782.229201:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626808192 00000100:00100000:2.0:1746143782.229205:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+89:3774:x1830963626807808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143782.229216:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+83:3774:x1830963626807296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (868us total) trans 17179873082 rc 0/0 00000100:00100000:1.0:1746143782.229221:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12215 00000004:00080000:0.0:1746143782.229227:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35ad80/2, rc 0, transno 17179873082 00000100:00100000:1.0:1746143782.229230:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12217 00000100:00100000:0.0:1746143782.229230:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626807296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143782.229234:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+89:3774:x1830963626808320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143782.229240:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12218 00000100:00100000:0.0:1746143782.229245:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+90:3774:x1830963626807680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143782.229286:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+91:3774:x1830963626807808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (216us total) trans 21474840411 rc 0/0 00000100:00100000:2.0:1746143782.229291:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12216 00000100:00100000:2.0:1746143782.229302:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12219 00000100:00100000:2.0:1746143782.229306:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+90:3774:x1830963626808192:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746143782.229417:0:7244:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012457d880 reply state ffff880122644800 transno 8589943714 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143782.229430:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+91:3774:x1830963626808320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (342us total) trans 21474840412 rc 0/0 00000004:00080000:0.0:1746143782.229430:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457c700/2, rc 0, transno 21474840411 00000100:00100000:1.0:1746143782.229434:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12217 00010000:00010000:3.0:1746143782.229435:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143782.229437:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626807808:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143782.229442:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143782.229444:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:0.0:1746143782.229445:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457ca80/2, rc 0, transno 21474840412 00000100:00100000:3.0:1746143782.229447:0:7244:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746143782.229447:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626808320:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1746143782.229449:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143782.229451:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143782.229462:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626807936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143782.229478:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1746143782.229505:0:7244:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143782.229514:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32321:x1830963622664320:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 11478us (11715us total) trans 8589943714 rc 0/0 00000100:00100000:3.0:1746143782.229520:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12949 00010000:00010000:3.0:1746143782.229536:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.229543:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.229548:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.229553:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143782.229556:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.229566:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.229574:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143782.229576:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746143782.229576:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626808448:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143782.229578:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143782.229583:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73a9e7a lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143782.229591:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143782.229607:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e358a80/2, rc 0, transno 17179873079 00000100:00100000:1.0:1746143782.229610:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626807040:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143782.229615:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35aa00/2, rc 0, transno 17179873080 00000100:00100000:1.0:1746143782.229617:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626807552:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143782.229622:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e358e00/2, rc 0, transno 17179873077 00000100:00100000:1.0:1746143782.229624:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626806912:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143782.229629:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35b480/2, rc 0, transno 17179873078 00000100:00100000:1.0:1746143782.229631:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626807424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143782.229636:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746143782.229640:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626808064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143782.229652:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143782.229669:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626808576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143782.229681:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143782.229691:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626807936 00000100:00100000:1.0:1746143782.229693:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626808448 00000100:00100000:3.0:1746143782.229694:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626807936 00000100:00100000:1.0:1746143782.229695:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626808448 00000100:00100000:1.0:1746143782.229707:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626808064 00000100:00100000:3.0:1746143782.229709:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626808576 00000100:00100000:1.0:1746143782.229709:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626808064 00000100:00100000:3.0:1746143782.229710:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626808576 00000100:00100000:1.0:1746143782.229715:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12220 00000100:00100000:3.0:1746143782.229718:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12221 00000100:00100000:1.0:1746143782.229719:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+94:3771:x1830963626807936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143782.229721:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3771:x1830963626808448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143782.229755:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12222 00000100:00100000:3.0:1746143782.229759:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+96:3771:x1830963626808064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143782.229771:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+96:3771:x1830963626807936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (292us total) trans 21474840414 rc 0/0 00000100:00100000:1.0:1746143782.229775:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12220 00000100:00100000:1.0:1746143782.229785:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12223 00000100:00100000:1.0:1746143782.229789:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+96:3771:x1830963626808576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143782.229806:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+96:3771:x1830963626808064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (152us total) trans 21474840416 rc 0/0 00000100:00100000:3.0:1746143782.229810:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12222 00000100:00100000:1.0:1746143782.229829:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+96:3771:x1830963626808576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (147us total) trans 21474840417 rc 0/0 00002000:00010000:3.0:1746143782.229830:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143782.229833:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143782.229834:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746143782.229834:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12223 00002000:00010000:3.0:1746143782.229836:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143782.229838:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000004:00080000:1.0:1746143782.229849:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457f100/2, rc 0, transno 21474840416 00000100:00100000:3.0:1746143782.229851:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3771:x1830963626808448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (259us total) trans 21474840415 rc 0/0 00000100:00100000:1.0:1746143782.229852:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626808064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143782.229856:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12221 00000004:00080000:1.0:1746143782.229858:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457df80/2, rc 0, transno 21474840417 00000100:00100000:1.0:1746143782.229861:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626808576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143782.229866:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457c380/2, rc 0, transno 21474840414 00000100:00100000:1.0:1746143782.229869:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626807936:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143782.229873:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457d180/2, rc 0, transno 21474840415 00000100:00100000:1.0:1746143782.229886:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626808448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143782.229929:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+94:3774:x1830963626808192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 606us (763us total) trans 21474840413 rc 0/0 00000100:00100000:2.0:1746143782.229934:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12219 00000100:00100000:2.0:1746143782.229954:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143782.229979:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626807168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143782.229995:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143782.230016:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626806656 00000100:00100000:2.0:1746143782.230019:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626806656 00000100:00100000:2.0:1746143782.230030:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626807168 00000100:00100000:2.0:1746143782.230032:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626807168 00000100:00100000:2.0:1746143782.230040:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12224 00000100:00100000:2.0:1746143782.230045:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3773:x1830963626806656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143782.230097:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3773:x1830963626806656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (142us total) trans 17179873083 rc 0/0 00000100:00100000:2.0:1746143782.230102:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12224 00000100:00100000:2.0:1746143782.230111:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12225 00000100:00100000:2.0:1746143782.230115:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3773:x1830963626807168:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143782.230129:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457f800/2, rc 0, transno 21474840413 00000100:00100000:0.0:1746143782.230133:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626808192:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143782.230147:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143782.230149:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143782.230151:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143782.230152:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143782.230154:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746143782.230161:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143782.230166:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626808704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143782.230169:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3773:x1830963626807168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (173us total) trans 17179873084 rc 0/0 00000100:00100000:2.0:1746143782.230173:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12225 00000100:00100000:0.0:1746143782.230184:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143782.230192:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35a300/2, rc 0, transno 17179873083 00000100:00100000:2.0:1746143782.230196:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626806656:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143782.230201:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e359880/2, rc 0, transno 17179873084 00000100:00100000:2.0:1746143782.230203:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626807168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143782.230211:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626808704 00000100:00100000:2.0:1746143782.230213:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626808704 00000100:00100000:2.0:1746143782.230225:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12226 00000100:00100000:2.0:1746143782.230229:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+95:3774:x1830963626808704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143782.230236:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+95:3774:x1830963626807680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 991us (1104us total) trans 21474840418 rc 0/0 00000100:00100000:0.0:1746143782.230241:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12218 00000004:00080000:0.0:1746143782.230257:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457ed80/2, rc 0, transno 21474840418 00000100:00100000:0.0:1746143782.230260:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626807680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143782.230279:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+95:3774:x1830963626808704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (94us total) trans 21474840419 rc 0/0 00000100:00100000:2.0:1746143782.230283:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12226 00000004:00080000:0.0:1746143782.230289:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094196d80/2, rc 0, transno 21474840419 00000100:00100000:0.0:1746143782.230292:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626808704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143782.234058:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.234343:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622664832 00000100:00100000:3.0:1746143782.234351:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622664832 00000100:00100000:3.0:1746143782.234389:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12950 00000100:00100000:3.0:1746143782.234395:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32321:x1830963622664832:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143782.234413:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.234429:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73a9e81 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b771 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.234475:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73a9e81 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b771 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.234486:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73a9e81 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b771 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143782.234499:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143782.234825:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143782.234833:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467800, rc 0) 00000100:00100000:3.0:1746143782.234951:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32321:x1830963622664832:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 555us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.234956:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12950 00000100:00100000:3.0:1746143782.239905:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.239968:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622664960 00000100:00100000:0.0:1746143782.239976:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622664960 00000100:00100000:0.0:1746143782.240015:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12951 00000100:00100000:0.0:1746143782.240021:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32321:x1830963622664960:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143782.240037:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143782.240051:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9e88 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b778 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143782.240118:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.240129:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.240138:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746143782.240158:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:0.0:1746143782.240163:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143782.240175:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143782.240194:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73a9e88 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b778 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143782.240220:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b778 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143782.240226:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143782.240229:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143782.240232:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c000, rc 0) 00000100:00100000:0.0:1746143782.240265:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32321:x1830963622664960:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 244us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143782.240270:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12951 00000100:00100000:0.0:1746143782.243639:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.243665:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.243683:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.243698:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.243709:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143782.243735:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143782.243790:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622665216 00000100:00100000:3.0:1746143782.243798:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622665216 00000100:00100000:3.0:1746143782.243832:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622665472 00000100:00100000:3.0:1746143782.243834:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622665472 00000100:00100000:3.0:1746143782.243848:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622665728 00000100:00100000:3.0:1746143782.243849:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622665728 00000100:00100000:3.0:1746143782.243858:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622665088 00000100:00100000:3.0:1746143782.243859:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622665088 00000100:00100000:3.0:1746143782.243866:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622665344 00000100:00100000:3.0:1746143782.243868:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622665344 00000100:00100000:3.0:1746143782.243874:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622665600 00000100:00100000:3.0:1746143782.243883:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622665600 00000100:00100000:3.0:1746143782.243894:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12227 00000100:00100000:3.0:1746143782.243899:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622665216:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143782.243927:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.243944:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a9e96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b786 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143782.243961:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x808 00010000:00010000:3.0:1746143782.243975:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.243977:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.243983:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a9e96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b786 expref: 18 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.243994:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a9e96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b786 expref: 18 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244002:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716200, rc 0) 00000100:00100000:3.0:1746143782.244033:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2011:x1830963622665216:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 133us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.244038:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12227 00000100:00100000:3.0:1746143782.244050:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12228 00000100:00100000:3.0:1746143782.244054:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2011:x1830963622665472:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143782.244059:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.244067:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a9e9d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b794 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143782.244077:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x808 00010000:00010000:3.0:1746143782.244083:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.244084:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.244087:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a9e9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b794 expref: 17 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244099:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a9e9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b794 expref: 17 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244105:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717800, rc 0) 00000100:00100000:3.0:1746143782.244114:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622665472:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 60us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.244118:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12228 00000100:00100000:3.0:1746143782.244127:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12229 00000100:00100000:3.0:1746143782.244130:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622665728:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143782.244134:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.244140:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a9ea4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7a2 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143782.244147:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a26, atime: 0x68140a26, ctime: 0x68140a26, blocks: 0x1008 00010000:00010000:3.0:1746143782.244152:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.244153:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.244155:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a9ea4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a2 expref: 18 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244162:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a9ea4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a2 expref: 18 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244167:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717e00, rc 0) 00000100:00100000:3.0:1746143782.244175:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2011:x1830963622665728:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 45us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.244181:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12229 00000100:00100000:3.0:1746143782.244188:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12230 00000100:00100000:3.0:1746143782.244191:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2011:x1830963622665088:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143782.244195:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.244200:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093716c00/0x87925e4cb73a9eab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b77f expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143782.244207:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x7d8 00010000:00010000:3.0:1746143782.244212:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.244213:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.244216:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093716c00/0x87925e4cb73a9eab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b77f expref: 17 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244223:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093716c00/0x87925e4cb73a9eab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b77f expref: 17 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244227:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716c00, rc 0) 00000100:00100000:3.0:1746143782.244237:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622665088:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 46us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.244241:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12230 00000100:00100000:3.0:1746143782.244315:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12231 00000100:00100000:3.0:1746143782.244319:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622665344:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143782.244323:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.244329:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73a9eb2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b78d expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143782.244339:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x800 00010000:00010000:3.0:1746143782.244344:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.244345:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.244347:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73a9eb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b78d expref: 18 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244355:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73a9eb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b78d expref: 18 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244361:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30600, rc 0) 00000100:00100000:3.0:1746143782.244373:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2011:x1830963622665344:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 54us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.244377:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12231 00000100:00100000:3.0:1746143782.244386:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12232 00000100:00100000:3.0:1746143782.244391:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2011:x1830963622665600:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143782.244395:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143782.244402:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a9eb9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b79b expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143782.244409:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4964768, mtime: 0x68140a26, atime: 0x68140a26, ctime: 0x68140a26, blocks: 0x15f0 00010000:00010000:3.0:1746143782.244416:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.244417:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143782.244420:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a9eb9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b79b expref: 17 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244432:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a9eb9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b79b expref: 17 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143782.244438:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30c00, rc 0) 00000100:00100000:3.0:1746143782.244451:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2011:x1830963622665600:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 61us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143782.244456:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12232 00010000:00010000:3.0:1746143782.837139:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143783.255066:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.255322:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.255348:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.255369:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.255379:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.255398:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.255406:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622665856 00000100:00100000:0.0:1746143783.255412:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622665984 00000100:00100000:1.0:1746143783.255413:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622665856 00000100:00100000:0.0:1746143783.255415:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622665984 00000100:00100000:1.0:1746143783.255450:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622666240 00000100:00100000:1.0:1746143783.255452:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622666240 00000100:00100000:0.0:1746143783.255624:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622666496 00000100:00100000:0.0:1746143783.255627:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622666496 00000100:00100000:0.0:1746143783.255638:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622666112 00000100:00100000:0.0:1746143783.255640:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622666112 00000100:00100000:0.0:1746143783.255647:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622666368 00000100:00100000:0.0:1746143783.255649:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622666368 00000100:00100000:0.0:1746143783.255659:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12233 00000100:00100000:0.0:1746143783.255665:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2008:x1830963622665856:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143783.255741:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2008:x1830963622665856:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 76us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.255746:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12233 00000100:00100000:0.0:1746143783.255756:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12234 00000100:00100000:0.0:1746143783.255760:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2009:x1830963622665984:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143783.255784:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+20:2009:x1830963622665984:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.255788:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12234 00000100:00100000:0.0:1746143783.255795:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12235 00000100:00100000:0.0:1746143783.255798:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2009:x1830963622666240:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143783.255816:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2009:x1830963622666240:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 17us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.255820:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12235 00000100:00100000:0.0:1746143783.255825:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12236 00000100:00100000:0.0:1746143783.255829:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2009:x1830963622666496:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143783.255847:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2009:x1830963622666496:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 18us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.255852:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12236 00000100:00100000:0.0:1746143783.255857:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12237 00000100:00100000:0.0:1746143783.255860:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2009:x1830963622666112:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143783.255890:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2009:x1830963622666112:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.255894:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12237 00000100:00100000:0.0:1746143783.255903:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12238 00000100:00100000:0.0:1746143783.255906:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622666368:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143783.255961:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622666368:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 54us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.255966:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12238 00000100:00080000:1.0:1746143783.256070:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143783.256074:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143783.263023:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.264169:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.265393:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.266495:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.266562:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622666624 00000100:00100000:2.0:1746143783.266571:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622666624 00000100:00100000:2.0:1746143783.266613:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622666880 00000100:00100000:2.0:1746143783.266615:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622666880 00000100:00100000:2.0:1746143783.266628:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622667136 00000100:00100000:2.0:1746143783.266630:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622667136 00000100:00100000:2.0:1746143783.266651:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12239 00000100:00100000:2.0:1746143783.266658:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622666624:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143783.266751:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622666624:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 93us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.266758:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12239 00000100:00100000:2.0:1746143783.266774:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12240 00000100:00100000:2.0:1746143783.266778:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622666880:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143783.266811:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2008:x1830963622666880:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 33us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.266816:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12240 00000100:00100000:2.0:1746143783.266823:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12241 00000100:00100000:2.0:1746143783.266828:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622667136:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143783.266856:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622667136:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 28us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.266861:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12241 00000100:00100000:0.0:1746143783.267586:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.267999:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.268026:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622666752 00000100:00100000:0.0:1746143783.268030:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622666752 00000100:00100000:0.0:1746143783.268054:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622667008 00000100:00100000:0.0:1746143783.268055:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622667008 00000100:00100000:0.0:1746143783.268069:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622667264 00000100:00100000:0.0:1746143783.268070:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622667264 00000100:00100000:0.0:1746143783.268081:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12242 00000100:00100000:0.0:1746143783.268086:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2009:x1830963622666752:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143783.268137:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2009:x1830963622666752:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 51us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.268142:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12242 00000100:00100000:0.0:1746143783.268153:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12243 00000100:00100000:0.0:1746143783.268157:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622667008:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143783.268182:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622667008:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.268187:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12243 00000100:00100000:0.0:1746143783.268195:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12244 00000100:00100000:0.0:1746143783.268198:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2009:x1830963622667264:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:0.0:1746143783.268224:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2009:x1830963622667264:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.268228:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12244 00000100:00100000:0.0:1746143783.274620:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.274708:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622667392 00000100:00100000:2.0:1746143783.274715:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622667392 00000100:00100000:2.0:1746143783.274756:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12245 00000100:00100000:2.0:1746143783.274762:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2010:x1830963622667392:12345-192.168.202.3@tcp:22:mirror_io.0 00002000:00010000:2.0:1746143783.276574:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143783.277162:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143783.277165:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:2.0:1746143783.277167:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143783.277169:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:2.0:1746143783.277232:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+19:2010:x1830963622667392:12345-192.168.202.3@tcp:22:mirror_io.0 Request processed in 2465us (2614us total) trans 17179873085 rc 0/0 00000100:00100000:2.0:1746143783.277240:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12245 00000001:00080000:0.0:1746143783.280620:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873085 is committed 00000001:00080000:0.0:1746143783.280629:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873084 is committed 00000001:00080000:0.0:1746143783.280642:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873076 is committed 00000001:00080000:0.0:1746143783.280647:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873075 is committed 00000100:00100000:0.0:1746143783.283035:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.283140:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622667520 00000100:00100000:2.0:1746143783.283148:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622667520 00000100:00100000:2.0:1746143783.283376:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12246 00000100:00100000:2.0:1746143783.283385:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2010:x1830963622667520:12345-192.168.202.3@tcp:22:mirror_io.0 00002000:00010000:2.0:1746143783.283573:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143783.283576:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143783.283578:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143783.283579:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143783.283581:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:2.0:1746143783.283623:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2010:x1830963622667520:12345-192.168.202.3@tcp:22:mirror_io.0 Request processed in 239us (593us total) trans 21474840420 rc 0/0 00000100:00100000:2.0:1746143783.283630:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12246 00000001:00080000:0.0:1746143783.290491:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840420 is committed 00000001:00080000:0.0:1746143783.290614:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840419 is committed 00000001:00080000:0.0:1746143783.290634:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840410 is committed 00000001:00080000:0.0:1746143783.290640:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840409 is committed 00000100:00100000:1.0:1746143783.291391:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.291441:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.291498:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622667904 00000100:00100000:0.0:1746143783.291506:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622667904 00000100:00100000:0.0:1746143783.291562:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622668032 00000100:00100000:0.0:1746143783.291564:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622668032 00000100:00100000:0.0:1746143783.291584:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3558 00000100:00100000:0.0:1746143783.291590:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622667904:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143783.291621:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a9ec0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.291633:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.291635:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.291639:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a9ec0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.291653:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a9ec0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143783.293553:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3559 00000100:00100000:3.0:1746143783.293566:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622668032:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143783.293598:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9ec7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.293609:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.293610:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.293614:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9ec7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.293624:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9ec7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143783.308290:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.308584:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.308672:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622668288 00000100:00100000:2.0:1746143783.308681:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622668288 00000100:00100000:2.0:1746143783.308735:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622668544 00000100:00100000:2.0:1746143783.308738:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622668544 00000100:00100000:2.0:1746143783.308766:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3560 00000100:00100000:2.0:1746143783.308773:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622668288:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143783.308803:0:29557:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73a9ece lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.308814:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.308815:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.308820:0:29557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73a9ece lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.308831:0:29557:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73a9ece lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.309443:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3561 00000100:00100000:2.0:1746143783.309449:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622668544:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143783.309465:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73a9ed5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.309476:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.309477:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.309480:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73a9ed5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.309488:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73a9ed5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143783.310836:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.314161:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622668928 00000100:00100000:3.0:1746143783.314173:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622668928 00000100:00100000:3.0:1746143783.314234:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3562 00000100:00100000:3.0:1746143783.314242:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622668928:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143783.314279:0:29555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9edc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.314292:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.314294:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.314298:0:29555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9edc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.314309:0:29555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9edc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.315762:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.317333:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622669056 00000100:00100000:2.0:1746143783.317336:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.317343:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622669056 00000100:00100000:2.0:1746143783.317368:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.317396:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622669312 00000100:00100000:1.0:1746143783.317398:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622669312 00000100:00100000:1.0:1746143783.317412:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622669568 00000100:00100000:1.0:1746143783.317413:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622669568 00000100:00100000:1.0:1746143783.317489:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3563 00000100:00100000:1.0:1746143783.317498:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622669056:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143783.317531:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a9ee3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.317541:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.317543:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.317546:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a9ee3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.317559:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a9ee3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143783.318311:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3564 00000100:00100000:3.0:1746143783.318317:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622669312:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143783.318333:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9eea lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.318340:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.318341:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.318344:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9eea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.318351:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9eea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143783.318963:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3565 00000100:00100000:1.0:1746143783.318968:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2011:x1830963622669568:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143783.318981:0:29558:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e521000/0x87925e4cb73a9ef1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.318988:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.318989:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.318992:0:29558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521000/0x87925e4cb73a9ef1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.318999:0:29558:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e521000/0x87925e4cb73a9ef1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.327596:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a9ec0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.327614:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a9ec0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.327622:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a9ec0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.327628:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55d800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143783.327631:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a9ec0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.327641:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a9ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.327659:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a9ec0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.327666:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73a9ec0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.327752:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622667904:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 36156us (36360us total) trans 0 rc 1024000/1024000 00000100:00100000:2.0:1746143783.328305:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3558 00010000:00010000:3.0:1746143783.329946:0:13453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9ec7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.329957:0:13453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9ec7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.329965:0:13453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9ec7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.329970:0:13453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143783.329973:0:13453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9ec7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.329980:0:13453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9ec7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.329996:0:13453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9ec7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.330001:0:13453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73a9ec7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143783.330243:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2010:x1830963622668032:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 36676us (38796us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143783.330256:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3559 00010000:00010000:3.0:1746143783.336185:0:29557:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73a9ece lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.336201:0:29557:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73a9ece lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.336208:0:29557:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73a9ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.336216:0:29557:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143783.336220:0:29557:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73a9ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.336227:0:29557:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73a9ece lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.336244:0:29557:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73a9ece lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.336250:0:29557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73a9ece lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143783.336308:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2010:x1830963622668288:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 27531us (28021us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143783.336317:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3560 00010000:00010000:2.0:1746143783.341401:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73a9ed5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.341417:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73a9ed5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.341424:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73a9ed5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.341430:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f635000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143783.341433:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73a9ed5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.341440:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73a9ed5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.341455:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73a9ed5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.341461:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73a9ed5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.341627:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2010:x1830963622668544:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 32173us (33039us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143783.341636:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3561 00010000:00010000:3.0:1746143783.346053:0:29555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9edc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.346067:0:29555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9edc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.346074:0:29555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9edc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.346079:0:29555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143783.346083:0:29555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9edc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.346090:0:29555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9edc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.346103:0:29555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9edc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.346108:0:29555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9edc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143783.346164:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622668928:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 31919us (35326us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143783.346172:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3562 00010000:00010000:1.0:1746143783.360426:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a9ee3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.360441:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a9ee3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.360448:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a9ee3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.360453:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e520200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143783.360456:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a9ee3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.360461:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a9ee3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.360475:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a9ee3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.360480:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73a9ee3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143783.360559:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622669056:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 43056us (44797us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143783.360567:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3563 00010000:00010000:3.0:1746143783.361598:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9eea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.361608:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9eea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.361614:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9eea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.361618:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143783.361621:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9eea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.361626:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9eea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.361635:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9eea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.361639:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9eea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143783.361696:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622669312:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 43378us (44361us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143783.361703:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3564 00010000:00010000:1.0:1746143783.370959:0:29558:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e521000/0x87925e4cb73a9ef1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.370974:0:29558:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521000/0x87925e4cb73a9ef1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.370982:0:29558:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e521000/0x87925e4cb73a9ef1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.370988:0:29558:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e521000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143783.370991:0:29558:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e521000/0x87925e4cb73a9ef1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.370998:0:29558:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e521000/0x87925e4cb73a9ef1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.371012:0:29558:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e521000/0x87925e4cb73a9ef1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.371017:0:29558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e521000/0x87925e4cb73a9ef1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143783.371097:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622669568:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 52125us (53725us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143783.371106:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3565 00000100:00100000:0.0:1746143783.384046:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.384134:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622669696 00000100:00100000:3.0:1746143783.384142:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622669696 00000100:00100000:3.0:1746143783.384193:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 761 00000100:00100000:3.0:1746143783.384201:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32321:x1830963622669696:12345-192.168.202.3@tcp:103:mirror_io.0 00010000:00010000:3.0:1746143783.384212:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143783.384234:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097369e00/0x87925e4cb73a9e3b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b763 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.384259:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143783.384263:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.384296:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32321:x1830963622669696:12345-192.168.202.3@tcp:103:mirror_io.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.384302:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 761 00000100:00100000:0.0:1746143783.389642:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.389808:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622669952 00000100:00100000:2.0:1746143783.389816:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622669952 00000100:00100000:2.0:1746143783.389876:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4761 00000100:00100000:2.0:1746143783.389883:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32321:x1830963622669952:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143783.393359:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32321:x1830963622669952:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 3466us (3714us total) trans 8589943715 rc 0/0 00000100:00100000:2.0:1746143783.393371:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4761 00000100:00100000:0.0:1746143783.394908:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.394990:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622670208 00000100:00100000:2.0:1746143783.394997:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622670208 00000100:00100000:2.0:1746143783.395033:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4762 00000100:00100000:2.0:1746143783.395039:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32321:x1830963622670208:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143783.395184:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32321:x1830963622670208:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 144us (281us total) trans 8589943716 rc 0/0 00000100:00100000:2.0:1746143783.395189:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4762 00000100:00100000:2.0:1746143783.423115:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143783.423136:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626808832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746143783.423196:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143783.423358:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626808832 00000100:00100000:3.0:1746143783.423366:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626808832 00000100:00100000:3.0:1746143783.423419:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1746143783.423425:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963626808832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1746143783.423452:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1012092096 pending 0 free 3912818688 avail 3681296384 00000100:00100000:3.0:1746143783.423497:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963626808832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.423502:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00080000:1.0:1746143783.423568:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143783.426999:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626808832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143783.427597:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.427664:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622670464 00000100:00100000:2.0:1746143783.427670:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622670464 00000100:00100000:2.0:1746143783.427733:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12952 00000100:00100000:2.0:1746143783.427741:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:32333:x1830963622670464:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143783.427760:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143783.427775:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a9ef8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7a9 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.427835:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.427846:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.427855:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.427878:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635000/0x87925e4cb73a9f06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.427884:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635000/0x87925e4cb73a9f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.427889:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635000/0x87925e4cb73a9f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.427999:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428006:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428011:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143783.428018:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143783.428082:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428088:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428093:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428098:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428103:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143783.428106:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428112:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428121:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143783.428123:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143783.428126:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428130:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73a9eff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428144:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635000/0x87925e4cb73a9f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428148:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635000/0x87925e4cb73a9f06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428152:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635000/0x87925e4cb73a9f06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428156:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f635000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143783.428158:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635000/0x87925e4cb73a9f06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428161:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635000/0x87925e4cb73a9f06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428167:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092b11400) 00010000:00010000:2.0:1746143783.428168:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143783.428170:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635000/0x87925e4cb73a9f06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428174:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635000/0x87925e4cb73a9f06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.428204:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a9ef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a9 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.428213:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a9 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.428218:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143783.428220:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143783.428222:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634000, rc 0) 00000100:00100000:2.0:1746143783.428259:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32333:x1830963622670464:12345-192.168.202.3@tcp:101:cat.0 Request processed in 518us (664us total) trans 8589943717 rc 0/0 00000100:00100000:2.0:1746143783.428265:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12952 00000100:00080000:1.0:1746143783.428357:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143783.431763:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.431792:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.431815:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.431835:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.431858:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.431930:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622670720 00000100:00100000:1.0:1746143783.431939:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622670720 00000100:00100000:1.0:1746143783.431983:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622671104 00000100:00100000:1.0:1746143783.431985:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622671104 00000100:00100000:1.0:1746143783.431998:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12953 00000100:00100000:1.0:1746143783.432004:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+260:32334:x1830963622670720:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143783.432022:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143783.432037:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9f1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7b0 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432095:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432104:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432112:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432121:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9f29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432125:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432129:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432196:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432203:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432210:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143783.432217:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143783.432268:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432273:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432277:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432282:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432286:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e521000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143783.432289:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432299:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432307:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143783.432309:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143783.432312:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432315:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521000/0x87925e4cb73a9f22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432326:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432333:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9f29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432337:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9f29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432340:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e520e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143783.432342:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9f29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432345:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9f29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432349:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5be3600) 00010000:00010000:1.0:1746143783.432351:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143783.432352:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9f29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432355:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520e00/0x87925e4cb73a9f29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432379:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73a9f1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b0 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432387:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b0 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432391:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143783.432393:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143783.432394:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e520200, rc 0) 00000100:00100000:1.0:1746143783.432430:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32334:x1830963622670720:12345-192.168.202.3@tcp:101:cat.0 Request processed in 426us (673us total) trans 8589943718 rc 0/0 00000100:00100000:1.0:1746143783.432436:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12953 00000100:00100000:1.0:1746143783.432447:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12954 00000100:00100000:1.0:1746143783.432451:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32329:x1830963622671104:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143783.432463:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143783.432468:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9f3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7be expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432493:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432500:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b778 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432505:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a9 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432510:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b0 expref: 261 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432515:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143783.432535:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b0 expref: 261 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432543:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b0 expref: 261 pid: 7244 timeout: 942 lvb_type: 0 00000100:00100000:1.0:1746143783.432551:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626808960:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143783.432602:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a9 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432608:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a9 expref: 10 pid: 14991 timeout: 942 lvb_type: 0 00000100:00100000:1.0:1746143783.432614:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626809088:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143783.432632:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b778 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432637:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b778 expref: 9 pid: 7244 timeout: 942 lvb_type: 0 00000100:00100000:1.0:1746143783.432643:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626809216:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143783.432654:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143783.432670:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622670848 00000100:00100000:1.0:1746143783.432672:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622670848 00000100:00100000:1.0:1746143783.432694:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622671232 00000100:00100000:1.0:1746143783.432695:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622671232 00000100:00100000:1.0:1746143783.432705:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622671360 00000100:00100000:1.0:1746143783.432707:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622671360 00000100:00100000:1.0:1746143783.432715:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12247 00000100:00100000:1.0:1746143783.432719:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2011:x1830963622670848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143783.432725:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143783.432733:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a9f4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7b7 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432745:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.432747:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.432753:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a9f4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b7 expref: 6 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.432761:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a9f4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b7 expref: 6 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.432767:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512400, rc 0) 00000100:00100000:1.0:1746143783.432779:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2011:x1830963622670848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 60us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143783.432783:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12247 00000100:00100000:1.0:1746143783.432790:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12248 00000100:00100000:1.0:1746143783.432794:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2011:x1830963622671232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143783.432799:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143783.432805:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7c5 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432812:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.432813:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.432816:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 7 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.432824:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 7 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.432829:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512a00, rc 0) 00000100:00100000:1.0:1746143783.432837:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2011:x1830963622671232:12345-192.168.202.3@tcp:101:cat.0 Request processed in 43us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143783.432844:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12248 00000100:00100000:1.0:1746143783.432849:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12249 00000100:00100000:1.0:1746143783.432852:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2011:x1830963622671360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143783.432856:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143783.432860:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124512000/0x87925e4cb73a9f5a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7cc expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.432879:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.432881:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.432884:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124512000/0x87925e4cb73a9f5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7cc expref: 7 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.432891:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124512000/0x87925e4cb73a9f5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7cc expref: 7 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.432896:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512000, rc 0) 00000100:00100000:1.0:1746143783.432906:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2011:x1830963622671360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 53us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143783.432925:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12249 00000100:00080000:0.0:1746143783.433073:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143783.433076:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143783.433078:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143783.434182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.434208:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.434238:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.434292:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622671488 00000100:00100000:3.0:1746143783.434298:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622671488 00000100:00100000:3.0:1746143783.434328:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622671616 00000100:00100000:3.0:1746143783.434330:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622671616 00000100:00100000:3.0:1746143783.434343:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622671744 00000100:00100000:3.0:1746143783.434344:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622671744 00000100:00100000:3.0:1746143783.434358:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12250 00000100:00100000:3.0:1746143783.434362:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2011:x1830963622671488:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143783.434373:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143783.434384:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a9f61 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7d3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.434399:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.434401:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.434406:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a9f61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7d3 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143783.434416:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a9f61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7d3 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143783.434423:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30200, rc 0) 00000100:00100000:3.0:1746143783.434447:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622671488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.434451:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12250 00000100:00100000:3.0:1746143783.434464:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12251 00000100:00100000:3.0:1746143783.434469:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2011:x1830963622671616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143783.434473:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143783.434478:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9f68 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7da expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.434485:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.434486:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.434489:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9f68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7da expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143783.434496:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9f68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7da expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143783.434502:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:3.0:1746143783.434512:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622671616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 44us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.434516:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12251 00000100:00100000:3.0:1746143783.434524:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12252 00000100:00100000:3.0:1746143783.434527:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2011:x1830963622671744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143783.434532:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143783.434538:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9f6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7e1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.434546:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.434547:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.434550:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9f6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e1 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143783.434559:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9f6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e1 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143783.434565:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31e00, rc 0) 00000100:00100000:3.0:1746143783.434576:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622671744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 49us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.434580:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12252 00000100:00100000:1.0:1746143783.438360:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626808960:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143783.438372:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626809088:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143783.438379:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626809216:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143783.438403:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143783.441482:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.441574:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622672384 00000100:00100000:3.0:1746143783.441583:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622672384 00000100:00100000:3.0:1746143783.441631:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12955 00000100:00100000:3.0:1746143783.441640:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+262:32332:x1830963622672384:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143783.441662:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143783.441678:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a9f76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7ef expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.441763:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143783.441776:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143783.441783:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143783.442464:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.442493:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.442520:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.442541:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.442626:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622671872 00000100:00100000:2.0:1746143783.442631:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622671872 00010000:00010000:2.0:1746143783.442656:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a9 expref: 11 pid: 14991 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.442681:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622672000 00000100:00100000:2.0:1746143783.442683:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622672000 00010000:00010000:2.0:1746143783.442691:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b778 expref: 10 pid: 7244 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.442702:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622672512 00000100:00100000:2.0:1746143783.442704:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622672512 00010000:00010000:2.0:1746143783.442710:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b0 expref: 264 pid: 7244 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.442722:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5775 00000100:00100000:2.0:1746143783.442727:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622671872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143783.442737:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143783.442741:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a9 expref: 11 pid: 14991 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.442750:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a9 expref: 11 pid: 14991 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.442766:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73a9f0d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a9 expref: 11 pid: 14991 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.442782:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143783.442786:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143783.442792:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143783.442799:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143783.442833:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622671872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.442839:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5775 00000100:00100000:2.0:1746143783.442851:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5776 00000100:00100000:2.0:1746143783.442855:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622672000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143783.442862:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143783.442878:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b778 expref: 10 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.442885:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b778 expref: 10 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.442895:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73a9e8f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b778 expref: 10 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.442903:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143783.442906:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143783.442934:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143783.442939:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143783.442953:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622672000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 97us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.442958:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5776 00000100:00100000:2.0:1746143783.442970:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5777 00000100:00100000:2.0:1746143783.442975:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:2009:x1830963622672512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143783.442980:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143783.442984:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b0 expref: 264 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.442992:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b0 expref: 264 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.443001:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520200/0x87925e4cb73a9f30 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b0 expref: 264 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.443008:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143783.443011:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143783.443016:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143783.443020:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143783.443026:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.443030:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.443035:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.443051:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143783.443065:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2009:x1830963622672512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 90us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.443070:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5777 00010000:00010000:2.0:1746143783.443108:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143783.443114:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143783.443126:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143783.443207:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73a9f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7ef expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.443220:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7ef expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.443225:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143783.443227:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143783.443229:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30800, rc 0) 00000100:00100000:2.0:1746143783.443248:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+263:32332:x1830963622672384:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1610us (1775us total) trans 8589943719 rc 0/0 00000100:00100000:2.0:1746143783.443253:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12955 00000100:00100000:2.0:1746143783.443265:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622672128 00000100:00100000:2.0:1746143783.443267:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622672128 00000100:00100000:2.0:1746143783.443285:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12956 00000100:00100000:2.0:1746143783.443290:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:32334:x1830963622672128:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143783.443299:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143783.443305:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a9f8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7e8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.443337:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.443345:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143783.443350:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7ef expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.443355:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.443374:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7ef expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.443384:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7ef expref: 264 pid: 14991 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.443392:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626809344:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.443437:0:6587:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746143783.443443:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695da80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143783.443534:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143783.443540:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143783.443550:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143783.443592:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521200/0x87925e4cb73a9f3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7be expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.443603:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7be expref: 10 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.443610:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7be expref: 10 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.443615:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e520c00, rc 0) 00000100:00100000:2.0:1746143783.448403:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32329:x1830963622671104:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 15606us (16242us total) trans 8589943720 rc 0/0 00000100:00100000:2.0:1746143783.448413:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12954 00000100:00100000:0.0:1746143783.449832:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.454959:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.456112:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626809344:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.456246:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143783.456415:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622672640 00000100:00100000:1.0:1746143783.456422:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622672640 00000100:00100000:1.0:1746143783.456459:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622672768 00000100:00100000:1.0:1746143783.456462:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622672768 00000100:00100000:0.0:1746143783.457680:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12957 00000100:00100000:0.0:1746143783.457691:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+265:32332:x1830963622672640:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143783.457707:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143783.457722:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9fa0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7f6 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.457768:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7f6 expref: 266 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.457778:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7f6 expref: 266 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.457792:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143783.457795:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143783.457798:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3000, rc 0) 00000100:00100000:0.0:1746143783.457838:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+266:32332:x1830963622672640:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 150us (8009us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.457848:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12957 00000100:00100000:0.0:1746143783.457893:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12958 00000100:00100000:0.0:1746143783.457899:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32333:x1830963622672768:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143783.457907:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143783.457928:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9fa7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b7fd expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.457946:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7fd expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.457954:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7fd expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.457962:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143783.457964:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143783.457966:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3e00, rc 0) 00000100:00100000:0.0:1746143783.457981:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32333:x1830963622672768:12345-192.168.202.3@tcp:101:cat.0 Request processed in 83us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.457987:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12958 00000100:00100000:0.0:1746143783.460335:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.460384:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.464519:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622672896 00000100:00100000:3.0:1746143783.464531:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622672896 00010000:00010000:3.0:1746143783.464574:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7ef expref: 266 pid: 14991 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143783.464609:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622673024 00000100:00100000:3.0:1746143783.464612:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622673024 00010000:00010000:3.0:1746143783.464622:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7be expref: 11 pid: 7244 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143783.464647:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5778 00000100:00100000:3.0:1746143783.464653:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+266:2008:x1830963622672896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143783.464665:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143783.464671:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7ef expref: 266 pid: 14991 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.464683:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7ef expref: 266 pid: 14991 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.464701:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73a9f7d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7ef expref: 266 pid: 14991 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.464717:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143783.464722:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.464729:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.464734:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.464739:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.464782:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+265:2008:x1830963622672896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 129us (4453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.464788:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5778 00000100:00100000:3.0:1746143783.464803:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5779 00000100:00100000:3.0:1746143783.464807:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129c37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622673024:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143783.464813:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143783.464817:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7be expref: 11 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.464824:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7be expref: 11 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.464834:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e520c00/0x87925e4cb73a9f45 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7be expref: 11 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.464842:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143783.464845:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.464852:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.464857:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.464888:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.464902:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129c37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622673024:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 93us (4518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.464907:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5779 00010000:00010000:2.0:1746143783.465825:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.465833:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143783.465884:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:2.0:1746143783.465888:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143783.465908:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.465932:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.465959:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73a9f8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e8 expref: 265 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.465973:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e8 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.465979:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143783.465981:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143783.465983:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635800, rc 0) 00000100:00100000:2.0:1746143783.466010:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:32334:x1830963622672128:12345-192.168.202.3@tcp:101:cat.0 Request processed in 22720us (23489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.466016:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12956 00000100:00100000:0.0:1746143783.469444:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.469499:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.470591:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622673280 00000100:00100000:2.0:1746143783.470600:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622673280 00000100:00100000:2.0:1746143783.470631:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622673408 00000100:00100000:2.0:1746143783.470633:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622673408 00000100:00100000:2.0:1746143783.470656:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12959 00000100:00100000:2.0:1746143783.470663:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:32332:x1830963622673280:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143783.470678:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143783.470680:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143783.470701:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73a9fa0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7f6 expref: 264 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.470715:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143783.470719:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143783.470726:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a9fae lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b804 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.470768:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.470778:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e8 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.470785:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73a9e81 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b771 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.470791:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9fa7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7fd expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.470796:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.470819:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7fd expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.470828:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7fd expref: 10 pid: 7243 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.470838:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626809472:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.470930:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73a9e81 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b771 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.470937:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73a9e81 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b771 expref: 8 pid: 7244 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.470949:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626809600:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.470979:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e8 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.470986:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e8 expref: 264 pid: 6587 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.470993:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626809728:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143783.471006:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695da80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143783.471062:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12960 00000100:00100000:1.0:1746143783.471069:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32329:x1830963622673408:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143783.471079:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143783.471086:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b80b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.471109:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143783.471115:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.471123:0:7245:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143783.471133:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.471142:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143783.471144:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143783.471146:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143783.471151:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512800, rc 0) 00000100:00100000:1.0:1746143783.471169:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32329:x1830963622673408:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 100us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143783.471175:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12960 00000100:00100000:0.0:1746143783.472834:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.474809:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.474839:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.474859:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.474884:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.474904:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622673536 00000100:00100000:0.0:1746143783.474924:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622673536 00000100:00100000:3.0:1746143783.474926:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622673664 00000100:00100000:3.0:1746143783.474930:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622673664 00000100:00080000:0.0:1746143783.474943:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143783.474946:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143783.474959:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622673792 00000100:00100000:3.0:1746143783.474961:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622673792 00000100:00100000:0.0:1746143783.474964:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622673920 00000100:00100000:0.0:1746143783.474965:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622673920 00000100:00100000:3.0:1746143783.474969:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622674048 00000100:00100000:3.0:1746143783.474971:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622674048 00000100:00100000:0.0:1746143783.474978:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12253 00000100:00100000:3.0:1746143783.475015:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12254 00000100:00100000:3.0:1746143783.475021:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622673536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143783.475037:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143783.475052:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9fc3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b812 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.475057:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12255 00000100:00100000:2.0:1746143783.475063:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622673792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143783.475070:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143783.475077:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.475079:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.475079:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a9fca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b820 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.475086:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b812 expref: 23 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.475087:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.475088:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.475092:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a9fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b820 expref: 23 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143783.475100:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b812 expref: 23 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.475101:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a9fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b820 expref: 23 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143783.475109:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30400, rc 0) 00010000:00010000:2.0:1746143783.475109:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6bb200, rc 0) 00000100:00100000:3.0:1746143783.475141:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622673536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 120us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.475146:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12254 00000100:00100000:3.0:1746143783.475158:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12256 00000100:00100000:3.0:1746143783.475163:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622673920:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143783.475169:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143783.475175:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9fd1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b827 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.475188:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.475190:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.475194:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9fd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b827 expref: 23 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143783.475202:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9fd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b827 expref: 23 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143783.475208:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31200, rc 0) 00000100:00100000:1.0:1746143783.475294:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12257 00000100:00100000:1.0:1746143783.475300:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622674048:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143783.475306:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143783.475312:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a9fd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b82e expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.475320:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.475321:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.475325:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a9fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b82e expref: 24 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.475332:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a9fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b82e expref: 24 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.475338:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4600, rc 0) 00000100:00100000:2.0:1746143783.476088:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622673792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1023us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.476094:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12255 00000100:00100000:0.0:1746143783.477050:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622673664:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143783.477061:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143783.477070:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b819 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.477084:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.477086:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.477091:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.477101:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.477109:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3c00, rc 0) 00000100:00100000:0.0:1746143783.477128:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622673664:12345-192.168.202.3@tcp:101:cat.0 Request processed in 84us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.477133:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12253 00000100:00100000:0.0:1746143783.477187:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.477203:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622674176 00000100:00100000:0.0:1746143783.477208:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622674176 00000100:00100000:0.0:1746143783.477227:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12258 00000100:00100000:0.0:1746143783.477232:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622674176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143783.477238:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143783.477244:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a9fe6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b835 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.477253:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.477254:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.477258:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a9fe6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b835 expref: 24 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.477266:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a9fe6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b835 expref: 24 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.477272:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2c00, rc 0) 00000100:00100000:0.0:1746143783.477287:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622674176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 54us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.477291:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12258 00000100:00100000:0.0:1746143783.477349:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.477418:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622673920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2253us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.477424:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12256 00000100:00100000:1.0:1746143783.477438:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622674048:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2138us (2553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143783.477443:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12257 00000100:00100000:2.0:1746143783.477653:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626809472:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143783.477662:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626809600:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143783.477668:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626809728:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.477691:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143783.477708:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622674432 00000100:00100000:2.0:1746143783.477711:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622674432 00010000:00010000:2.0:1746143783.477725:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7fd expref: 11 pid: 7243 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.478890:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5780 00000100:00100000:2.0:1746143783.478898:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622674432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143783.478909:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143783.478928:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7fd expref: 11 pid: 7243 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.478938:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7fd expref: 11 pid: 7243 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.478954:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3e00/0x87925e4cb73a9fa7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7fd expref: 11 pid: 7243 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.478966:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143783.478970:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.478977:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.478982:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143783.479001:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622674432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 104us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.479007:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5780 00000100:00100000:0.0:1746143783.479321:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.479495:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622674304 00000100:00100000:2.0:1746143783.479500:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622674304 00010000:00010000:2.0:1746143783.479516:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73a9e81 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b771 expref: 9 pid: 7244 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.479989:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5781 00000100:00100000:2.0:1746143783.479996:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622674304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143783.480004:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143783.480007:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73a9e81 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b771 expref: 9 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.480015:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73a9e81 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b771 expref: 9 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.480027:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73a9e81 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b771 expref: 9 pid: 7244 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.480036:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143783.480039:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.480048:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.480051:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143783.480073:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622674304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.480078:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5781 00000100:00100000:0.0:1746143783.483077:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.483133:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622674560 00000100:00100000:3.0:1746143783.483140:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622674560 00010000:00010000:3.0:1746143783.483168:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e8 expref: 265 pid: 6587 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143783.483200:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5782 00000100:00100000:3.0:1746143783.483207:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:2009:x1830963622674560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143783.483220:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143783.483225:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e8 expref: 265 pid: 6587 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.483235:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e8 expref: 265 pid: 6587 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.483256:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73a9f92 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e8 expref: 265 pid: 6587 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.483288:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143783.483292:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.483299:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.483305:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.483311:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.483328:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.483367:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:2009:x1830963622674560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 160us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.483373:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5782 00010000:00010000:2.0:1746143783.483430:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143783.483436:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00000040:00080000:2.0:1746143783.483624:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2726, 88 off227608 00000004:00080000:2.0:1746143783.483629:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842707716432ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143783.483647:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2682, 88 off224088 00000004:00080000:2.0:1746143783.483650:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842707737990ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143783.483659:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2683, 88 off224176 00000004:00080000:2.0:1746143783.483661:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842707748956ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143783.483667:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2727, 88 off227696 00000004:00080000:2.0:1746143783.483669:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842707757112ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143783.483675:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2728, 88 off227784 00000004:00080000:2.0:1746143783.483677:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842707764855ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143783.483682:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2684, 88 off224264 00000004:00080000:2.0:1746143783.483684:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842707772066ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143783.483690:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2685, 88 off224352 00000004:00080000:2.0:1746143783.483691:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842707779323ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143783.483697:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2686, 88 off224440 00000004:00080000:2.0:1746143783.483699:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842707786903ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143783.483705:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2729, 88 off227872 00000004:00080000:2.0:1746143783.483707:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842707795197ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143783.483714:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2687, 88 off224528 00000004:00080000:2.0:1746143783.483716:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842707803922ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143783.483721:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2730, 88 off227960 00000004:00080000:2.0:1746143783.483723:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842707810955ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143783.485980:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2688, 88 off224616 00000004:00080000:2.0:1746143783.485993:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842710079961ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143783.486019:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2731, 88 off228048 00000004:00080000:2.0:1746143783.486022:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842710109872ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143783.487394:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2732, 88 off228136 00000004:00080000:2.0:1746143783.487400:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842711487821ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143783.487408:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2733, 88 off228224 00000004:00080000:2.0:1746143783.487410:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842711498427ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143783.487417:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2734, 88 off228312 00000004:00080000:2.0:1746143783.487419:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842711506496ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143783.487429:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2689, 88 off224704 00000004:00080000:2.0:1746143783.487431:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842711519089ns, next at 770855090093ns, rc = 0 00000100:00100000:1.0:1746143783.487734:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.487752:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.487757:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622674816 00000100:00100000:0.0:1746143783.487764:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622674816 00002000:00100000:0.0:1746143783.487797:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012b7e3100 x1830963622674816/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143783.487806:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e3100 with x1830963622674816 ext(0->1048575) 00002000:00010000:0.0:1746143783.487811:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7e3100 00000100:00100000:1.0:1746143783.487812:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.487825:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622675072 00000100:00100000:1.0:1746143783.487827:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622675328 00000100:00100000:0.0:1746143783.487827:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622675072 00000100:00100000:1.0:1746143783.487829:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622675328 00002000:00100000:0.0:1746143783.487838:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b7e2a00 x1830963622675072/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.487840:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012b7e0000 x1830963622675328/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143783.487846:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e2a00 with x1830963622675072 ext(1048576->2097151) 00002000:00010000:0.0:1746143783.487848:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e2a00 00002000:00100000:1.0:1746143783.487851:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e0000 with x1830963622675328 ext(1048576->2097151) 00002000:00010000:1.0:1746143783.487854:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e0000 00000100:00100000:0.0:1746143783.487858:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3566 00000100:00100000:0.0:1746143783.487863:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622674816:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143783.487877:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3567 00000100:00100000:1.0:1746143783.487882:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2008:x1830963622675072:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143783.488388:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3568 00000100:00100000:2.0:1746143783.488394:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622675328:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143783.490061:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.492243:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622675584 00000100:00100000:2.0:1746143783.492252:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622675584 00002000:00100000:2.0:1746143783.492288:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092b72a00 x1830963622675584/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.492297:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72a00 with x1830963622675584 ext(1048576->2097151) 00002000:00010000:2.0:1746143783.492302:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72a00 00000100:00100000:2.0:1746143783.492331:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3569 00000100:00100000:2.0:1746143783.492340:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622675584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143783.493298:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.493342:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622675712 00000100:00100000:3.0:1746143783.493347:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622675712 00000100:00100000:3.0:1746143783.493381:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12961 00000100:00100000:3.0:1746143783.493387:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:32334:x1830963622675712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143783.493399:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143783.493413:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b83c expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.493456:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 266 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.493471:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 266 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.493481:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143783.493484:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143783.493488:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.493494:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00000100:00100000:3.0:1746143783.493522:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:32334:x1830963622675712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 135us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.493529:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12961 00000100:00100000:0.0:1746143783.499179:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622675072:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11285us (11413us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143783.499189:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3567 00002000:00100000:0.0:1746143783.499199:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88012b7e2a00 x1830963622675072/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143783.499208:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e2a00 with x1830963622675072 ext(1048576->2097151) 00002000:00010000:0.0:1746143783.499214:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e2a00 00000001:00080000:3.0:1746143783.502035:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943721 is committed 00000004:00080000:3.0:1746143783.502046:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1918 committed 00000004:00080000:3.0:1746143783.502064:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1961 committed 00000004:00080000:3.0:1746143783.502071:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1960 committed 00000004:00080000:3.0:1746143783.502073:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1959 committed 00000004:00080000:3.0:1746143783.502075:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1958 committed 00000004:00080000:3.0:1746143783.502076:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1917 committed 00000004:00080000:3.0:1746143783.502078:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1957 committed 00000004:00080000:3.0:1746143783.502079:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1916 committed 00000004:00080000:3.0:1746143783.502081:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1956 committed 00000004:00080000:3.0:1746143783.502082:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1915 committed 00000004:00080000:3.0:1746143783.502084:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1914 committed 00000004:00080000:3.0:1746143783.502085:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1913 committed 00000004:00080000:3.0:1746143783.502087:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1955 committed 00000004:00080000:3.0:1746143783.502088:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1954 committed 00000004:00080000:3.0:1746143783.502089:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1912 committed 00000004:00080000:3.0:1746143783.502091:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1911 committed 00000004:00080000:3.0:1746143783.502093:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1953 committed 00000001:00080000:3.0:1746143783.502099:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943720 is committed 00000001:00080000:3.0:1746143783.502105:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943716 is committed 00000100:00100000:1.0:1746143783.502209:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626809856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143783.502215:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626810112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143783.502325:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626810240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143783.502377:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143783.502400:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626810752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143783.502412:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143783.502422:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626811264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143783.502432:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143783.502441:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626811776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143783.502451:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143783.502477:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626810112 00000100:00100000:0.0:1746143783.502481:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626810112 00000100:00100000:0.0:1746143783.502506:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626810752 00000100:00100000:0.0:1746143783.502507:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626810752 00000100:00100000:0.0:1746143783.502516:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626811264 00000100:00100000:0.0:1746143783.502517:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626811264 00000100:00100000:0.0:1746143783.502524:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626811776 00000100:00100000:0.0:1746143783.502526:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626811776 00000100:00100000:0.0:1746143783.502536:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12259 00000100:00100000:0.0:1746143783.502541:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3774:x1830963626810112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143783.502637:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143783.502640:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143783.502642:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143783.502643:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:0.0:1746143783.502645:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:0.0:1746143783.502666:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3774:x1830963626810112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (290us total) trans 21474840421 rc 0/0 00000100:00100000:0.0:1746143783.502671:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12259 00000100:00100000:0.0:1746143783.502681:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12260 00000100:00100000:0.0:1746143783.502685:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3774:x1830963626810752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143783.502732:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143783.502734:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143783.502735:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143783.502736:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143783.502737:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746143783.502751:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3774:x1830963626810752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (338us total) trans 17179873086 rc 0/0 00000100:00100000:0.0:1746143783.502755:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12260 00000100:00100000:0.0:1746143783.502763:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12261 00000100:00100000:0.0:1746143783.502766:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3774:x1830963626811264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143783.502809:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3774:x1830963626811264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (376us total) trans 17179873087 rc 0/0 00000100:00100000:0.0:1746143783.502813:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12261 00000100:00100000:0.0:1746143783.502820:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12262 00000100:00100000:0.0:1746143783.502824:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3774:x1830963626811776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143783.502862:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3774:x1830963626811776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (410us total) trans 21474840422 rc 0/0 00000100:00100000:0.0:1746143783.502879:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12262 00000100:00100000:0.0:1746143783.502905:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840419 gen 2 00000004:00080000:0.0:1746143783.502908:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911f9880, transno 21474840302 00000004:00080000:0.0:1746143783.502928:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911f9f80, transno 21474840303 00000004:00080000:0.0:1746143783.502931:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911fb100, transno 21474840304 00000004:00080000:0.0:1746143783.502933:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911f9c00, transno 21474840305 00000004:00080000:0.0:1746143783.502935:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911fa680, transno 21474840306 00000004:00080000:0.0:1746143783.502936:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911fa300, transno 21474840307 00000004:00080000:0.0:1746143783.502938:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911f8a80, transno 21474840308 00000004:00080000:0.0:1746143783.502940:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911f9180, transno 21474840309 00000004:00080000:0.0:1746143783.502946:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921ce680, transno 21474840310 00000004:00080000:0.0:1746143783.502948:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093415f80, transno 21474840315 00000004:00080000:0.0:1746143783.502950:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911f8700, transno 21474840316 00000004:00080000:0.0:1746143783.502952:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093415880, transno 21474840317 00000004:00080000:0.0:1746143783.502954:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911f8000, transno 21474840318 00000004:00080000:0.0:1746143783.502956:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911f8e00, transno 21474840319 00000004:00080000:0.0:1746143783.502957:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911f8380, transno 21474840320 00000004:00080000:0.0:1746143783.502960:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093416300, transno 21474840321 00000004:00080000:0.0:1746143783.502962:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800911fad80, transno 21474840322 00000004:00080000:0.0:1746143783.502964:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bdc700, transno 21474840323 00000004:00080000:0.0:1746143783.502966:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093910e00, transno 21474840324 00000004:00080000:0.0:1746143783.502968:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093913800, transno 21474840325 00000004:00080000:0.0:1746143783.502970:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093910380, transno 21474840326 00000004:00080000:0.0:1746143783.502971:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093912a00, transno 21474840327 00000004:00080000:0.0:1746143783.502974:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093911c00, transno 21474840328 00000004:00080000:0.0:1746143783.502976:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ebd880, transno 21474840329 00000004:00080000:0.0:1746143783.502978:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093912300, transno 21474840330 00000004:00080000:0.0:1746143783.502980:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093911880, transno 21474840331 00000004:00080000:0.0:1746143783.502982:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093910000, transno 21474840332 00000004:00080000:0.0:1746143783.502984:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f648700, transno 21474840348 00000004:00080000:0.0:1746143783.502986:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f64aa00, transno 21474840349 00000004:00080000:0.0:1746143783.502988:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f64ad80, transno 21474840350 00000004:00080000:0.0:1746143783.502990:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f64b480, transno 21474840351 00000004:00080000:0.0:1746143783.502991:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f648a80, transno 21474840352 00000004:00080000:0.0:1746143783.502993:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f64bb80, transno 21474840353 00000004:00080000:0.0:1746143783.502995:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f648000, transno 21474840354 00000004:00080000:0.0:1746143783.502997:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f649500, transno 21474840355 00000004:00080000:0.0:1746143783.502999:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f649880, transno 21474840356 00000004:00080000:0.0:1746143783.503001:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f649180, transno 21474840361 00000004:00080000:0.0:1746143783.503003:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cc380, transno 21474840362 00000004:00080000:0.0:1746143783.503005:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cf480, transno 21474840363 00000004:00080000:0.0:1746143783.503006:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cf100, transno 21474840364 00000004:00080000:0.0:1746143783.503009:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921ced80, transno 21474840365 00000004:00080000:0.0:1746143783.503011:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cd880, transno 21474840366 00000004:00080000:0.0:1746143783.503013:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919e6d80, transno 21474840367 00000004:00080000:0.0:1746143783.503015:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cc000, transno 21474840368 00000004:00080000:0.0:1746143783.503017:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921cdc00, transno 21474840369 00000004:00080000:0.0:1746143783.503019:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d842a00, transno 21474840370 00000004:00080000:0.0:1746143783.503022:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d841500, transno 21474840371 00000004:00080000:0.0:1746143783.503024:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d843480, transno 21474840372 00000004:00080000:0.0:1746143783.503026:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d842300, transno 21474840373 00000004:00080000:0.0:1746143783.503028:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b48a80, transno 21474840374 00000004:00080000:0.0:1746143783.503030:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d841f80, transno 21474840375 00000004:00080000:0.0:1746143783.503032:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093726680, transno 21474840376 00000004:00080000:0.0:1746143783.503034:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d840e00, transno 21474840377 00000004:00080000:0.0:1746143783.503035:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d843800, transno 21474840378 00000004:00080000:0.0:1746143783.503037:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919e4380, transno 21474840382 00000004:00080000:0.0:1746143783.503039:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919e7480, transno 21474840383 00000004:00080000:0.0:1746143783.503041:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919e5c00, transno 21474840384 00000004:00080000:0.0:1746143783.503043:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb4e00, transno 21474840385 00000004:00080000:0.0:1746143783.503045:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb5180, transno 21474840386 00000004:00080000:0.0:1746143783.503047:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919e5f80, transno 21474840387 00000004:00080000:0.0:1746143783.503049:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919e7800, transno 21474840388 00000004:00080000:0.0:1746143783.503050:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919e6300, transno 21474840389 00000004:00080000:0.0:1746143783.503052:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919e7100, transno 21474840390 00000004:00080000:0.0:1746143783.503055:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e493b80, transno 21474840391 00000004:00080000:0.0:1746143783.503057:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e490000, transno 21474840392 00000004:00080000:0.0:1746143783.503058:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e490a80, transno 21474840393 00000004:00080000:0.0:1746143783.503060:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e58380, transno 21474840394 00000004:00080000:0.0:1746143783.503062:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e493480, transno 21474840395 00000004:00080000:0.0:1746143783.503064:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e490700, transno 21474840396 00000004:00080000:0.0:1746143783.503066:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e492a00, transno 21474840397 00000004:00080000:0.0:1746143783.503068:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e59c00, transno 21474840398 00000004:00080000:0.0:1746143783.503070:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093727480, transno 21474840399 00000004:00080000:0.0:1746143783.503072:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5ad80, transno 21474840400 00000004:00080000:0.0:1746143783.503074:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e59500, transno 21474840401 00000004:00080000:0.0:1746143783.503076:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5bb80, transno 21474840402 00000004:00080000:0.0:1746143783.503078:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e59f80, transno 21474840403 00000004:00080000:0.0:1746143783.503080:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5b800, transno 21474840404 00000004:00080000:0.0:1746143783.503082:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5a300, transno 21474840405 00000004:00080000:0.0:1746143783.503084:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e59180, transno 21474840406 00000004:00080000:0.0:1746143783.503086:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5aa00, transno 21474840407 00000004:00080000:0.0:1746143783.503088:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e58000, transno 21474840408 00000004:00080000:0.0:1746143783.503090:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457c700, transno 21474840411 00000004:00080000:0.0:1746143783.503092:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457ca80, transno 21474840412 00000004:00080000:0.0:1746143783.503093:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457f800, transno 21474840413 00000004:00080000:0.0:1746143783.503095:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457c380, transno 21474840414 00000004:00080000:0.0:1746143783.503097:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457d180, transno 21474840415 00000004:00080000:0.0:1746143783.503100:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457f100, transno 21474840416 00000004:00080000:0.0:1746143783.503102:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457df80, transno 21474840417 00000004:00080000:0.0:1746143783.503104:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457ed80, transno 21474840418 00000004:00080000:0.0:1746143783.503105:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094196d80, transno 21474840419 00000100:00100000:0.0:1746143783.503109:0:3774:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880092b70e00 x1830963626810112/t21474840421(21474840421) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143799 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143783.503116:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b70e00/2, rc 0, transno 21474840421 00000100:00100000:0.0:1746143783.503120:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626810112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143783.503130:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873084 gen 2 00000004:00080000:0.0:1746143783.503133:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e490e00, transno 17179872981 00000004:00080000:0.0:1746143783.503138:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e491180, transno 17179872982 00000004:00080000:0.0:1746143783.503139:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e491f80, transno 17179872983 00000004:00080000:0.0:1746143783.503141:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e491c00, transno 17179872984 00000004:00080000:0.0:1746143783.503143:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e491500, transno 17179872985 00000004:00080000:0.0:1746143783.503144:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e492300, transno 17179872986 00000004:00080000:0.0:1746143783.503146:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e491880, transno 17179872987 00000004:00080000:0.0:1746143783.503148:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e492680, transno 17179872988 00000004:00080000:0.0:1746143783.503150:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d840380, transno 17179872993 00000004:00080000:0.0:1746143783.503151:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d843100, transno 17179872994 00000004:00080000:0.0:1746143783.503154:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7ab100, transno 17179872995 00000004:00080000:0.0:1746143783.503156:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b21f80, transno 17179872996 00000004:00080000:0.0:1746143783.503157:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b21500, transno 17179872997 00000004:00080000:0.0:1746143783.503159:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b23800, transno 17179872998 00000004:00080000:0.0:1746143783.503161:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b20380, transno 17179872999 00000004:00080000:0.0:1746143783.503163:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b22a00, transno 17179873000 00000004:00080000:0.0:1746143783.503165:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ebce00, transno 17179873001 00000004:00080000:0.0:1746143783.503167:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ebdf80, transno 17179873002 00000004:00080000:0.0:1746143783.503168:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ebe680, transno 17179873003 00000004:00080000:0.0:1746143783.503170:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ebd500, transno 17179873004 00000004:00080000:0.0:1746143783.503172:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ebed80, transno 17179873005 00000004:00080000:0.0:1746143783.503174:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ebd180, transno 17179873006 00000004:00080000:0.0:1746143783.503176:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ebea00, transno 17179873007 00000004:00080000:0.0:1746143783.503178:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ebe300, transno 17179873008 00000004:00080000:0.0:1746143783.503180:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092147b80, transno 17179873020 00000004:00080000:0.0:1746143783.503182:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a7800, transno 17179873021 00000004:00080000:0.0:1746143783.503184:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a4380, transno 17179873022 00000004:00080000:0.0:1746143783.503186:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a6300, transno 17179873023 00000004:00080000:0.0:1746143783.503188:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a5500, transno 17179873024 00000004:00080000:0.0:1746143783.503190:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a5880, transno 17179873025 00000004:00080000:0.0:1746143783.503192:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092146a00, transno 17179873026 00000004:00080000:0.0:1746143783.503194:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092144e00, transno 17179873027 00000004:00080000:0.0:1746143783.503197:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093912d80, transno 17179873032 00000004:00080000:0.0:1746143783.503199:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4c700, transno 17179873033 00000004:00080000:0.0:1746143783.503201:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093913b80, transno 17179873034 00000004:00080000:0.0:1746143783.503203:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093913480, transno 17179873035 00000004:00080000:0.0:1746143783.503205:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4d500, transno 17179873036 00000004:00080000:0.0:1746143783.503206:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093911f80, transno 17179873037 00000004:00080000:0.0:1746143783.503209:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093912680, transno 17179873038 00000004:00080000:0.0:1746143783.503210:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093913100, transno 17179873039 00000004:00080000:0.0:1746143783.503213:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b4b800, transno 17179873040 00000004:00080000:0.0:1746143783.503215:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092145180, transno 17179873041 00000004:00080000:0.0:1746143783.503217:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092146d80, transno 17179873042 00000004:00080000:0.0:1746143783.503220:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b49500, transno 17179873043 00000004:00080000:0.0:1746143783.503221:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092145500, transno 17179873044 00000004:00080000:0.0:1746143783.503223:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092144a80, transno 17179873045 00000004:00080000:0.0:1746143783.503226:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092146300, transno 17179873046 00000004:00080000:0.0:1746143783.503228:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092144000, transno 17179873047 00000004:00080000:0.0:1746143783.503230:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d9c00, transno 17179873049 00000004:00080000:0.0:1746143783.503232:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d9500, transno 17179873050 00000004:00080000:0.0:1746143783.503233:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d9180, transno 17179873051 00000004:00080000:0.0:1746143783.503235:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1dbb80, transno 17179873052 00000004:00080000:0.0:1746143783.503237:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d8380, transno 17179873053 00000004:00080000:0.0:1746143783.503239:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d8700, transno 17179873054 00000004:00080000:0.0:1746143783.503240:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1db100, transno 17179873055 00000004:00080000:0.0:1746143783.503242:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1db800, transno 17179873056 00000004:00080000:0.0:1746143783.503244:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e0700, transno 17179873057 00000004:00080000:0.0:1746143783.503246:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e1880, transno 17179873058 00000004:00080000:0.0:1746143783.503247:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e3b80, transno 17179873059 00000004:00080000:0.0:1746143783.503249:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e1f80, transno 17179873060 00000004:00080000:0.0:1746143783.503251:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e2680, transno 17179873061 00000004:00080000:0.0:1746143783.503253:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e0380, transno 17179873062 00000004:00080000:0.0:1746143783.503254:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e0e00, transno 17179873063 00000004:00080000:0.0:1746143783.503256:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e3800, transno 17179873064 00000004:00080000:0.0:1746143783.503259:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c32d80, transno 17179873065 00000004:00080000:0.0:1746143783.503261:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c32680, transno 17179873066 00000004:00080000:0.0:1746143783.503262:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c31f80, transno 17179873067 00000004:00080000:0.0:1746143783.503264:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c32a00, transno 17179873068 00000004:00080000:0.0:1746143783.503267:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c33800, transno 17179873069 00000004:00080000:0.0:1746143783.503269:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c33b80, transno 17179873070 00000004:00080000:0.0:1746143783.503271:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c31880, transno 17179873071 00000004:00080000:0.0:1746143783.503273:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c30380, transno 17179873072 00000004:00080000:0.0:1746143783.503275:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e358e00, transno 17179873077 00000004:00080000:0.0:1746143783.503277:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35b480, transno 17179873078 00000004:00080000:0.0:1746143783.503278:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e358a80, transno 17179873079 00000004:00080000:0.0:1746143783.503280:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35aa00, transno 17179873080 00000004:00080000:0.0:1746143783.503281:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e359500, transno 17179873081 00000004:00080000:0.0:1746143783.503283:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35ad80, transno 17179873082 00000004:00080000:0.0:1746143783.503284:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35a300, transno 17179873083 00000004:00080000:0.0:1746143783.503286:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e359880, transno 17179873084 00000100:00100000:0.0:1746143783.503289:0:3774:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880093417480 x1830963626810752/t17179873086(17179873086) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143799 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143783.503294:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093417480/2, rc 0, transno 17179873086 00000100:00100000:0.0:1746143783.503297:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626810752:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143783.503305:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093415500/2, rc 0, transno 17179873087 00000100:00100000:0.0:1746143783.503308:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626811264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143783.503313:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b71c00/2, rc 0, transno 21474840422 00000100:00100000:0.0:1746143783.503315:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626811776:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143783.503611:0:8224:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 6 in flight, 90 done 00000100:00100000:3.0:1746143783.504192:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626809984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143783.504203:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143783.504218:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143783.504220:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626810368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143783.504230:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626810496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143783.504233:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143783.504241:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143783.504242:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626810880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143783.504251:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626811008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143783.504253:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143783.504262:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626811392:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143783.504263:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143783.504272:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626811520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143783.504275:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143783.504286:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143783.504287:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626811904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143783.504299:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143783.504305:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626809856 00000100:00100000:3.0:1746143783.504309:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626809856 00000100:00100000:1.0:1746143783.504313:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626809984 00000100:00100000:1.0:1746143783.504315:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626809984 00000100:00100000:3.0:1746143783.504324:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626810496 00000100:00100000:1.0:1746143783.504324:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626810368 00000100:00100000:3.0:1746143783.504325:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626810496 00000100:00100000:1.0:1746143783.504325:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626810368 00000100:00100000:3.0:1746143783.504330:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626810880 00000100:00100000:1.0:1746143783.504331:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626811008 00000100:00100000:3.0:1746143783.504332:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626810880 00000100:00100000:1.0:1746143783.504332:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626811008 00000100:00100000:3.0:1746143783.504337:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626811392 00000100:00100000:1.0:1746143783.504338:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626811520 00000100:00100000:3.0:1746143783.504339:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626811392 00000100:00100000:1.0:1746143783.504340:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626811520 00000100:00100000:3.0:1746143783.504344:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626811904 00000100:00100000:3.0:1746143783.504345:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626811904 00000100:00100000:1.0:1746143783.504347:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12263 00000100:00100000:1.0:1746143783.504351:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3772:x1830963626809984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143783.504352:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12264 00000100:00100000:3.0:1746143783.504355:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3771:x1830963626809856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143783.504404:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12265 00000100:00100000:1.0:1746143783.504409:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963626810496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143783.504413:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143783.504415:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143783.504417:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143783.504419:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143783.504421:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143783.504442:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963626809856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (238us total) trans 17179873088 rc 0/0 00002000:00010000:1.0:1746143783.504442:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143783.504444:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143783.504446:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00000100:00100000:3.0:1746143783.504448:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12264 00002000:00010000:1.0:1746143783.504448:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143783.504450:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143783.504459:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12266 00000100:00100000:3.0:1746143783.504463:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3771:x1830963626810368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143783.504466:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963626810496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (224us total) trans 17179873090 rc 0/0 00000100:00100000:1.0:1746143783.504471:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12265 00000100:00100000:1.0:1746143783.504479:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12267 00000100:00100000:1.0:1746143783.504482:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963626810880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143783.504504:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143783.504506:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143783.504508:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143783.504510:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:3.0:1746143783.504512:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143783.504523:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963626810880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (268us total) trans 17179873091 rc 0/0 00000100:00100000:3.0:1746143783.504524:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3771:x1830963626810368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (290us total) trans 21474840423 rc 0/0 00000100:00100000:1.0:1746143783.504527:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12267 00000100:00100000:3.0:1746143783.504529:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12266 00000100:00100000:1.0:1746143783.504535:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12268 00000100:00100000:3.0:1746143783.504537:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12269 00000100:00100000:1.0:1746143783.504538:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626811008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143783.504541:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3771:x1830963626811392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143783.504579:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3771:x1830963626811392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (302us total) trans 21474840424 rc 0/0 00000100:00100000:1.0:1746143783.504579:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963626811008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (314us total) trans 17179873092 rc 0/0 00000100:00100000:3.0:1746143783.504584:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12269 00000100:00100000:1.0:1746143783.504586:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12268 00000100:00100000:3.0:1746143783.504592:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12270 00000100:00100000:3.0:1746143783.504596:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963626811520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143783.504601:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12271 00000100:00100000:1.0:1746143783.504604:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3771:x1830963626811904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143783.504639:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626811520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (352us total) trans 21474840425 rc 0/0 00000100:00100000:1.0:1746143783.504639:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963626811904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 34us (339us total) trans 21474840426 rc 0/0 00000100:00100000:3.0:1746143783.504643:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12270 00000100:00100000:1.0:1746143783.504645:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12271 00002000:00010000:1.0:1746143783.504663:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143783.504665:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143781 -> 1746143781 00000004:00080000:3.0:1746143783.504667:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e3480/2, rc 0, transno 17179873090 00002000:00010000:1.0:1746143783.504667:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143783.504669:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143781 -> 1746143781 00002000:00010000:1.0:1746143783.504670:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746143783.504671:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626810496:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143783.504676:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093414000/2, rc 0, transno 17179873092 00000100:00100000:3.0:1746143783.504679:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626811008:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143783.504684:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b72d80/2, rc 0, transno 21474840425 00000100:00100000:1.0:1746143783.504684:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626809984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 333us (465us total) trans 17179873089 rc 0/0 00000100:00100000:3.0:1746143783.504687:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626811520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143783.504689:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12263 00000004:00080000:3.0:1746143783.504693:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e1c00/2, rc 0, transno 17179873089 00000100:00100000:3.0:1746143783.504695:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626809984:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143783.505073:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 3 in flight, 80 done 00000004:00080000:1.0:1746143783.505091:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f648700/2, rc 0, transno 21474840426 00000100:00100000:1.0:1746143783.505094:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626811904:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143783.505101:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e2d80/2, rc 0, transno 17179873088 00000100:00100000:1.0:1746143783.505103:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626809856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143783.505108:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143783.505108:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b70380/2, rc 0, transno 21474840423 00000100:00100000:1.0:1746143783.505110:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626810368:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143783.505115:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093414380/2, rc 0, transno 17179873091 00000100:00100000:1.0:1746143783.505117:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626810880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143783.505122:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626810624:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143783.505123:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b71180/2, rc 0, transno 21474840424 00000100:00100000:1.0:1746143783.505126:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626811392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143783.505135:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626810240 00000100:00100000:2.0:1746143783.505137:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143783.505138:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626810240 00000100:00100000:2.0:1746143783.505147:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626811136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143783.505149:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626810624 00000100:00100000:1.0:1746143783.505151:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626810624 00000100:00100000:2.0:1746143783.505158:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143783.505160:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12272 00000100:00100000:1.0:1746143783.505163:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963626810240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143783.505167:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626811648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143783.505177:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143783.505196:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626811136 00000100:00100000:2.0:1746143783.505198:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626811136 00002000:00010000:1.0:1746143783.505200:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143783.505202:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143782 -> 1746143782 00002000:00010000:1.0:1746143783.505204:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143782 -> 1746143782 00002000:00010000:1.0:1746143783.505206:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143782 -> 1746143782 00002000:00010000:1.0:1746143783.505207:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746143783.505208:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626811648 00000100:00100000:2.0:1746143783.505209:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626811648 00000100:00100000:2.0:1746143783.505216:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12273 00000100:00100000:2.0:1746143783.505220:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626810624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143783.505225:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626810240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (118us total) trans 17179873093 rc 0/0 00000100:00100000:1.0:1746143783.505230:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12272 00000100:00100000:1.0:1746143783.505237:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12274 00000100:00100000:1.0:1746143783.505241:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626811136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143783.505257:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:2.0:1746143783.505260:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143782 -> 1746143782 00002000:00010000:2.0:1746143783.505269:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143782 -> 1746143782 00002000:00010000:2.0:1746143783.505270:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143782 -> 1746143782 00002000:00010000:2.0:1746143783.505272:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00000100:00100000:1.0:1746143783.505280:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3773:x1830963626811136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (120us total) trans 21474840428 rc 0/0 00000100:00100000:2.0:1746143783.505285:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3773:x1830963626810624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (147us total) trans 21474840427 rc 0/0 00000100:00100000:1.0:1746143783.505285:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12274 00000100:00100000:2.0:1746143783.505289:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12273 00000100:00100000:1.0:1746143783.505294:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12275 00000100:00100000:1.0:1746143783.505298:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626811648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143783.505330:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143783.505331:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143783.505333:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143783.505334:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00010000:00010000:2.0:1746143783.505336:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b804 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143783.505336:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00010000:00010000:2.0:1746143783.505346:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143783.505349:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1746143783.505351:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963626811648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (172us total) trans 21474840429 rc 0/0 00010000:00010000:2.0:1746143783.505353:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143783.505355:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12275 00010000:00010000:2.0:1746143783.505361:0:6587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.505368:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.505374:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.505380:0:6587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.505386:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.505406:0:6587:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.505415:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626812032:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143783.505478:0:6587:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.505488:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626812160:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143783.505503:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d180 going to sleep for 11 seconds 00000004:00080000:2.0:1746143783.505518:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e2300/2, rc 0, transno 17179873093 00000100:00100000:2.0:1746143783.505521:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626810240:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143783.505527:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b71500/2, rc 0, transno 21474840427 00000100:00100000:2.0:1746143783.505529:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626810624:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143783.505534:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b72680/2, rc 0, transno 21474840428 00000100:00100000:2.0:1746143783.505536:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626811136:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143783.505541:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b72300/2, rc 0, transno 21474840429 00000100:00100000:2.0:1746143783.505543:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626811648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143783.506489:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622675328:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18090us (18671us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143783.506496:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3568 00002000:00100000:3.0:1746143783.506504:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012b7e0000 x1830963622675328/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.506513:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e0000 with x1830963622675328 ext(1048576->2097151) 00002000:00010000:3.0:1746143783.506517:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e0000 00000100:00100000:2.0:1746143783.511100:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622674816:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23227us (23360us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143783.511110:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3566 00002000:00100000:2.0:1746143783.511120:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88012b7e3100 x1830963622674816/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.511128:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e3100 with x1830963622674816 ext(0->1048575) 00002000:00010000:2.0:1746143783.511133:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7e3100 00000100:00100000:3.0:1746143783.512636:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626812032:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143783.512735:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626812160:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143783.512770:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73a9fae lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b804 expref: 263 pid: 6587 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143783.512801:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b804 expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.512828:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4200, rc 0) 00000100:00100000:3.0:1746143783.512876:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32332:x1830963622673280:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 42203us (43429us total) trans 8589943721 rc 0/0 00000100:00100000:3.0:1746143783.512884:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12959 00000100:00100000:0.0:1746143783.513436:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.516705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.516993:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622675840 00000100:00100000:2.0:1746143783.517002:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622675840 00000100:00100000:2.0:1746143783.517041:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622675968 00000100:00100000:2.0:1746143783.517043:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622675968 00000100:00100000:2.0:1746143783.517056:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4763 00000100:00100000:2.0:1746143783.517062:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32329:x1830963622675840:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:2.0:1746143783.517151:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32329:x1830963622675840:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 89us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.517157:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4763 00000100:00100000:2.0:1746143783.517172:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4764 00000100:00100000:2.0:1746143783.517177:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b497050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:32334:x1830963622675968:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:2.0:1746143783.517202:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b497050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:32334:x1830963622675968:12345-192.168.202.3@tcp:49:cat.0 Request processed in 25us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.517207:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4764 00000100:00100000:2.0:1746143783.517794:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622675584:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25455us (27735us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143783.517801:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3569 00002000:00100000:2.0:1746143783.517808:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880092b72a00 x1830963622675584/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.517817:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72a00 with x1830963622675584 ext(1048576->2097151) 00002000:00010000:2.0:1746143783.517821:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72a00 00000100:00100000:0.0:1746143783.521879:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.523255:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622676096 00000100:00100000:3.0:1746143783.523268:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622676096 00000100:00100000:3.0:1746143783.523322:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4765 00000100:00100000:3.0:1746143783.523330:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32332:x1830963622676096:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:3.0:1746143783.523440:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32332:x1830963622676096:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 110us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.523446:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4765 00000100:00100000:0.0:1746143783.534819:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.537896:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622676224 00000100:00100000:1.0:1746143783.537907:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622676224 00000100:00100000:1.0:1746143783.537968:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12276 00000100:00100000:1.0:1746143783.537975:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32329:x1830963622676224:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143783.537991:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143783.538006:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b843 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.538029:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a9ea4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a2 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.538036:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a9fe6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b835 expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.538042:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9f6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e1 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.538047:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.538048:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.538051:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3506176->3698687] (req 3506176->3698687) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 9 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.538074:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9f6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e1 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.538084:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9f6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e1 expref: 9 pid: 9586 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143783.538094:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626812288:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143783.538191:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a9fe6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b835 expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.538202:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a9fe6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b835 expref: 23 pid: 1945 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143783.538210:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093415c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626812416:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143783.538233:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a9ea4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a2 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.538240:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a9ea4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a2 expref: 9 pid: 3134 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143783.538248:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626812544:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143783.538262:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143783.538812:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.538836:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.538859:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.538883:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622676608 00000100:00100000:2.0:1746143783.538886:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622676608 00002000:00100000:2.0:1746143783.538928:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b45180 x1830963622676608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.538936:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45180 with x1830963622676608 ext(0->1048575) 00002000:00010000:2.0:1746143783.538939:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b45180 00000100:00100000:2.0:1746143783.538951:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622676992 00000100:00100000:2.0:1746143783.538953:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622676992 00002000:00100000:2.0:1746143783.538964:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092b45880 x1830963622676992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.538970:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45880 with x1830963622676992 ext(1048576->2097151) 00002000:00010000:2.0:1746143783.538973:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b45880 00000100:00100000:2.0:1746143783.538984:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3570 00000100:00100000:2.0:1746143783.538990:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622676608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143783.539544:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.539931:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622677120 00000100:00100000:3.0:1746143783.539935:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622677120 00002000:00100000:3.0:1746143783.539959:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092b47480 x1830963622677120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.539967:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b47480 with x1830963622677120 ext(1048576->2097151) 00002000:00010000:3.0:1746143783.539970:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b47480 00000100:00100000:3.0:1746143783.539984:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3571 00000100:00100000:3.0:1746143783.539989:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622676992:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143783.540518:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3572 00000100:00100000:3.0:1746143783.540525:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622677120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143783.542733:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622676352 00000100:00100000:0.0:1746143783.542741:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622676352 00000100:00100000:0.0:1746143783.542779:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12277 00000100:00100000:0.0:1746143783.542784:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:32332:x1830963622676352:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143783.542797:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143783.542811:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b84a expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.542833:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a9e96 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b786 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.542840:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.542846:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.542851:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.542853:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.542856:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 29 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.542891:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.542899:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 9 pid: 12327 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143783.543041:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.543058:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622677376 00000100:00100000:1.0:1746143783.543061:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622677376 00002000:00100000:1.0:1746143783.543081:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880093417800 x1830963622677376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.543089:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417800 with x1830963622677376 ext(1048576->2097151) 00002000:00010000:1.0:1746143783.543093:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093417800 00000100:00100000:1.0:1746143783.543103:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3573 00000100:00100000:1.0:1746143783.543107:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622677376:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143783.543799:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626812672:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143783.543857:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.543883:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 29 pid: 9839 timeout: 942 lvb_type: 1 00000100:00100000:0.0:1746143783.543892:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626812800:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143783.543929:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a9e96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b786 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.543937:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a9e96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b786 expref: 9 pid: 3134 timeout: 942 lvb_type: 1 00000100:00100000:0.0:1746143783.543944:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626812928:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143783.543965:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143783.547707:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626812288:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143783.547708:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.547716:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093415c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626812416:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143783.547724:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626812544:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143783.547733:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143783.547753:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3506176->3698687] (req 3506176->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 9 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143783.547761:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143783.547767:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec90800, rc 0) 00000100:00100000:1.0:1746143783.547832:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32329:x1830963622676224:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9857us (13019us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143783.547840:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12276 00000100:00100000:3.0:1746143783.547932:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622677632 00000100:00100000:2.0:1746143783.547933:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622677504 00000100:00100000:3.0:1746143783.547937:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622677632 00000100:00100000:2.0:1746143783.547937:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622677504 00010000:00010000:3.0:1746143783.547958:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a9fe6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b835 expref: 30 pid: 1945 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.547958:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9f6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e1 expref: 9 pid: 9586 timeout: 942 lvb_type: 1 00000100:00100000:2.0:1746143783.547975:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622677760 00000100:00100000:2.0:1746143783.547976:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622677760 00000100:00100000:3.0:1746143783.547983:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5783 00010000:00010000:2.0:1746143783.547984:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a9ea4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a2 expref: 10 pid: 3134 timeout: 942 lvb_type: 1 00000100:00100000:3.0:1746143783.547990:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622677504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143783.547995:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5784 00000100:00100000:2.0:1746143783.547998:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622677632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143783.548000:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143783.548004:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143783.548014:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9f6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e1 expref: 9 pid: 9586 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.548014:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a9fe6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b835 expref: 30 pid: 1945 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.548023:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a9fe6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b835 expref: 30 pid: 1945 timeout: 942 lvb_type: 1 00000100:00100000:0.0:1746143783.548133:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5785 00000100:00100000:0.0:1746143783.548138:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622677760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143783.548144:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143783.548578:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9f6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e1 expref: 9 pid: 9586 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.548596:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31e00/0x87925e4cb73a9f6f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7e1 expref: 9 pid: 9586 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.548643:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73a9fe6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b835 expref: 30 pid: 1945 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.548689:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.548710:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622677504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 721us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.548716:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5783 00010000:00010000:0.0:1746143783.548807:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a9ea4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a2 expref: 10 pid: 3134 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143783.548815:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a9ea4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a2 expref: 10 pid: 3134 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143783.548832:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73a9ea4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7a2 expref: 10 pid: 3134 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.548842:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.548844:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.548853:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 7 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.548863:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 7 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.548881:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143783.548898:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 7 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143783.548898:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622677760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 761us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.548904:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5785 00000100:00100000:2.0:1746143783.548909:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626813056:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143783.548964:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009695d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143783.553755:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.553787:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.553800:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.553841:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.553894:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626812672:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143783.553906:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626812800:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143783.553934:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626812928:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143783.553961:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 29 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.553977:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e522400, rc 0) 00000100:00100000:0.0:1746143783.554014:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:32332:x1830963622676352:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11229us (15202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.554021:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12277 00000100:00100000:3.0:1746143783.554137:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622678016 00000100:00100000:3.0:1746143783.554143:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622678016 00002000:00100000:3.0:1746143783.554171:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88007f64aa00 x1830963622678016/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.554179:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64aa00 with x1830963622678016 ext(1048576->2097151) 00010000:00010000:3.0:1746143783.554186:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 8 pid: 12327 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.554195:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 8 pid: 12327 timeout: 942 lvb_type: 1 00002000:00010000:3.0:1746143783.554201:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007f64aa00 00000100:00100000:3.0:1746143783.554216:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622678272 00000100:00100000:3.0:1746143783.554219:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622678272 00002000:00100000:3.0:1746143783.554230:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012d840380 x1830963622678272/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.554236:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840380 with x1830963622678272 ext(1048576->2097151) 00002000:00010000:3.0:1746143783.554239:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840380 00000100:00100000:3.0:1746143783.554248:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622678528 00000100:00100000:3.0:1746143783.554251:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622678528 00002000:00100000:3.0:1746143783.554262:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88012d843100 x1830963622678528/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.554269:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843100 with x1830963622678528 ext(1048576->2097151) 00002000:00010000:3.0:1746143783.554272:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d843100 00000100:00100000:3.0:1746143783.554282:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1477 00000100:00100000:3.0:1746143783.554287:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622678016:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143783.555012:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3574 00000100:00100000:3.0:1746143783.555018:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622678272:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143783.555295:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3575 00000100:00100000:1.0:1746143783.555302:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622678528:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143783.555965:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622676608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16973us (17125us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143783.555983:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3570 00002000:00100000:2.0:1746143783.555988:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880092b45180 x1830963622676608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.555996:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45180 with x1830963622676608 ext(0->1048575) 00002000:00010000:2.0:1746143783.556000:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b45180 00000100:00100000:2.0:1746143783.556023:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622678656 00000100:00100000:2.0:1746143783.556027:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622678656 00010000:00010000:2.0:1746143783.556041:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a9e96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b786 expref: 9 pid: 3134 timeout: 942 lvb_type: 1 00000100:00100000:2.0:1746143783.556057:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5786 00000100:00100000:2.0:1746143783.556061:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5220050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622678656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143783.556069:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143783.556078:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a9e96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b786 expref: 9 pid: 3134 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.556086:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a9e96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b786 expref: 9 pid: 3134 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.556102:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73a9e96 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b786 expref: 9 pid: 3134 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.556112:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143783.556126:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5220050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622678656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 64us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.556132:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5786 00000100:00100000:2.0:1746143783.559171:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626813056:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143783.559188:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143783.563155:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622677632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 15142us (15436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.563167:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5784 00000100:00100000:0.0:1746143783.563797:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.563799:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622676992:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23810us (24939us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143783.563807:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3571 00002000:00100000:3.0:1746143783.563815:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880092b45880 x1830963622676992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143783.563817:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622678912 00002000:00100000:3.0:1746143783.563823:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45880 with x1830963622676992 ext(1048576->2097151) 00000100:00100000:0.0:1746143783.563823:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622678912 00010000:00010000:3.0:1746143783.563831:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 26 pid: 9839 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.563845:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 26 pid: 9839 timeout: 942 lvb_type: 1 00002000:00100000:0.0:1746143783.563845:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x397:0x0] (3506176->3510271) req@ffff88012d842a00 x1830963622678912/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746143783.563851:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b45880 00002000:00100000:0.0:1746143783.563852:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842a00 with x1830963622678912 ext(3506176->3510271) 00002000:00010000:0.0:1746143783.563855:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d842a00 00000100:00100000:3.0:1746143783.563877:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3576 00000100:00100000:3.0:1746143783.563883:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622678912:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143783.563971:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622678912:12345-192.168.202.3@tcp:3:cat.0 Request processed in 88us (174us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143783.563975:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3576 00002000:00100000:3.0:1746143783.563979:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (3506176->3510271) req@ffff88012d842a00 x1830963622678912/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/4536 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.563985:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842a00 with x1830963622678912 ext(3506176->3510271) 00002000:00010000:3.0:1746143783.563987:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d842a00 00000100:00100000:1.0:1746143783.564810:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.564987:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622679040 00000100:00100000:0.0:1746143783.564990:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622679040 00000100:00100000:0.0:1746143783.565011:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12278 00000100:00100000:0.0:1746143783.565016:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:32334:x1830963622679040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143783.565024:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143783.565036:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b851 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.565052:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.565056:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.565061:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143783.565064:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.565089:0:9839:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.565099:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.565106:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee77000, rc 0) 00000100:00100000:0.0:1746143783.565122:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:32334:x1830963622679040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 106us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.565126:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12278 00000100:00100000:0.0:1746143783.567210:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622677120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 26677us (27658us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143783.567220:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3572 00002000:00100000:0.0:1746143783.567229:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880092b47480 x1830963622677120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143783.567238:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b47480 with x1830963622677120 ext(1048576->2097151) 00002000:00010000:0.0:1746143783.567242:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b47480 00000100:00100000:0.0:1746143783.572097:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.572802:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622677376:12345-192.168.202.3@tcp:3:cat.0 Request processed in 29691us (29758us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143783.572811:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3573 00002000:00100000:1.0:1746143783.572821:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880093417800 x1830963622677376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.572830:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417800 with x1830963622677376 ext(1048576->2097151) 00002000:00010000:1.0:1746143783.572834:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093417800 00000100:00100000:2.0:1746143783.573359:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622679168 00000100:00100000:2.0:1746143783.573367:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622679168 00010000:00010000:2.0:1746143783.573392:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 25 pid: 9839 timeout: 942 lvb_type: 1 00000100:00100000:2.0:1746143783.573423:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5787 00000100:00100000:2.0:1746143783.573429:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622679168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143783.573440:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143783.573455:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 25 pid: 9839 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.573464:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 25 pid: 9839 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.573484:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73a9fdf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b819 expref: 25 pid: 9839 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.573508:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143783.573542:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622679168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 113us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.573547:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5787 00000100:00100000:3.0:1746143783.577796:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622678016:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23501us (24043us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143783.577808:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1477 00002000:00100000:3.0:1746143783.577817:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88007f64aa00 x1830963622678016/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.577826:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64aa00 with x1830963622678016 ext(1048576->2097151) 00010000:00010000:3.0:1746143783.577836:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 10 pid: 12327 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.577849:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 10 pid: 12327 timeout: 942 lvb_type: 1 00002000:00010000:3.0:1746143783.577856:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007f64aa00 00000100:00100000:1.0:1746143783.579095:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622678528:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23789us (25288us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143783.579103:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3575 00002000:00100000:1.0:1746143783.579110:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff88012d843100 x1830963622678528/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.579122:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843100 with x1830963622678528 ext(1048576->2097151) 00002000:00010000:1.0:1746143783.579126:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d843100 00000100:00100000:3.0:1746143783.584771:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622678272:12345-192.168.202.3@tcp:3:cat.0 Request processed in 29744us (30974us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143783.584782:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3574 00002000:00100000:3.0:1746143783.584791:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88012d840380 x1830963622678272/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.584799:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840380 with x1830963622678272 ext(1048576->2097151) 00002000:00010000:3.0:1746143783.584804:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840380 00000100:00100000:0.0:1746143783.588735:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.588817:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622679424 00000100:00100000:3.0:1746143783.588824:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622679424 00002000:00100000:3.0:1746143783.588861:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3694592->3698687) req@ffff88012d843480 x1830963622679424/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.588881:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843480 with x1830963622679424 ext(3694592->3698687) 00002000:00010000:3.0:1746143783.588886:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d843480 00000100:00100000:1.0:1746143783.589083:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3577 00000100:00100000:1.0:1746143783.589093:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622679424:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143783.589210:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622679424:12345-192.168.202.3@tcp:3:cat.0 Request processed in 118us (479us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143783.589216:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3577 00002000:00100000:1.0:1746143783.589221:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3694592->3698687) req@ffff88012d843480 x1830963622679424/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/4536 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.589229:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843480 with x1830963622679424 ext(3694592->3698687) 00002000:00010000:1.0:1746143783.589232:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d843480 00000100:00100000:0.0:1746143783.591325:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.591410:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622679552 00000100:00100000:2.0:1746143783.591416:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622679552 00010000:00010000:2.0:1746143783.591447:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 8 pid: 12327 timeout: 942 lvb_type: 1 00000100:00100000:2.0:1746143783.591480:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5788 00000100:00100000:2.0:1746143783.591486:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622679552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143783.591495:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143783.591510:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 8 pid: 12327 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.591521:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 8 pid: 12327 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.591539:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73a9f53 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7c5 expref: 8 pid: 12327 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.591561:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.591563:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.591569:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 23 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.591576:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 23 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.591603:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 23 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.591613:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 23 pid: 9839 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.591622:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626813312:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143783.591693:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f8796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143783.593528:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626813312:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143783.593544:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143783.593580:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622679552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2094us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.593589:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5788 00000100:00100000:0.0:1746143783.594623:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.596189:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622679808 00000100:00100000:2.0:1746143783.596198:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622679808 00002000:00100000:2.0:1746143783.596238:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (2076672->2080767) req@ffff88012d841f80 x1830963622679808/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.596246:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841f80 with x1830963622679808 ext(2076672->2080767) 00010000:00010000:2.0:1746143783.596254:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 24 pid: 9839 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.596265:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 24 pid: 9839 timeout: 942 lvb_type: 0 00002000:00010000:2.0:1746143783.596270:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d841f80 00000100:00100000:2.0:1746143783.596296:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1478 00000100:00100000:2.0:1746143783.596302:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622679808:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143783.596384:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.596401:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622679808:12345-192.168.202.3@tcp:3:cat.0 Request processed in 98us (1779us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143783.596406:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1478 00002000:00100000:2.0:1746143783.596411:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (2076672->2080767) req@ffff88012d841f80 x1830963622679808/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/4536 e 0 to 0 dl 1746143794 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.596418:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841f80 with x1830963622679808 ext(2076672->2080767) 00010000:00010000:2.0:1746143783.596422:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 24 pid: 9839 timeout: 942 lvb_type: 0 00000100:00100000:1.0:1746143783.596476:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622680064 00000100:00100000:1.0:1746143783.596480:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622680064 00000100:00100000:1.0:1746143783.596503:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4766 00000100:00100000:1.0:1746143783.596508:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32329:x1830963622680064:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143783.596932:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32329:x1830963622680064:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 422us (547us total) trans 8589943722 rc 0/0 00000100:00100000:1.0:1746143783.596938:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4766 00010000:00010000:2.0:1746143783.597009:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 24 pid: 9839 timeout: 942 lvb_type: 0 00002000:00010000:2.0:1746143783.597015:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d841f80 00000100:00100000:0.0:1746143783.599719:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.599754:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.599780:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.599814:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.599843:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622680320 00000100:00100000:3.0:1746143783.599851:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622680320 00000100:00100000:2.0:1746143783.599896:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622680960 00002000:00100000:3.0:1746143783.599897:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012d843800 x1830963622680320/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143783.599900:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622680960 00002000:00100000:3.0:1746143783.599905:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843800 with x1830963622680320 ext(2097152->4194303) 00002000:00010000:3.0:1746143783.599936:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d843800 00002000:00100000:2.0:1746143783.599941:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (2076672->2097151) req@ffff88007f649180 x1830963622680960/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.599948:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649180 with x1830963622680960 ext(2076672->2097151) 00000100:00100000:3.0:1746143783.599953:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622680704 00000100:00100000:3.0:1746143783.599955:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622680704 00010000:00010000:2.0:1746143783.599955:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 24 pid: 9839 timeout: 942 lvb_type: 0 00002000:00100000:3.0:1746143783.599968:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88007f649500 x1830963622680704/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 504/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.599978:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649500 with x1830963622680704 ext(2097152->4194303) 00002000:00010000:3.0:1746143783.599981:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f649500 00000100:00100000:3.0:1746143783.599991:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3578 00000100:00100000:3.0:1746143783.599997:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622680320:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143783.600246:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622680832 00000100:00100000:1.0:1746143783.600250:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622680832 00000100:00100000:1.0:1746143783.600271:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12279 00000100:00100000:1.0:1746143783.600276:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:32332:x1830963622680832:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143783.600285:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143783.600298:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b858 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.600317:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73a9eb2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b78d expref: 7 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.600325:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a9fca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b820 expref: 26 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.600332:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124512000/0x87925e4cb73a9f5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7cc expref: 7 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.600337:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.600339:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143783.600341:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->1146879] (req 1048576->1146879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 26 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.600365:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124512000/0x87925e4cb73a9f5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7cc expref: 7 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.600373:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124512000/0x87925e4cb73a9f5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7cc expref: 7 pid: 12327 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143783.600383:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093415c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626813440:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143783.600435:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a9fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b820 expref: 26 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.600442:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a9fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b820 expref: 26 pid: 13436 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143783.600448:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626813568:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143783.600465:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73a9eb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b78d expref: 7 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143783.600471:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73a9eb2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b78d expref: 7 pid: 3134 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143783.600478:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626813696:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143783.600490:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffafa80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143783.600683:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 26 pid: 9839 timeout: 942 lvb_type: 0 00002000:00010000:2.0:1746143783.600689:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007f649180 00000100:00100000:2.0:1746143783.600704:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1479 00000100:00100000:2.0:1746143783.600710:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622680960:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143783.600789:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3579 00000100:00100000:2.0:1746143783.600795:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622680704:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143783.610525:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093415c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626813440:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143783.610624:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626813568:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143783.610651:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626813696:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143783.610680:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->1146879] (req 1048576->1146879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143783.610696:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84800, rc 0) 00000100:00100000:2.0:1746143783.611686:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.611703:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.611760:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622681216 00000100:00100000:3.0:1746143783.611766:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622681216 00010000:00010000:3.0:1746143783.611824:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73a9eb2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b78d expref: 8 pid: 3134 timeout: 942 lvb_type: 1 00000100:00100000:3.0:1746143783.611848:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622681088 00000100:00100000:3.0:1746143783.611851:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622681088 00010000:00010000:3.0:1746143783.611860:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a9fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b820 expref: 30 pid: 13436 timeout: 942 lvb_type: 1 00000100:00100000:3.0:1746143783.611886:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5789 00000100:00100000:3.0:1746143783.611894:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622681216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143783.611905:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143783.611937:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73a9eb2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b78d expref: 8 pid: 3134 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.611946:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73a9eb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b78d expref: 8 pid: 3134 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.611964:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73a9eb2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b78d expref: 8 pid: 3134 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.611985:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.612013:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622681216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 119us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.612019:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5789 00000100:00100000:3.0:1746143783.612032:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5790 00000100:00100000:3.0:1746143783.612037:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622681088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143783.612045:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143783.612051:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a9fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b820 expref: 30 pid: 13436 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.612060:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a9fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b820 expref: 30 pid: 13436 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.612069:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e6bb200/0x87925e4cb73a9fca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b820 expref: 30 pid: 13436 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143783.612076:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.612090:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622681088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 53us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.612095:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5790 00000100:00100000:1.0:1746143783.612180:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:32332:x1830963622680832:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11901us (12422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143783.612186:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12279 00000100:00100000:3.0:1746143783.613815:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622680960:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13102us (14030us total) trans 17179873094 rc 0/0 00000100:00100000:3.0:1746143783.613825:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1479 00002000:00100000:3.0:1746143783.613834:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (2076672->2097151) req@ffff88007f649180 x1830963622680960/t17179873094(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/448 e 0 to 0 dl 1746143794 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.613844:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649180 with x1830963622680960 ext(2076672->2097151) 00010000:00010000:3.0:1746143783.614033:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 26 pid: 9839 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.614043:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 26 pid: 9839 timeout: 942 lvb_type: 0 00002000:00010000:3.0:1746143783.614050:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007f649180 00000100:00100000:2.0:1746143783.614082:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622680704:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13286us (14266us total) trans 0 rc 1904640/1904640 00000100:00100000:2.0:1746143783.614092:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3579 00002000:00100000:2.0:1746143783.614098:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff88007f649500 x1830963622680704/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 504/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1904640/1904640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.614104:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649500 with x1830963622680704 ext(2097152->4194303) 00002000:00010000:2.0:1746143783.614107:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f649500 00000100:00100000:0.0:1746143783.619332:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.619379:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622681344 00000100:00100000:2.0:1746143783.619387:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622681344 00010000:00010000:2.0:1746143783.619419:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124512000/0x87925e4cb73a9f5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7cc expref: 7 pid: 12327 timeout: 942 lvb_type: 1 00000100:00100000:2.0:1746143783.619463:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5791 00000100:00100000:2.0:1746143783.619472:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622681344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143783.619483:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143783.619498:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124512000/0x87925e4cb73a9f5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7cc expref: 7 pid: 12327 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.619509:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124512000/0x87925e4cb73a9f5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7cc expref: 7 pid: 12327 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.619528:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124512000/0x87925e4cb73a9f5a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7cc expref: 7 pid: 12327 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143783.619551:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.619554:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.619560:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.619572:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.619599:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.619610:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626813824:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143783.619683:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f8796c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143783.620168:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.621561:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622681472 00000100:00100000:2.0:1746143783.621567:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622681472 00010000:00010000:2.0:1746143783.621590:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 26 pid: 9839 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.621618:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5792 00000100:00100000:2.0:1746143783.621624:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963622681472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143783.621634:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143783.621645:0:7229:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143781 -> 1746143784 00002000:00010000:2.0:1746143783.621647:0:7229:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143781 -> 1746143784 00010000:00010000:2.0:1746143783.621652:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 26 pid: 9839 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.621661:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 26 pid: 9839 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.621676:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e522400/0x87925e4cb73a9ffb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b84a expref: 26 pid: 9839 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143783.621686:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.621688:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.621692:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.621699:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.621721:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.621730:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626813952:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143783.622169:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622680320:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22169us (22455us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143783.622174:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143783.622177:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3578 00002000:00100000:3.0:1746143783.622184:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88012d843800 x1830963622680320/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.622193:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843800 with x1830963622680320 ext(2097152->4194303) 00002000:00010000:3.0:1746143783.622196:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d843800 00000100:00100000:2.0:1746143783.624394:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626813824:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143783.624412:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143783.624459:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2008:x1830963622681344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4987us (5132us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.624467:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5791 00000100:00100000:0.0:1746143783.625188:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.627234:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622681728 00000100:00100000:3.0:1746143783.627244:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622681728 00002000:00100000:3.0:1746143783.627285:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1142784->1146879) req@ffff88007f648a80 x1830963622681728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.627294:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648a80 with x1830963622681728 ext(1142784->1146879) 00002000:00010000:3.0:1746143783.627298:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648a80 00000100:00100000:3.0:1746143783.627336:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3580 00000100:00100000:3.0:1746143783.627343:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622681728:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143783.627479:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622681728:12345-192.168.202.3@tcp:3:cat.0 Request processed in 135us (2291us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143783.627486:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3580 00002000:00100000:3.0:1746143783.627492:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1142784->1146879) req@ffff88007f648a80 x1830963622681728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/4536 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.627498:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648a80 with x1830963622681728 ext(1142784->1146879) 00002000:00010000:3.0:1746143783.627500:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648a80 00000100:00100000:3.0:1746143783.627969:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626813952:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143783.627984:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.628020:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963622681472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6395us (7858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.628027:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5792 00000100:00100000:1.0:1746143783.632004:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.632496:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622681984 00000100:00100000:3.0:1746143783.632504:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622681984 00002000:00100000:3.0:1746143783.632540:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880093414700 x1830963622681984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.632549:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414700 with x1830963622681984 ext(1048576->2097151) 00002000:00010000:3.0:1746143783.632554:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093414700 00000100:00100000:3.0:1746143783.632582:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3581 00000100:00100000:3.0:1746143783.632589:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963622681984:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143783.636311:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.636365:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.636424:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622682112 00000100:00100000:0.0:1746143783.636431:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622682112 00000100:00100000:0.0:1746143783.636464:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622682240 00000100:00100000:0.0:1746143783.636466:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622682240 00000100:00100000:0.0:1746143783.636480:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12280 00000100:00100000:0.0:1746143783.636488:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622682112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143783.636504:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143783.636519:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73aa010 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b85f expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.636539:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.636541:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.636548:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73aa010 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b85f expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.636562:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73aa010 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b85f expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.636571:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f6d600, rc 0) 00000100:00100000:0.0:1746143783.636606:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2008:x1830963622682112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 118us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.636612:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12280 00000100:00100000:0.0:1746143783.636625:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12281 00000100:00100000:0.0:1746143783.636629:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622682240:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143783.636634:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143783.636640:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73aa017 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b866 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143783.636674:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626814080:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143783.636731:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143783.641691:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.642012:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622682496 00000100:00100000:1.0:1746143783.642020:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622682496 00000100:00100000:1.0:1746143783.642070:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4767 00000100:00100000:1.0:1746143783.642079:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:32332:x1830963622682496:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143783.642241:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:32332:x1830963622682496:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 162us (556us total) trans 8589943723 rc 0/0 00000100:00100000:1.0:1746143783.642248:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4767 00002000:00010000:2.0:1746143783.642748:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime: 1746143781 -> 1746143784 00002000:00010000:2.0:1746143783.642751:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143781 -> 1746143784 00002000:00010000:2.0:1746143783.642753:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime: 1746143781 -> 1746143784 00000100:00100000:2.0:1746143783.642765:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626814080:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143783.642787:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73aa017 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b866 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.642798:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa000/0x87925e4cb73aa017 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b866 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.642818:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5aa000, rc 0) 00000100:00100000:2.0:1746143783.642839:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622682240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6210us (6474us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143783.642846:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12281 00000100:00100000:3.0:1746143783.643034:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963622681984:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10445us (11036us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143783.643042:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3581 00002000:00100000:3.0:1746143783.643050:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880093414700 x1830963622681984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.643063:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414700 with x1830963622681984 ext(1048576->2097151) 00002000:00010000:3.0:1746143783.643066:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093414700 00000100:00100000:0.0:1746143783.649747:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.650635:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.650719:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622682752 00000100:00100000:3.0:1746143783.650729:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622682752 00000100:00100000:2.0:1746143783.650735:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622683008 00000100:00100000:2.0:1746143783.650739:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622683008 00002000:00100000:3.0:1746143783.650766:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880094195c00 x1830963622682752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.650766:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1146880->2097151) req@ffff880094195180 x1830963622683008/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.650774:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195c00 with x1830963622682752 ext(4194304->4968447) 00002000:00100000:2.0:1746143783.650774:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195180 with x1830963622683008 ext(1146880->2097151) 00002000:00010000:3.0:1746143783.650778:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094195c00 00002000:00010000:2.0:1746143783.650778:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094195180 00000100:00100000:2.0:1746143783.650805:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3582 00000100:00100000:2.0:1746143783.650813:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963622683008:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143783.650889:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3583 00000100:00100000:3.0:1746143783.650894:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622682752:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143783.665749:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622682752:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14846us (16001us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143783.665761:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3583 00002000:00100000:3.0:1746143783.665770:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880094195c00 x1830963622682752/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.665779:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195c00 with x1830963622682752 ext(4194304->4968447) 00002000:00010000:3.0:1746143783.665784:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094195c00 00000100:00100000:2.0:1746143783.666528:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963622683008:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15714us (15892us total) trans 0 rc 950272/950272 00000100:00100000:2.0:1746143783.666535:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3582 00002000:00100000:2.0:1746143783.666540:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1146880->2097151) req@ffff880094195180 x1830963622683008/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.666548:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195180 with x1830963622683008 ext(1146880->2097151) 00002000:00010000:2.0:1746143783.666552:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094195180 00000100:00100000:0.0:1746143783.676188:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.676298:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622683136 00000100:00100000:2.0:1746143783.676307:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622683136 00000100:00100000:2.0:1746143783.676352:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12282 00000100:00100000:2.0:1746143783.676359:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622683136:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143783.676374:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143783.676386:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73aa01e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b86d expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.676432:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626814208:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143783.676504:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143783.682229:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626814208:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143783.682258:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73aa01e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b86d expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.682271:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73aa01e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b86d expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.682299:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25c00, rc 0) 00000100:00100000:2.0:1746143783.682971:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622683136:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6611us (6790us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143783.682978:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12282 00000100:00100000:0.0:1746143783.686433:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.686536:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622683392 00000100:00100000:2.0:1746143783.686543:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622683392 00002000:00100000:2.0:1746143783.686577:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880094196680 x1830963622683392/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.686585:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196680 with x1830963622683392 ext(2097152->3145727) 00002000:00010000:2.0:1746143783.686590:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196680 00000100:00100000:2.0:1746143783.686741:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3584 00000100:00100000:2.0:1746143783.686752:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622683392:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143783.693131:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.693201:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622683520 00000100:00100000:2.0:1746143783.693209:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622683520 00000100:00100000:2.0:1746143783.693258:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12283 00000100:00100000:2.0:1746143783.693266:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622683520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143783.693281:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143783.693297:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73aa025 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b874 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.693340:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626814336:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143783.693432:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143783.699534:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626814336:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143783.699563:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73aa025 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b874 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.699574:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73aa025 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b874 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.700017:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24600, rc 0) 00000100:00100000:2.0:1746143783.700293:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2008:x1830963622683520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7025us (7167us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143783.700300:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12283 00000100:00100000:3.0:1746143783.700548:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622683392:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13799us (14122us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143783.700555:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3584 00002000:00100000:3.0:1746143783.700562:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880094196680 x1830963622683392/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.700570:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196680 with x1830963622683392 ext(2097152->3145727) 00002000:00010000:3.0:1746143783.700575:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196680 00000100:00100000:0.0:1746143783.707681:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.707772:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.707845:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622683904 00000100:00100000:2.0:1746143783.707853:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622683904 00000100:00100000:2.0:1746143783.707896:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12284 00000100:00100000:2.0:1746143783.707903:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:32334:x1830963622683904:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143783.707939:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143783.707952:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b87b expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.707976:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 6 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.707983:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143783.707985:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143783.707988:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 26 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.708010:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 6 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.708019:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 6 pid: 9587 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143783.708029:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626814464:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143783.708150:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622683776 00000100:00100000:1.0:1746143783.708154:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622683776 00000100:00100000:1.0:1746143783.708174:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4768 00000100:00100000:1.0:1746143783.708179:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32333:x1830963622683776:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143783.708309:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32333:x1830963622683776:12345-192.168.202.3@tcp:35:cat.0 Request processed in 129us (635us total) trans 8589943724 rc 0/0 00000100:00100000:1.0:1746143783.708314:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4768 00000100:00100000:2.0:1746143783.708587:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143783.710022:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626814464:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.710044:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 26 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.710056:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25200, rc 0) 00000100:00100000:2.0:1746143783.711020:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:32334:x1830963622683904:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3115us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.711028:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12284 00000100:00100000:0.0:1746143783.712146:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.712555:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622684032 00000100:00100000:3.0:1746143783.712563:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622684032 00002000:00100000:3.0:1746143783.712595:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (3506176->3698687) req@ffff880094195880 x1830963622684032/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.712604:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195880 with x1830963622684032 ext(3506176->3698687) 00010000:00010000:3.0:1746143783.712611:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 7 pid: 9587 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.712622:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 7 pid: 9587 timeout: 942 lvb_type: 0 00002000:00010000:3.0:1746143783.712628:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094195880 00000100:00100000:3.0:1746143783.712655:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1480 00000100:00100000:3.0:1746143783.712662:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2009:x1830963622684032:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143783.726206:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622684032:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13535us (14051us total) trans 17179873095 rc 0/0 00000100:00100000:3.0:1746143783.726218:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1480 00002000:00100000:3.0:1746143783.726230:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (3506176->3698687) req@ffff880094195880 x1830963622684032/t17179873095(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/448 e 0 to 0 dl 1746143794 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.726238:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195880 with x1830963622684032 ext(3506176->3698687) 00010000:00010000:3.0:1746143783.729481:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 9 pid: 9587 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.729506:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 9 pid: 9587 timeout: 942 lvb_type: 0 00002000:00010000:3.0:1746143783.729516:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094195880 00000100:00100000:0.0:1746143783.741705:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.743561:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622684160 00000100:00100000:3.0:1746143783.743571:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622684160 00010000:00010000:3.0:1746143783.743609:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 9 pid: 9587 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143783.743647:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5793 00000100:00100000:3.0:1746143783.743653:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5221050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2011:x1830963622684160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143783.743666:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143783.743679:0:7229:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143782 -> 1746143784 00002000:00010000:3.0:1746143783.743681:0:7229:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143782 -> 1746143784 00002000:00010000:3.0:1746143783.743683:0:7229:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143782 -> 1746143784 00010000:00010000:3.0:1746143783.743687:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 9 pid: 9587 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.743701:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 9 pid: 9587 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.743721:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec90800/0x87925e4cb73a9ff4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3698687) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b843 expref: 9 pid: 9587 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143783.743743:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.743745:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.743750:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.743762:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.743792:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143783.743801:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626814592:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143783.744030:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fed16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143783.749610:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626814592:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143783.749627:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.749840:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5221050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622684160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6184us (8139us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.749849:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5793 00000100:00100000:0.0:1746143783.760087:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.760129:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.760212:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622684416 00000100:00100000:1.0:1746143783.760219:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622684416 00002000:00100000:1.0:1746143783.760255:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880094195500 x1830963622684416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.760264:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195500 with x1830963622684416 ext(2097152->4194303) 00002000:00010000:1.0:1746143783.760269:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094195500 00000100:00100000:1.0:1746143783.760296:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622684672 00000100:00100000:1.0:1746143783.760299:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622684672 00002000:00100000:1.0:1746143783.760309:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880094196300 x1830963622684672/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.760316:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196300 with x1830963622684672 ext(3145728->4194303) 00002000:00010000:1.0:1746143783.760319:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196300 00000100:00100000:1.0:1746143783.760329:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3585 00000100:00100000:2.0:1746143783.760336:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3586 00000100:00100000:1.0:1746143783.760336:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622684416:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143783.760346:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622684672:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143783.770659:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622684672:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10308us (10521us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143783.770669:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3586 00002000:00100000:2.0:1746143783.770679:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880094196300 x1830963622684672/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.770687:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196300 with x1830963622684672 ext(3145728->4194303) 00002000:00010000:2.0:1746143783.770692:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196300 00000100:00100000:1.0:1746143783.776178:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622684416:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15834us (16091us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143783.776188:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3585 00002000:00100000:1.0:1746143783.776199:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880094195500 x1830963622684416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.776207:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195500 with x1830963622684416 ext(2097152->4194303) 00002000:00010000:1.0:1746143783.776212:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094195500 00000100:00100000:0.0:1746143783.786338:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.786462:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622684928 00000100:00100000:1.0:1746143783.786468:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622684928 00002000:00100000:1.0:1746143783.786500:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880094194e00 x1830963622684928/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.786509:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194e00 with x1830963622684928 ext(4194304->4968447) 00002000:00010000:1.0:1746143783.786514:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094194e00 00000100:00100000:1.0:1746143783.786543:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3587 00000100:00100000:1.0:1746143783.786551:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622684928:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143783.793135:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622684928:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6577us (6798us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143783.793145:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3587 00002000:00100000:2.0:1746143783.793155:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880094194e00 x1830963622684928/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.793164:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194e00 with x1830963622684928 ext(4194304->4968447) 00002000:00010000:2.0:1746143783.793169:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094194e00 00000100:00100000:0.0:1746143783.800409:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.800634:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622685184 00000100:00100000:3.0:1746143783.800642:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622685184 00000100:00100000:3.0:1746143783.800688:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4769 00000100:00100000:3.0:1746143783.800695:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:32334:x1830963622685184:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143783.800871:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:32334:x1830963622685184:12345-192.168.202.3@tcp:35:cat.0 Request processed in 166us (459us total) trans 8589943725 rc 0/0 00000100:00100000:3.0:1746143783.800878:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4769 00000100:00100000:0.0:1746143783.827432:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.827691:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622685440 00000100:00100000:3.0:1746143783.827700:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622685440 00000100:00100000:3.0:1746143783.827754:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12962 00000100:00100000:3.0:1746143783.827762:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32341:x1830963622685440:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143783.827785:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143783.827800:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ca00/0x87925e4cb73aa033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b882 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.828166:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828177:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828188:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828199:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73aa041 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828205:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73aa041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828210:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73aa041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828294:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828301:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828305:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143783.828312:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143783.828366:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828376:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828380:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828385:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828390:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55dc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143783.828392:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828398:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828406:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143783.828408:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143783.828412:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828416:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa03a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828444:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73aa041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828449:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73aa041 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828453:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73aa041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828456:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55cc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143783.828459:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73aa041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828463:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73aa041 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828468:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800937ac900) 00010000:00010000:3.0:1746143783.828470:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143783.828472:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73aa041 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828476:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73aa041 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.828507:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55ca00/0x87925e4cb73aa033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b882 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.828515:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b882 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.828520:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143783.828522:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143783.828523:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c800, rc 0) 00000100:00100000:3.0:1746143783.828575:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32341:x1830963622685440:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 814us (1150us total) trans 8589943726 rc 0/0 00000100:00100000:3.0:1746143783.828581:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12962 00010000:00010000:2.0:1746143783.839188:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143783.839752:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.839809:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622685696 00000100:00100000:3.0:1746143783.839818:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622685696 00000100:00100000:3.0:1746143783.839877:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12963 00000100:00100000:3.0:1746143783.839884:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32345:x1830963622685696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143783.839908:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143783.839941:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73aa056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b889 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.840020:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.840031:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143783.840039:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143783.840046:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143783.840110:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73aa056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b889 expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.840137:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b889 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.840143:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143783.840145:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143783.840147:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d800, rc 0) 00000100:00100000:3.0:1746143783.840188:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32345:x1830963622685696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 305us (440us total) trans 8589943727 rc 0/0 00000100:00100000:3.0:1746143783.840193:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12963 00000100:00100000:0.0:1746143783.842053:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.842145:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.842299:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622685824 00000100:00100000:2.0:1746143783.842305:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622685824 00000100:00100000:2.0:1746143783.842342:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622685952 00000100:00100000:2.0:1746143783.842345:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622685952 00000100:00100000:2.0:1746143783.842365:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12285 00000100:00100000:2.0:1746143783.842370:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2011:x1830963622685824:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143783.842382:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143783.842393:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa06b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b890 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143783.842430:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626814720:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143783.842486:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143783.842591:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12286 00000100:00100000:0.0:1746143783.842597:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622685952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143783.842603:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143783.842609:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73aa072 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b897 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.842619:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.842621:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.842627:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73aa072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b897 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.842639:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73aa072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b897 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143783.842647:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3400, rc 0) 00000100:00100000:0.0:1746143783.842668:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622685952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 72us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.842673:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12286 00000100:00100000:2.0:1746143783.845260:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626814720:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143783.845285:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa06b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b890 expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.845297:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa06b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b890 expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.845318:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26c00, rc 0) 00000100:00100000:2.0:1746143783.845348:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2011:x1830963622685824:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2977us (3298us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143783.845360:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12285 00000100:00100000:0.0:1746143783.860490:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.860564:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.861397:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622686336 00000100:00100000:2.0:1746143783.861407:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622686336 00002000:00100000:2.0:1746143783.861453:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88009c4d7480 x1830963622686336/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.861463:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7480 with x1830963622686336 ext(0->1048575) 00002000:00010000:2.0:1746143783.861468:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d7480 00000100:00100000:2.0:1746143783.861503:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622686464 00000100:00100000:2.0:1746143783.861508:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622686464 00002000:00100000:2.0:1746143783.861526:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88009c4d5500 x1830963622686464/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.861534:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5500 with x1830963622686464 ext(1048576->2097151) 00002000:00010000:2.0:1746143783.861537:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d5500 00000100:00100000:0.0:1746143783.861541:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3588 00000100:00100000:0.0:1746143783.861556:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622686336:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143783.861852:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3589 00000100:00100000:2.0:1746143783.861875:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622686464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143783.875852:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622686464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13983us (15280us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143783.877307:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3589 00002000:00100000:2.0:1746143783.877321:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88009c4d5500 x1830963622686464/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.877329:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5500 with x1830963622686464 ext(1048576->2097151) 00002000:00010000:2.0:1746143783.877334:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d5500 00000100:00100000:0.0:1746143783.878042:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.878061:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622686720 00000100:00100000:0.0:1746143783.878066:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622686720 00000100:00100000:0.0:1746143783.878112:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12964 00000100:00100000:0.0:1746143783.878118:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:32347:x1830963622686720:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143783.878136:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143783.878149:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73aa079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b89e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.878203:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878214:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878222:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878233:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73aa087 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878238:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73aa087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878242:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73aa087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878324:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878332:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878337:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746143783.878344:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:0.0:1746143783.878399:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878405:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878410:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878415:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878419:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143783.878422:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878428:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878439:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143783.878442:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143783.878445:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878449:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3200/0x87925e4cb73aa080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878463:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73aa087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878468:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73aa087 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878472:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73aa087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878476:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143783.878478:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73aa087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878482:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73aa087 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878486:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008219e900) 00010000:00010000:0.0:1746143783.878487:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143783.878489:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73aa087 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878492:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73aa087 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143783.878518:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73aa079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b89e expref: 267 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.878526:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b89e expref: 266 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.878532:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143783.878533:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143783.878535:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2c00, rc 0) 00000100:00100000:0.0:1746143783.878563:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:32347:x1830963622686720:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 445us (522us total) trans 8589943728 rc 0/0 00000100:00100000:0.0:1746143783.878568:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12964 00000100:00100000:2.0:1746143783.878638:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622686336:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17085us (18157us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143783.878644:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3588 00002000:00100000:2.0:1746143783.878649:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff88009c4d7480 x1830963622686336/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.878657:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7480 with x1830963622686336 ext(0->1048575) 00002000:00010000:2.0:1746143783.878660:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d7480 00000100:00100000:0.0:1746143783.883475:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.883742:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622686848 00000100:00100000:2.0:1746143783.883750:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622686848 00000100:00100000:2.0:1746143783.883857:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12287 00000100:00100000:2.0:1746143783.883876:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32341:x1830963622686848:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143783.883891:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143783.883905:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8a5 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.883959:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a9eb9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b79b expref: 8 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.883966:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a9fd8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b82e expref: 22 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.883971:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9f68 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7da expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.883976:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.883977:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.883979:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3481600->4059135] (req 3481600->4059135) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 9 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.884002:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9f68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7da expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.884011:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9f68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7da expref: 9 pid: 9586 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143783.884021:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626814848:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.884094:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a9fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b82e expref: 22 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.884102:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a9fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b82e expref: 22 pid: 1947 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143783.884110:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626814976:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.884133:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a9eb9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b79b expref: 8 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.884139:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a9eb9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b79b expref: 8 pid: 3134 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143783.884143:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626815104:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143783.884153:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143783.890450:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626814848:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143783.890462:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626814976:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143783.890468:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626815104:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.890493:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3481600->4059135] (req 3481600->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 9 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.890509:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27600, rc 0) 00000100:00100000:2.0:1746143783.890547:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32341:x1830963622686848:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6672us (7077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.890554:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12287 00000100:00100000:0.0:1746143783.890692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.890748:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622686976 00000100:00100000:3.0:1746143783.890754:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622686976 00010000:00010000:3.0:1746143783.890775:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a9fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b82e expref: 23 pid: 1947 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143783.890784:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.890889:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622687104 00000100:00100000:1.0:1746143783.890893:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622687104 00010000:00010000:1.0:1746143783.890905:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a9eb9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b79b expref: 9 pid: 3134 timeout: 943 lvb_type: 1 00000100:00100000:1.0:1746143783.890945:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5794 00000100:00100000:1.0:1746143783.890950:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622686976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143783.890960:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143783.890975:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a9fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b82e expref: 23 pid: 1947 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143783.890983:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a9fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b82e expref: 23 pid: 1947 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143783.890994:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5795 00010000:00010000:1.0:1746143783.891000:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73a9fd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b82e expref: 23 pid: 1947 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143783.891001:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622687104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143783.891008:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143783.891011:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143783.891016:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a9eb9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b79b expref: 9 pid: 3134 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143783.891024:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a9eb9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b79b expref: 9 pid: 3134 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143783.891034:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73a9eb9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b79b expref: 9 pid: 3134 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143783.891154:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143783.891157:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622686976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 206us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143783.891163:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5794 00000100:00100000:0.0:1746143783.891168:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622687104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 169us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.891173:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5795 00000100:00100000:0.0:1746143783.891814:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.891852:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622687232 00000100:00100000:3.0:1746143783.891857:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622687232 00010000:00010000:3.0:1746143783.891879:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9f68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7da expref: 9 pid: 9586 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143783.891905:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5796 00000100:00100000:3.0:1746143783.891926:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2011:x1830963622687232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143783.891933:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143783.891941:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9f68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7da expref: 9 pid: 9586 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143783.891949:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9f68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7da expref: 9 pid: 9586 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143783.891960:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30e00/0x87925e4cb73a9f68 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7da expref: 9 pid: 9586 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143783.891982:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.891983:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.891989:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 8 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.891995:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 8 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.892019:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 8 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143783.892029:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626815232:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143783.892089:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143783.893061:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963626815232:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143783.893072:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.893564:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622687232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1651us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.893570:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5796 00000100:00100000:0.0:1746143783.896502:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.896692:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622687488 00000100:00100000:3.0:1746143783.896699:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622687488 00002000:00100000:3.0:1746143783.896735:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3481600->3485695) req@ffff880093727b80 x1830963622687488/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.896743:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093727b80 with x1830963622687488 ext(3481600->3485695) 00002000:00010000:3.0:1746143783.896747:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093727b80 00000100:00100000:3.0:1746143783.896764:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3590 00000100:00100000:3.0:1746143783.896770:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622687488:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143783.896895:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622687488:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 124us (399us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143783.896901:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3590 00002000:00100000:3.0:1746143783.896906:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3481600->3485695) req@ffff880093727b80 x1830963622687488/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/4536 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.896928:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093727b80 with x1830963622687488 ext(3481600->3485695) 00002000:00010000:3.0:1746143783.896931:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093727b80 00000100:00100000:0.0:1746143783.898667:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.898803:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622687616 00000100:00100000:2.0:1746143783.898808:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622687616 00000100:00100000:2.0:1746143783.898839:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12288 00000100:00100000:2.0:1746143783.898844:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32345:x1830963622687616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143783.898853:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143783.899156:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8ac expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.899180:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.899186:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143783.899188:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143783.899191:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 10 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.899214:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 25 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.899223:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 25 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143783.899232:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626815360:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143783.899295:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143783.900992:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626815360:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.901013:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 10 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.901025:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27800, rc 0) 00000100:00100000:2.0:1746143783.901052:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32345:x1830963622687616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2208us (2387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.901058:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12288 00000100:00100000:0.0:1746143783.901558:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.901756:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622687744 00000100:00100000:1.0:1746143783.901761:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622687744 00002000:00100000:1.0:1746143783.901963:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1146879) req@ffff880093725880 x1830963622687744/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.901971:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725880 with x1830963622687744 ext(1048576->1146879) 00010000:00010000:1.0:1746143783.901978:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 26 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143783.901988:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 26 pid: 9587 timeout: 943 lvb_type: 0 00002000:00010000:1.0:1746143783.901994:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093725880 00000100:00100000:1.0:1746143783.902021:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1481 00000100:00100000:1.0:1746143783.902026:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622687744:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143783.906819:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.907349:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622688000 00000100:00100000:3.0:1746143783.907356:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622688000 00002000:00100000:3.0:1746143783.907392:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4055040->4059135) req@ffff880093725c00 x1830963622688000/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.907400:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725c00 with x1830963622688000 ext(4055040->4059135) 00002000:00010000:3.0:1746143783.907405:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093725c00 00000100:00100000:3.0:1746143783.907422:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3591 00000100:00100000:3.0:1746143783.907429:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622688000:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143783.907543:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622688000:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 114us (730us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143783.907549:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3591 00002000:00100000:3.0:1746143783.907554:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4055040->4059135) req@ffff880093725c00 x1830963622688000/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/4536 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.907560:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725c00 with x1830963622688000 ext(4055040->4059135) 00002000:00010000:3.0:1746143783.907563:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093725c00 00000100:00100000:1.0:1746143783.910205:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622687744:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8172us (8641us total) trans 17179873096 rc 0/0 00000100:00100000:1.0:1746143783.910216:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1481 00002000:00100000:1.0:1746143783.910224:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1146879) req@ffff880093725880 x1830963622687744/t17179873096(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/448 e 0 to 0 dl 1746143794 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.910232:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725880 with x1830963622687744 ext(1048576->1146879) 00010000:00010000:1.0:1746143783.910240:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 28 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143783.910253:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 28 pid: 9587 timeout: 943 lvb_type: 0 00002000:00010000:1.0:1746143783.910259:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093725880 00000100:00100000:0.0:1746143783.911197:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.911264:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622688256 00000100:00100000:1.0:1746143783.911271:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622688256 00000100:00100000:1.0:1746143783.911315:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4770 00000100:00100000:1.0:1746143783.911321:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b496c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32341:x1830963622688256:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143783.911457:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b496c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32341:x1830963622688256:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 135us (262us total) trans 8589943729 rc 0/0 00000100:00100000:1.0:1746143783.911463:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4770 00000100:00100000:0.0:1746143783.917689:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.918426:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622688384 00000100:00100000:3.0:1746143783.918434:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622688384 00010000:00010000:3.0:1746143783.918466:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 28 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143783.918492:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5797 00000100:00100000:3.0:1746143783.918498:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622688384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143783.918512:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143783.918528:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 28 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143783.918542:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 28 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143783.918563:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73aa009 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b858 expref: 28 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143783.918595:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.918597:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143783.918602:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 9 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.918609:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 9 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143783.918636:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 9 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143783.918646:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626815488:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143783.918821:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143783.923479:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626815488:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143783.923496:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143783.923532:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622688384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5033us (5851us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143783.923541:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5797 00000100:00100000:0.0:1746143783.926707:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.926789:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622688640 00000100:00100000:1.0:1746143783.926797:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622688640 00002000:00100000:1.0:1746143783.926834:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093072300 x1830963622688640/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.926842:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093072300 with x1830963622688640 ext(1048576->2097151) 00002000:00010000:1.0:1746143783.926846:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093072300 00000100:00100000:2.0:1746143783.927095:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3592 00000100:00100000:2.0:1746143783.927105:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622688640:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143783.934362:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622688640:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7252us (7655us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143783.934371:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3592 00002000:00100000:2.0:1746143783.934381:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093072300 x1830963622688640/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.934389:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093072300 with x1830963622688640 ext(1048576->2097151) 00002000:00010000:2.0:1746143783.934394:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093072300 00000100:00100000:0.0:1746143783.950329:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.950377:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.950418:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622689024 00000100:00100000:2.0:1746143783.950425:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622689024 00002000:00100000:2.0:1746143783.950464:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880093071880 x1830963622689024/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143783.950823:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622689152 00000100:00100000:1.0:1746143783.950828:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622689152 00002000:00100000:1.0:1746143783.950846:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88009e490e00 x1830963622689152/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 504/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143783.950855:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490e00 with x1830963622689152 ext(2097152->4194303) 00002000:00010000:1.0:1746143783.950859:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490e00 00002000:00100000:2.0:1746143783.950882:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071880 with x1830963622689024 ext(2097152->4194303) 00002000:00010000:2.0:1746143783.950885:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093071880 00000100:00100000:2.0:1746143783.950950:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3593 00000100:00100000:2.0:1746143783.950957:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622689024:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143783.951163:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3594 00000100:00100000:1.0:1746143783.951168:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622689152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143783.962304:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622689152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11128us (11919us total) trans 0 rc 1519616/1519616 00000100:00100000:2.0:1746143783.962314:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3594 00002000:00100000:2.0:1746143783.962324:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff88009e490e00 x1830963622689152/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 504/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 1519616/1519616 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.962338:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490e00 with x1830963622689152 ext(2097152->4194303) 00002000:00010000:2.0:1746143783.962343:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490e00 00000100:00100000:2.0:1746143783.975032:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622689024:12345-192.168.202.3@tcp:3:cat.0 Request processed in 24066us (24700us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143783.975045:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3593 00002000:00100000:2.0:1746143783.975060:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880093071880 x1830963622689024/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.975069:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093071880 with x1830963622689024 ext(2097152->4194303) 00002000:00010000:2.0:1746143783.975074:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093071880 00000100:00100000:0.0:1746143783.981572:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.981642:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622689280 00000100:00100000:2.0:1746143783.981650:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622689280 00000100:00100000:2.0:1746143783.981701:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12289 00000100:00100000:2.0:1746143783.981709:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:32347:x1830963622689280:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143783.981724:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143783.981736:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8b3 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.981761:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.981768:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73aa010 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b85f expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.981773:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.981775:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143783.981778:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1417216->2097151] (req 1417216->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.981800:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73aa010 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b85f expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143783.981811:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73aa010 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b85f expref: 9 pid: 9587 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143783.981821:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626815616:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.981932:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.981940:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 28 pid: 9839 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143783.981947:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626815744:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143783.981972:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143783.984385:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626815616:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143783.984395:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626815744:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143783.984421:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [1417216->2097151] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143783.984438:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26c00, rc 0) 00000100:00100000:2.0:1746143783.984565:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:32347:x1830963622689280:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2767us (2909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143783.984573:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12289 00000100:00100000:1.0:1746143783.984847:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143783.985391:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143783.985515:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622689408 00000100:00100000:0.0:1746143783.985521:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622689408 00010000:00010000:0.0:1746143783.985541:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73aa010 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b85f expref: 10 pid: 9587 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143783.985558:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622689536 00000100:00100000:0.0:1746143783.985560:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622689536 00010000:00010000:0.0:1746143783.985565:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 28 pid: 9839 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746143783.985587:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5798 00000100:00100000:0.0:1746143783.985592:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622689408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143783.985602:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143783.985615:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73aa010 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b85f expref: 10 pid: 9587 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143783.985624:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73aa010 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b85f expref: 10 pid: 9587 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143783.985642:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73aa010 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b85f expref: 10 pid: 9587 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143783.985656:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143783.985676:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622689408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 84us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143783.985682:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5798 00000100:00100000:0.0:1746143783.985691:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5799 00000100:00100000:0.0:1746143783.985695:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963622689536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143783.985701:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143783.985707:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 28 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143783.985714:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 28 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143783.985724:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73aa002 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b851 expref: 28 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143783.985731:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.985732:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143783.985737:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.985745:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143783.985766:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143783.985776:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e491f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626815872:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143783.985814:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143783.986614:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143783.987932:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622689792 00000100:00100000:2.0:1746143783.987938:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622689792 00000100:00100000:1.0:1746143783.987947:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e491f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626815872:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143783.987961:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746143783.987970:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff88009e491c00 x1830963622689792/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.987978:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491c00 with x1830963622689792 ext(4194304->4968447) 00002000:00010000:2.0:1746143783.987982:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e491c00 00000100:00100000:1.0:1746143783.987986:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963622689536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2289us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143783.987992:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5799 00000100:00100000:2.0:1746143783.988038:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3595 00000100:00100000:2.0:1746143783.988046:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622689792:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143783.988144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143783.988181:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622690048 00000100:00100000:3.0:1746143783.988185:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622690048 00002000:00100000:3.0:1746143783.988201:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1417216->1421311) req@ffff88009e491500 x1830963622690048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/0 e 0 to 0 dl 1746143794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.988208:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491500 with x1830963622690048 ext(1417216->1421311) 00002000:00010000:3.0:1746143783.988210:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e491500 00000100:00100000:3.0:1746143783.988227:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3596 00000100:00100000:3.0:1746143783.988231:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622690048:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143783.988305:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622690048:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 73us (161us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143783.988310:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3596 00002000:00100000:3.0:1746143783.988314:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1417216->1421311) req@ffff88009e491500 x1830963622690048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:179/0 lens 488/4536 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143783.988319:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491500 with x1830963622690048 ext(1417216->1421311) 00002000:00010000:3.0:1746143783.988321:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e491500 00000100:00100000:2.0:1746143783.993300:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2010:x1830963622689792:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5247us (6678us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143783.993310:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3595 00002000:00100000:2.0:1746143783.993320:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff88009e491c00 x1830963622689792/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:179/0 lens 488/440 e 0 to 0 dl 1746143794 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143783.993329:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491c00 with x1830963622689792 ext(4194304->4968447) 00002000:00010000:2.0:1746143783.993333:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e491c00 00000100:00100000:0.0:1746143784.000259:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.000490:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622690176 00000100:00100000:2.0:1746143784.000498:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622690176 00000100:00100000:2.0:1746143784.000585:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12290 00000100:00100000:2.0:1746143784.000593:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:32347:x1830963622690176:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143784.000609:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.000623:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8ba expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143784.000755:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.000898:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622690304 00000100:00100000:1.0:1746143784.000903:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622690304 00000100:00100000:1.0:1746143784.000952:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12291 00000100:00100000:1.0:1746143784.000958:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622690304:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143784.000964:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.000973:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73aa0b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8c1 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143784.001025:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093417100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626816000:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143784.001131:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 10 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.001138:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.001139:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.001143:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->1146879] (req 1048576->1146879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143784.001156:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffafa80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143784.001759:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 10 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.001771:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 10 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.001779:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626816128:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.001801:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.004075:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626816128:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.004099:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->1146879] (req 1048576->1146879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.004111:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27000, rc 0) 00000100:00100000:2.0:1746143784.004141:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:32347:x1830963622690176:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3548us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.004149:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12290 00002000:00010000:1.0:1746143784.004240:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143781 -> 1746143784 00000100:00100000:1.0:1746143784.004255:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093417100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626816000:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143784.004274:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73aa0b8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8c1 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.004283:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73aa0b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8c1 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.004306:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76600, rc 0) 00000100:00100000:1.0:1746143784.004322:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2010:x1830963622690304:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3364us (3567us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143784.004328:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12291 00000100:00100000:0.0:1746143784.005804:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.005846:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622690432 00000100:00100000:1.0:1746143784.005852:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622690432 00010000:00010000:1.0:1746143784.005885:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 9 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143784.006067:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5800 00000100:00100000:1.0:1746143784.006074:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5221c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622690432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143784.006085:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143784.006098:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 9 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143784.006108:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 9 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143784.006125:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73aa0a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ac expref: 9 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143784.006140:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.006142:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.006148:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.006155:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.006181:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143784.006192:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093417100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626816256:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143784.006772:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffafa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.009264:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.009291:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.009312:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622690688 00000100:00100000:2.0:1746143784.009319:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622690688 00000100:00100000:0.0:1746143784.009328:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.009348:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622690560 00000100:00100000:2.0:1746143784.009350:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622690560 00000100:00100000:2.0:1746143784.009361:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12292 00000100:00100000:2.0:1746143784.009367:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622690688:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.009378:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.009389:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa0bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8cf expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.009428:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626816384:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143784.009481:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.009493:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622690944 00000100:00100000:2.0:1746143784.009495:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622690944 00000100:00100000:1.0:1746143784.009501:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093417100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626816256:192.168.202.3@tcp:105: 00002000:00100000:2.0:1746143784.009514:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1142784->1146879) req@ffff88009e490000 x1830963622690944/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143784.009516:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746143784.009522:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490000 with x1830963622690944 ext(1142784->1146879) 00002000:00010000:2.0:1746143784.009525:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e490000 00000100:00100000:2.0:1746143784.009534:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3597 00000100:00100000:1.0:1746143784.009537:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5221c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622690432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3463us (3736us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.009541:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622690944:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143784.009545:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5800 00000100:00100000:0.0:1746143784.009618:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12293 00000100:00100000:0.0:1746143784.009626:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622690560:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143784.009632:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143784.009639:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73aa0c6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8c8 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143784.009662:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626816512:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143784.009682:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.010492:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622690944:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 948us (1161us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143784.010498:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3597 00002000:00100000:2.0:1746143784.010504:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1142784->1146879) req@ffff88009e490000 x1830963622690944/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.010510:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490000 with x1830963622690944 ext(1142784->1146879) 00002000:00010000:2.0:1746143784.010513:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e490000 00000100:00100000:1.0:1746143784.013119:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626816512:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143784.013144:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73aa0c6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8c8 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.013155:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73aa0c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8c8 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.013182:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504e00, rc 0) 00000100:00100000:1.0:1746143784.013210:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622690560:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3585us (3918us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143784.013216:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12293 00000100:00100000:2.0:1746143784.013404:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626816384:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143784.013420:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa0bf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8cf expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.013429:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa0bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8cf expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.013441:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26800, rc 0) 00000100:00100000:2.0:1746143784.013472:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2011:x1830963622690688:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4104us (4213us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143784.013477:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12292 00000100:00100000:0.0:1746143784.016080:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.016159:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622691200 00000100:00100000:3.0:1746143784.016166:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622691200 00000100:00100000:3.0:1746143784.016222:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4771 00000100:00100000:3.0:1746143784.016229:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:32347:x1830963622691200:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143784.016435:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+267:32347:x1830963622691200:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 205us (359us total) trans 8589943730 rc 0/0 00000100:00100000:3.0:1746143784.016441:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4771 00000100:00100000:0.0:1746143784.034639:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.034984:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622691456 00000100:00100000:3.0:1746143784.034993:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622691456 00000100:00100000:3.0:1746143784.035048:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12965 00000100:00100000:3.0:1746143784.035056:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+267:32353:x1830963622691456:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143784.035076:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.035090:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa0cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8d6 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.035166:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143784.035179:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143784.035187:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143784.035197:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143784.035335:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73aa0cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8d6 expref: 270 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.035362:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8d6 expref: 269 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.035369:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143784.035371:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143784.035373:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d000, rc 0) 00000100:00100000:3.0:1746143784.035418:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+269:32353:x1830963622691456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 363us (787us total) trans 8589943731 rc 0/0 00000100:00100000:3.0:1746143784.035423:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12965 00000100:00100000:0.0:1746143784.037813:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.037905:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622691584 00000100:00100000:2.0:1746143784.037938:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622691584 00000100:00100000:2.0:1746143784.037978:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12294 00000100:00100000:2.0:1746143784.037985:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622691584:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.037996:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.038009:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27200/0x87925e4cb73aa0e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8dd expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.038049:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626816640:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143784.038112:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00002000:00010000:2.0:1746143784.040334:0:9839:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143782 -> 1746143784 00002000:00010000:2.0:1746143784.040338:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143782 -> 1746143784 00002000:00010000:2.0:1746143784.040340:0:9839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143782 -> 1746143784 00000100:00100000:2.0:1746143784.040355:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626816640:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143784.040378:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b27200/0x87925e4cb73aa0e2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8dd expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.040389:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27200/0x87925e4cb73aa0e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8dd expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.040412:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27200, rc 0) 00000100:00100000:2.0:1746143784.040527:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622691584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2541us (2718us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143784.040534:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12294 00000100:00100000:0.0:1746143784.052354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.052403:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.053238:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622691840 00000100:00100000:2.0:1746143784.053247:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622691840 00002000:00100000:2.0:1746143784.053285:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1417215) req@ffff88009e490380 x1830963622691840/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.053294:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490380 with x1830963622691840 ext(1048576->1417215) 00002000:00010000:2.0:1746143784.053299:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e490380 00000100:00100000:2.0:1746143784.053314:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622692096 00000100:00100000:2.0:1746143784.053316:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622692096 00002000:00100000:2.0:1746143784.053326:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1146880->2097151) req@ffff88009e493100 x1830963622692096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.053332:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493100 with x1830963622692096 ext(1146880->2097151) 00002000:00010000:2.0:1746143784.053335:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e493100 00000100:00100000:2.0:1746143784.053597:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3598 00000100:00100000:3.0:1746143784.053602:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3599 00000100:00100000:2.0:1746143784.053605:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622691840:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143784.053613:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622692096:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143784.061497:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622691840:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7885us (9143us total) trans 0 rc 368640/368640 00000100:00100000:2.0:1746143784.061510:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3598 00002000:00100000:2.0:1746143784.061519:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->1417215) req@ffff88009e490380 x1830963622691840/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 368640/368640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.061528:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490380 with x1830963622691840 ext(1048576->1417215) 00002000:00010000:2.0:1746143784.061532:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e490380 00000100:00100000:3.0:1746143784.062747:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622692096:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9137us (10340us total) trans 0 rc 950272/950272 00000100:00100000:3.0:1746143784.062755:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3599 00002000:00100000:3.0:1746143784.062761:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1146880->2097151) req@ffff88009e493100 x1830963622692096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.062768:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493100 with x1830963622692096 ext(1146880->2097151) 00002000:00010000:3.0:1746143784.062771:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e493100 00000100:00100000:0.0:1746143784.078584:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.079837:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622692224 00000100:00100000:2.0:1746143784.079846:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622692224 00000100:00100000:2.0:1746143784.079909:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12295 00000100:00100000:2.0:1746143784.079941:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:32353:x1830963622692224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.079958:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.079973:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8e4 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.079999:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 7 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.080006:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.080007:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.080010:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 23 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.080035:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 7 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.080045:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 7 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.080060:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626816768:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.080139:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.083212:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.083564:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626816768:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.083588:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 23 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.083602:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27800, rc 0) 00000100:00100000:2.0:1746143784.083637:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:32353:x1830963622692224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3698us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.083644:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12295 00000100:00100000:3.0:1746143784.084093:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622692352 00000100:00100000:3.0:1746143784.084100:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622692352 00002000:00100000:3.0:1746143784.084131:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3481600->4059135) req@ffff88009e490a80 x1830963622692352/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.084139:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490a80 with x1830963622692352 ext(3481600->4059135) 00010000:00010000:3.0:1746143784.084145:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 8 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.084155:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 8 pid: 9587 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143784.084160:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e490a80 00000100:00100000:3.0:1746143784.084189:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1482 00000100:00100000:3.0:1746143784.084196:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622692352:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143784.092457:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622692352:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8248us (9238us total) trans 21474840430 rc 0/0 00000100:00100000:3.0:1746143784.092472:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1482 00002000:00100000:3.0:1746143784.092486:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3481600->4059135) req@ffff88009e490a80 x1830963622692352/t21474840430(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/448 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.092502:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490a80 with x1830963622692352 ext(3481600->4059135) 00010000:00010000:3.0:1746143784.092513:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 10 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.092531:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 10 pid: 9587 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143784.092537:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e490a80 00000100:00100000:0.0:1746143784.100402:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.100500:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622692480 00000100:00100000:1.0:1746143784.100511:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622692480 00010000:00010000:1.0:1746143784.100548:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 10 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143784.100599:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5801 00000100:00100000:1.0:1746143784.100606:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622692480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143784.100620:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143784.100638:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 10 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143784.100648:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 10 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143784.100669:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73aa09c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3481600->4059135) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8a5 expref: 10 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143784.100694:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.100696:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.100702:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 22 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.100713:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 22 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.100744:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 22 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143784.101142:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626816896:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143784.101231:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143784.103720:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626816896:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143784.103739:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143784.103790:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622692480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3183us (3400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.103800:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5801 00000100:00100000:0.0:1746143784.109772:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.109881:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622692736 00000100:00100000:3.0:1746143784.109891:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622692736 00002000:00100000:3.0:1746143784.109969:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880092b4b800 x1830963622692736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.109980:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4b800 with x1830963622692736 ext(2097152->4194303) 00002000:00010000:3.0:1746143784.109986:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b4b800 00000100:00100000:3.0:1746143784.110019:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3600 00000100:00100000:3.0:1746143784.110026:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622692736:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143784.120702:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622692736:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10664us (10930us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143784.120715:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3600 00002000:00100000:3.0:1746143784.120728:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880092b4b800 x1830963622692736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.120738:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4b800 with x1830963622692736 ext(2097152->4194303) 00002000:00010000:3.0:1746143784.120745:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b4b800 00000100:00100000:0.0:1746143784.129781:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.129947:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622692992 00000100:00100000:3.0:1746143784.129958:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622692992 00002000:00100000:3.0:1746143784.130006:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092b49500 x1830963622692992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.130017:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49500 with x1830963622692992 ext(4194304->4968447) 00002000:00010000:3.0:1746143784.130022:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49500 00000100:00100000:3.0:1746143784.130058:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3601 00000100:00100000:3.0:1746143784.130066:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622692992:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143784.143604:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622692992:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13527us (13822us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143784.143618:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3601 00002000:00100000:3.0:1746143784.143630:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092b49500 x1830963622692992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.143639:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49500 with x1830963622692992 ext(4194304->4968447) 00002000:00010000:3.0:1746143784.143646:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49500 00000100:00100000:1.0:1746143784.146058:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.146093:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.146129:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.146184:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622693120 00000100:00100000:1.0:1746143784.146188:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622693248 00000100:00100000:3.0:1746143784.146197:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622693120 00000100:00100000:1.0:1746143784.146197:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622693248 00000100:00100000:1.0:1746143784.146232:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622693376 00000100:00100000:1.0:1746143784.146234:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622693376 00000100:00100000:3.0:1746143784.146303:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12296 00000100:00100000:3.0:1746143784.146319:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622693248:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143784.146350:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.146379:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c0400/0x87925e4cb73aa0f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8f2 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.146420:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12297 00000100:00100000:2.0:1746143784.146428:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622693120:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.146435:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.146443:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27a00/0x87925e4cb73aa0f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8eb expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143784.146454:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626817024:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143784.146468:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626817152:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143784.146536:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143784.146538:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12298 00000100:00100000:1.0:1746143784.146545:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622693376:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143784.146553:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.146565:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b8f9 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.146582:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.146584:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.146591:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.146607:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.146616:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7de00, rc 0) 00000100:00100000:1.0:1746143784.146846:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622693376:12345-192.168.202.3@tcp:101:cat.0 Request processed in 300us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.146852:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143784.146852:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12298 00000100:00100000:0.0:1746143784.151528:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.151635:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622693632 00000100:00100000:3.0:1746143784.151646:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622693632 00000100:00100000:3.0:1746143784.151712:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12966 00000100:00100000:3.0:1746143784.151721:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32357:x1830963622693632:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143784.151749:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.151771:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73aa105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b900 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.152035:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143784.152050:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b882 expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.152058:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b89e expref: 268 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.152064:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143784.152097:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b89e expref: 268 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.152108:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b89e expref: 268 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143784.152120:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626817280:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143784.153003:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b882 expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.153013:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b882 expref: 16 pid: 6587 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143784.153022:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626817408:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143784.156845:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.158421:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.158464:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622693888 00000100:00100000:1.0:1746143784.158473:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622693888 00000100:00100000:1.0:1746143784.158531:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12967 00000100:00100000:1.0:1746143784.158541:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:32358:x1830963622693888:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:2.0:1746143784.158745:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626817152:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143784.158777:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27a00/0x87925e4cb73aa0f7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8eb expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.158793:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27a00/0x87925e4cb73aa0f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8eb expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.158818:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27a00, rc 0) 00000100:00100000:2.0:1746143784.158872:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622693120:12345-192.168.202.3@tcp:101:cat.0 Request processed in 12445us (12825us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143784.158880:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12297 00000100:00100000:2.0:1746143784.158951:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626817024:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143784.158972:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0400/0x87925e4cb73aa0f0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f2 expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.158981:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0400/0x87925e4cb73aa0f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f2 expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.158989:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0400, rc 0) 00000100:00100000:2.0:1746143784.159010:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:2009:x1830963622693248:12345-192.168.202.3@tcp:101:cat.0 Request processed in 12698us (12917us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143784.159016:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12296 00010000:00010000:1.0:1746143784.159305:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.159323:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b907 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.159430:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.159444:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.159454:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143784.165640:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626817280:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143784.165655:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626817408:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143784.165686:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143784.166678:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.166721:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.166785:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622694144 00000100:00100000:1.0:1746143784.166794:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622694144 00010000:00010000:1.0:1746143784.166831:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b882 expref: 17 pid: 6587 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143784.166878:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622694016 00000100:00100000:1.0:1746143784.166881:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622694016 00000100:00100000:2.0:1746143784.167089:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5802 00000100:00100000:2.0:1746143784.167100:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622694144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.167116:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.167123:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b882 expref: 17 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.167133:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b882 expref: 17 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.167162:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73aa048 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b882 expref: 17 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.167189:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143784.167194:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.167203:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.167208:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143784.167475:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b89e expref: 271 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746143784.167512:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5803 00000100:00100000:0.0:1746143784.167520:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+271:2008:x1830963622694016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143784.167527:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143784.167531:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b89e expref: 271 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.167540:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b89e expref: 271 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.167552:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa08e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b89e expref: 271 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.167565:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143784.167567:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143784.167575:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143784.167582:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143784.167589:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143784.167594:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143784.167599:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143784.167619:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143784.167631:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.167637:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143784.167655:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+270:2008:x1830963622694016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 136us (933us total) trans 0 rc 0/0 00000004:00200000:1.0:1746143784.167658:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000100:00100000:0.0:1746143784.167661:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5803 00010000:00010000:1.0:1746143784.167792:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b907 expref: 271 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.167809:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b907 expref: 270 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.167815:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143784.167817:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143784.167818:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c400, rc 0) 00000100:00100000:1.0:1746143784.167842:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:32358:x1830963622693888:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9303us (9435us total) trans 8589943732 rc 0/0 00000100:00100000:1.0:1746143784.167848:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12967 00000100:00100000:2.0:1746143784.168064:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622694144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 965us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.168071:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5802 00010000:00010000:2.0:1746143784.168095:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.168101:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143784.168113:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143784.168161:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73aa105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b900 expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.168172:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b900 expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.168178:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143784.168180:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143784.168182:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1a00, rc 0) 00000100:00100000:2.0:1746143784.168201:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32357:x1830963622693632:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 16482us (16684us total) trans 8589943733 rc 0/0 00000100:00100000:2.0:1746143784.168207:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12966 00000100:00100000:0.0:1746143784.172822:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.172961:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622694272 00000100:00100000:2.0:1746143784.172972:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622694272 00000100:00100000:2.0:1746143784.173166:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12299 00000100:00100000:2.0:1746143784.173175:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+8:32360:x1830963622694272:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.173195:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.173213:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b90e expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.173245:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.173253:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.173255:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.173258:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.173288:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.173301:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 27 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.173313:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626817536:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.173411:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.185349:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626817536:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.185385:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.185404:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27e00, rc 0) 00000100:00100000:2.0:1746143784.185459:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32360:x1830963622694272:12345-192.168.202.3@tcp:101:cat.0 Request processed in 12285us (12650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.185468:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12299 00000100:00100000:0.0:1746143784.191658:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.191885:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622694400 00000100:00100000:3.0:1746143784.191896:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622694400 00002000:00100000:3.0:1746143784.191976:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x395:0x0] (1191936->2097151) req@ffff880092b48700 x1830963622694400/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 504/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.191986:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48700 with x1830963622694400 ext(1191936->2097151) 00010000:00010000:3.0:1746143784.191995:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 28 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.192010:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 28 pid: 9587 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143784.192017:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b48700 00000100:00100000:3.0:1746143784.192053:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1483 00000100:00100000:3.0:1746143784.192060:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963622694400:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143784.199213:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963622694400:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7145us (7559us total) trans 17179873097 rc 0/0 00000100:00100000:3.0:1746143784.199225:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1483 00002000:00100000:3.0:1746143784.199237:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x395:0x0] (1191936->2097151) req@ffff880092b48700 x1830963622694400/t17179873097(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 504/448 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.199245:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48700 with x1830963622694400 ext(1191936->2097151) 00010000:00010000:3.0:1746143784.199255:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 30 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.199268:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 30 pid: 9587 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143784.199275:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b48700 00000100:00100000:0.0:1746143784.202714:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.205706:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622694528 00000100:00100000:3.0:1746143784.205716:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622694528 00010000:00010000:3.0:1746143784.205750:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 30 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143784.205798:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5804 00000100:00100000:3.0:1746143784.205805:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622694528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143784.205816:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.205832:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 30 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.205848:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 30 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.205875:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73aa0aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8b3 expref: 30 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.205906:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.205908:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.205941:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 8 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.205948:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 8 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.205973:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 8 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143784.205983:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626817664:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143784.206061:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143784.209124:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626817664:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143784.209141:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.210087:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622694528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4279us (7377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.210097:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5804 00000100:00100000:0.0:1746143784.212755:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.214084:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622694784 00000100:00100000:3.0:1746143784.214093:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622694784 00002000:00100000:3.0:1746143784.214131:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880093913b80 x1830963622694784/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.214139:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093913b80 with x1830963622694784 ext(1048576->2097151) 00002000:00010000:3.0:1746143784.214143:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093913b80 00000100:00100000:3.0:1746143784.214168:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3602 00000100:00100000:3.0:1746143784.214176:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622694784:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143784.221106:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:2009:x1830963622694784:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6922us (8349us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143784.221118:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3602 00002000:00100000:3.0:1746143784.221128:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880093913b80 x1830963622694784/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.221137:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093913b80 with x1830963622694784 ext(1048576->2097151) 00002000:00010000:3.0:1746143784.221142:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093913b80 00000100:00100000:0.0:1746143784.233015:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.234162:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622694912 00000100:00100000:2.0:1746143784.234170:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622694912 00000100:00100000:2.0:1746143784.234236:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12300 00000100:00100000:2.0:1746143784.234242:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+9:32360:x1830963622694912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.234257:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.234270:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b915 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.234294:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.234300:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.234302:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.234305:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.234327:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.234337:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 28 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.234348:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626817792:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.235079:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.236902:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626817792:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.236953:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.236967:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26800, rc 0) 00000100:00100000:2.0:1746143784.237010:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32360:x1830963622694912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2767us (4001us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.237017:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12300 00000100:00100000:0.0:1746143784.237418:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.237485:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622695040 00000100:00100000:3.0:1746143784.237490:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622695040 00002000:00100000:3.0:1746143784.237519:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1146879) req@ffff880093911f80 x1830963622695040/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.237527:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093911f80 with x1830963622695040 ext(1048576->1146879) 00010000:00010000:3.0:1746143784.237532:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 29 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.237542:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 29 pid: 9587 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143784.237548:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093911f80 00000100:00100000:3.0:1746143784.237574:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1484 00000100:00100000:3.0:1746143784.237580:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963622695040:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143784.243597:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622695040:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 6008us (6171us total) trans 17179873098 rc 0/0 00000100:00100000:3.0:1746143784.243610:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1484 00002000:00100000:3.0:1746143784.243621:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1146879) req@ffff880093911f80 x1830963622695040/t17179873098(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/448 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.243627:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093911f80 with x1830963622695040 ext(1048576->1146879) 00010000:00010000:3.0:1746143784.243635:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 31 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.243648:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 31 pid: 9587 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143784.243654:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093911f80 00000100:00100000:0.0:1746143784.246351:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.246428:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622695168 00000100:00100000:3.0:1746143784.246435:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622695168 00010000:00010000:3.0:1746143784.246462:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 31 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143784.246497:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5805 00000100:00100000:3.0:1746143784.246505:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622695168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143784.246516:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.246532:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 31 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.246542:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 31 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.246563:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73aa0b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8ba expref: 31 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.246579:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.246581:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.246586:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.246593:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.246620:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143784.246630:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626817920:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143784.246698:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143784.248445:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626817920:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143784.248459:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.249279:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622695168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2771us (2930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.249288:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5805 00000100:00100000:0.0:1746143784.252131:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.252176:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.252372:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622695424 00000100:00100000:3.0:1746143784.252380:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622695424 00002000:00100000:3.0:1746143784.252415:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093913100 x1830963622695424/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.252431:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093913100 with x1830963622695424 ext(1048576->2097151) 00002000:00010000:3.0:1746143784.252435:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093913100 00000100:00100000:3.0:1746143784.252453:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3603 00000100:00100000:3.0:1746143784.252460:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622695424:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143784.253085:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622695552 00000100:00100000:2.0:1746143784.253089:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622695552 00000100:00100000:2.0:1746143784.253110:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12301 00000100:00100000:2.0:1746143784.253115:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32357:x1830963622695552:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143784.253123:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.253137:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b91c expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.253156:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.253163:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73aa072 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b897 expref: 13 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.253173:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.253175:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.253178:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 13 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.253200:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73aa072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b897 expref: 13 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.253210:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73aa072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b897 expref: 13 pid: 1945 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143784.253220:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626818048:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.253285:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.253293:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 29 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.253301:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626818176:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.253317:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.256306:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.256449:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622695680 00000100:00100000:2.0:1746143784.256457:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622695680 00000100:00100000:2.0:1746143784.256515:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12968 00000100:00100000:2.0:1746143784.256523:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:32364:x1830963622695680:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143784.256541:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.256558:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73aa144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b923 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.256608:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.256619:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.256627:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.256639:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa152 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.256645:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa152 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.256649:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa152 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.256709:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.256718:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b900 expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.256724:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b907 expref: 269 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.256729:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.256755:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b907 expref: 269 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.256764:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b907 expref: 269 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.256773:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626818304:192.168.202.3@tcp:104: 00000100:00080000:0.0:1746143784.257211:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746143784.257430:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b900 expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.257438:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b900 expref: 15 pid: 6587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.257446:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626818432:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.257724:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.261545:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.262026:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626818304:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.262036:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626818432:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.262055:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143784.262079:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626818048:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.262085:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626818176:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.262099:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 13 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.262113:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26400, rc 0) 00000100:00100000:3.0:1746143784.262215:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622695936 00000100:00100000:3.0:1746143784.262221:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622695936 00000100:00100000:3.0:1746143784.262253:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4772 00000100:00100000:3.0:1746143784.262259:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:30501:x1830963622695936:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143784.263121:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+271:30501:x1830963622695936:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 861us (1582us total) trans 8589943734 rc 0/0 00000100:00100000:2.0:1746143784.263122:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32357:x1830963622695552:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10005us (10944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.263128:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4772 00000100:00100000:2.0:1746143784.263129:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12301 00000100:00100000:3.0:1746143784.263184:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622695424:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10725us (11059us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143784.263190:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3603 00002000:00100000:3.0:1746143784.263198:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880093913100 x1830963622695424/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.263206:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093913100 with x1830963622695424 ext(1048576->2097151) 00002000:00010000:3.0:1746143784.263210:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093913100 00000100:00100000:0.0:1746143784.263275:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.265002:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.266698:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622696064 00000100:00100000:2.0:1746143784.266706:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622696064 00010000:00010000:2.0:1746143784.266736:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73aa072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b897 expref: 11 pid: 1945 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143784.266765:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622696192 00000100:00100000:2.0:1746143784.266768:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622696192 00010000:00010000:2.0:1746143784.266779:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b900 expref: 16 pid: 6587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.266794:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5806 00000100:00100000:2.0:1746143784.266800:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622696064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.266809:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.266826:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73aa072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b897 expref: 11 pid: 1945 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143784.266836:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73aa072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b897 expref: 11 pid: 1945 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143784.266853:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73aa072 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b897 expref: 11 pid: 1945 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143784.266882:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.266932:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622696064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 132us (3657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.266941:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5807 00000100:00100000:3.0:1746143784.266948:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622696192:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143784.266955:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.266960:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b900 expref: 16 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.266969:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b900 expref: 16 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.266981:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa10c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b900 expref: 16 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.266989:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143784.266993:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143784.267000:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143784.267005:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143784.267009:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.267024:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2010:x1830963622696192:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 77us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.267224:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5806 00000100:00100000:3.0:1746143784.267229:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5807 00000100:00100000:2.0:1746143784.267343:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.267357:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622696320 00000100:00100000:0.0:1746143784.267361:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622696320 00010000:00010000:0.0:1746143784.267373:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 30 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.267395:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.267399:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622696448 00000100:00100000:0.0:1746143784.267401:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622696448 00010000:00010000:0.0:1746143784.267409:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b907 expref: 271 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746143784.267430:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5808 00000100:00100000:0.0:1746143784.267434:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622696320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143784.267441:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143784.267449:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5809 00010000:00010000:0.0:1746143784.267449:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 30 pid: 9587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.267454:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+271:2009:x1830963622696448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143784.267456:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 30 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.267459:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.267462:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b907 expref: 271 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.267469:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b907 expref: 271 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.267472:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25200/0x87925e4cb73aa02c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b87b expref: 30 pid: 9587 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.267479:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73aa11a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b907 expref: 271 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.267486:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143784.267489:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267495:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267501:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267516:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.267532:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+270:2009:x1830963622696448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 77us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.267537:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5809 00010000:00010000:2.0:1746143784.267552:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267560:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143784.267599:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:2.0:1746143784.267602:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143784.267617:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267625:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267634:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267639:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267643:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267648:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267653:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb2e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143784.267656:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267661:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267668:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143784.267670:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143784.267672:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267677:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa14b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143784.267678:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143784.267680:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.267685:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa152 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143784.267685:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.267689:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa152 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267694:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa152 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267697:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5aa400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143784.267697:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.267699:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa152 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267703:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa152 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267708:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092b11900) 00010000:00010000:2.0:1746143784.267710:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143784.267711:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa152 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267716:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa152 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.267740:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73aa144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b923 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.267749:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b923 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.267750:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.267758:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143784.267760:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1746143784.267761:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626818560:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.267762:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5aa000, rc 0) 00000100:00100000:2.0:1746143784.267792:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32364:x1830963622695680:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 11270us (11492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.267797:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12968 00000100:00100000:1.0:1746143784.267805:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143784.272619:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626818560:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143784.272635:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143784.272654:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.272735:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622696704 00000100:00100000:3.0:1746143784.272741:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622696704 00002000:00100000:3.0:1746143784.272771:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3043328->3047423) req@ffff880093911c00 x1830963622696704/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.272777:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093911c00 with x1830963622696704 ext(3043328->3047423) 00002000:00010000:3.0:1746143784.272781:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093911c00 00000100:00100000:3.0:1746143784.272797:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3604 00000100:00100000:3.0:1746143784.272801:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622696704:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143784.273139:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622696320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5704us (5795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.273147:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5808 00000100:00100000:3.0:1746143784.273187:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622696704:12345-192.168.202.3@tcp:3:cat.0 Request processed in 384us (532us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143784.273193:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3604 00002000:00100000:3.0:1746143784.273198:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3043328->3047423) req@ffff880093911c00 x1830963622696704/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.273204:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093911c00 with x1830963622696704 ext(3043328->3047423) 00002000:00010000:3.0:1746143784.273206:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093911c00 00000100:00100000:2.0:1746143784.273245:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.273322:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622696832 00000100:00100000:0.0:1746143784.273325:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622696832 00000100:00100000:0.0:1746143784.273345:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12302 00000100:00100000:0.0:1746143784.273350:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2010:x1830963622696832:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143784.273358:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143784.273371:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73aa160 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b92a expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143784.273386:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143784.273387:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143784.273395:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73aa160 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b92a expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143784.273408:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73aa160 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b92a expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143784.273416:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d400, rc 0) 00000100:00100000:0.0:1746143784.273766:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622696832:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 414us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143784.273772:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12302 00000100:00100000:1.0:1746143784.273950:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.274244:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622696960 00000100:00100000:0.0:1746143784.274248:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622696960 00000100:00100000:2.0:1746143784.274332:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.274546:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.274599:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622697088 00000100:00100000:0.0:1746143784.274602:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622697088 00000100:00100000:0.0:1746143784.274625:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12303 00000100:00100000:0.0:1746143784.274629:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622696960:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143784.274636:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143784.274644:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73aa167 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b931 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143784.274654:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143784.274656:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143784.274660:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73aa167 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b931 expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143784.274668:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73aa167 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b931 expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143784.274676:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ce00, rc 0) 00000100:00100000:0.0:1746143784.274695:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622696960:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 65us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143784.274699:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12303 00000100:00100000:0.0:1746143784.274709:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12304 00000100:00100000:0.0:1746143784.274714:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622697088:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143784.274720:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143784.274728:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa16e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b938 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143784.274738:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143784.274739:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143784.274743:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa16e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b938 expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143784.274752:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa16e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b938 expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143784.274759:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7cc00, rc 0) 00000100:00100000:0.0:1746143784.274773:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622697088:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 59us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143784.274778:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12304 00000100:00100000:2.0:1746143784.274944:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622697216 00000100:00100000:2.0:1746143784.274947:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622697216 00000100:00100000:2.0:1746143784.274964:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12305 00000100:00100000:2.0:1746143784.274968:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622697216:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143784.274974:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.274980:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24000/0x87925e4cb73aa175 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b93f expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.275008:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626818688:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143784.275049:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.279870:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.279893:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.279962:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.280062:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622697472 00000100:00100000:0.0:1746143784.280071:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622697472 00002000:00100000:0.0:1746143784.280117:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880093414e00 x1830963622697472/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143784.280127:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414e00 with x1830963622697472 ext(2097152->3145727) 00002000:00010000:0.0:1746143784.280131:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093414e00 00000100:00100000:3.0:1746143784.280135:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622697984 00000100:00100000:3.0:1746143784.280143:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622697984 00000100:00100000:0.0:1746143784.280166:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3605 00000100:00100000:0.0:1746143784.280176:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622697472:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143784.280177:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3043327) req@ffff880093415f80 x1830963622697984/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.280185:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415f80 with x1830963622697984 ext(2097152->3043327) 00000100:00100000:2.0:1746143784.280188:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622697728 00002000:00010000:3.0:1746143784.280189:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093415f80 00000100:00100000:2.0:1746143784.280191:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622697728 00000100:00100000:3.0:1746143784.280212:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3606 00000100:00100000:2.0:1746143784.280214:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12969 00000100:00100000:3.0:1746143784.280218:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622697984:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143784.280218:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+270:32367:x1830963622697728:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.280231:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.280243:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73aa17c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b946 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.280292:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280302:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280309:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280318:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73aa18a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280323:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73aa18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280327:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73aa18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280397:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280404:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280409:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143784.280416:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143784.280468:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280473:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280481:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280485:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280489:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b24200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143784.280492:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280497:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280505:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143784.280507:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143784.280510:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280514:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73aa183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280523:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73aa18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280527:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73aa18a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280531:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73aa18a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280534:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b25200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143784.280536:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73aa18a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280543:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73aa18a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280547:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092b11d00) 00010000:00010000:2.0:1746143784.280549:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143784.280550:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73aa18a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280554:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25200/0x87925e4cb73aa18a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143784.280582:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73aa17c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b946 expref: 273 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.280590:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b946 expref: 272 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.280595:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143784.280597:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143784.280599:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25800, rc 0) 00000100:00100000:2.0:1746143784.280632:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+272:32367:x1830963622697728:12345-192.168.202.3@tcp:101:cat.0 Request processed in 413us (787us total) trans 8589943735 rc 0/0 00000100:00100000:2.0:1746143784.280636:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12969 00000100:00100000:3.0:1746143784.283434:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626818688:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143784.283463:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24000/0x87925e4cb73aa175 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b93f expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.283474:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24000/0x87925e4cb73aa175 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b93f expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.283491:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24000, rc 0) 00000100:00100000:3.0:1746143784.283530:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622697216:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 8560us (8984us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143784.283538:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12305 00000100:00100000:0.0:1746143784.287034:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.287089:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622698240 00000100:00100000:3.0:1746143784.287096:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622698240 00000100:00100000:3.0:1746143784.287141:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4773 00000100:00100000:3.0:1746143784.287148:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:32367:x1830963622698240:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143784.287305:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:32367:x1830963622698240:12345-192.168.202.3@tcp:35:cat.0 Request processed in 157us (278us total) trans 8589943736 rc 0/0 00000100:00100000:3.0:1746143784.287312:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4773 00000100:00100000:0.0:1746143784.292576:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.292728:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622697984:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12508us (12764us total) trans 0 rc 946176/946176 00000100:00100000:3.0:1746143784.292738:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3606 00002000:00100000:3.0:1746143784.292747:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3043327) req@ffff880093415f80 x1830963622697984/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.292754:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415f80 with x1830963622697984 ext(2097152->3043327) 00002000:00010000:3.0:1746143784.292759:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093415f80 00000100:00100000:1.0:1746143784.292944:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622698496 00000100:00100000:1.0:1746143784.292951:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622698496 00000100:00100000:1.0:1746143784.292982:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12970 00000100:00100000:1.0:1746143784.292988:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32364:x1830963622698496:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143784.293001:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.293015:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73aa19f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b94d expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.293091:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.293103:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b923 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.293111:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b946 expref: 272 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.293118:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.293140:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b946 expref: 272 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.293151:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b946 expref: 272 pid: 6587 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143784.293160:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093415880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626818816:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143784.293207:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b923 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.293215:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b923 expref: 8 pid: 6587 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143784.293222:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626818944:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143784.293238:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.295211:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.295299:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622697472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15124us (15445us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143784.295307:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3605 00002000:00100000:1.0:1746143784.295314:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880093414e00 x1830963622697472/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.295322:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414e00 with x1830963622697472 ext(2097152->3145727) 00002000:00010000:1.0:1746143784.295326:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093414e00 00000100:00100000:3.0:1746143784.295393:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622698624 00000100:00100000:3.0:1746143784.295398:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622698624 00000100:00100000:3.0:1746143784.295453:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12306 00000100:00100000:3.0:1746143784.295459:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622698624:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143784.295500:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.295513:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1200/0x87925e4cb73aa1ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b954 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.295529:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.295531:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.295537:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1200/0x87925e4cb73aa1ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b954 expref: 30 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.295549:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1200/0x87925e4cb73aa1ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b954 expref: 30 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.295557:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1200, rc 0) 00000100:00100000:3.0:1746143784.295589:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622698624:12345-192.168.202.3@tcp:101:cat.0 Request processed in 130us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.295594:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12306 00000100:00100000:0.0:1746143784.296109:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.296297:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.296335:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622698880 00000100:00100000:3.0:1746143784.296338:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622698880 00000100:00100000:3.0:1746143784.296359:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622698752 00000100:00100000:3.0:1746143784.296361:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622698752 00000100:00100000:3.0:1746143784.296373:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12307 00000100:00100000:3.0:1746143784.296378:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622698880:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143784.296384:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.296391:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73aa1b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b962 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143784.296421:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626819072:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143784.296471:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.296479:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12308 00000100:00100000:0.0:1746143784.296486:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622698752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143784.296492:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143784.296499:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73aa1bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b95b expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143784.296509:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143784.296510:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143784.296515:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73aa1bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b95b expref: 33 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143784.296525:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73aa1bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b95b expref: 33 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143784.296532:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c400, rc 0) 00000100:00100000:0.0:1746143784.296547:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622698752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143784.296552:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12308 00000100:00100000:1.0:1746143784.301270:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093415880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626818816:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143784.301283:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626818944:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143784.301305:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143784.301342:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626819072:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143784.301362:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73aa1b4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b962 expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.301373:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73aa1b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b962 expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.301397:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1000, rc 0) 00000100:00100000:3.0:1746143784.301437:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963622698880:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5057us (5327us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143784.301444:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12307 00000100:00100000:0.0:1746143784.304125:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.304161:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.304190:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.304212:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.304219:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622699136 00000100:00100000:2.0:1746143784.304227:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622699136 00000100:00100000:1.0:1746143784.304274:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622699008 00000100:00100000:1.0:1746143784.304279:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622699008 00000100:00100000:0.0:1746143784.304457:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.304490:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622699520 00000100:00100000:3.0:1746143784.304494:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622699520 00002000:00100000:3.0:1746143784.304520:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880093912d80 x1830963622699520/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.304529:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093912d80 with x1830963622699520 ext(3145728->4194303) 00002000:00010000:3.0:1746143784.304533:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093912d80 00000100:00100000:3.0:1746143784.304546:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622699648 00000100:00100000:3.0:1746143784.304548:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622699648 00002000:00100000:3.0:1746143784.304558:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880093912680 x1830963622699648/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.304564:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093912680 with x1830963622699648 ext(3145728->4194303) 00002000:00010000:3.0:1746143784.304567:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093912680 00000100:00100000:3.0:1746143784.304579:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3607 00000100:00100000:3.0:1746143784.304585:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622699520:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143784.304588:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3608 00000100:00100000:0.0:1746143784.304595:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622699648:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143784.304707:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b923 expref: 9 pid: 6587 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.304732:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5810 00000100:00100000:2.0:1746143784.304737:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622699136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.304745:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.304750:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b923 expref: 9 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.304759:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b923 expref: 9 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.304775:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa159 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b923 expref: 9 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.304789:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143784.304793:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.304800:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.304805:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.304836:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622699136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 98us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.304841:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5810 00010000:00010000:1.0:1746143784.305301:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b946 expref: 273 pid: 6587 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143784.305321:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5811 00000100:00100000:1.0:1746143784.305326:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+273:2009:x1830963622699008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143784.305332:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143784.305335:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b946 expref: 273 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143784.305343:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b946 expref: 273 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143784.305354:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73aa191 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b946 expref: 273 pid: 6587 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143784.305373:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143784.305376:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.305382:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.305391:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.305406:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143784.305421:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+272:2009:x1830963622699008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 95us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.305426:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5811 00010000:00010000:1.0:1746143784.305444:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.305450:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143784.305464:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000100:00100000:3.0:1746143784.305468:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622699776 00000100:00100000:3.0:1746143784.305472:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622699776 00000100:00100000:3.0:1746143784.305506:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12309 00000100:00100000:3.0:1746143784.305511:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32357:x1830963622699776:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143784.305520:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.305532:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b969 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.305550:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 22 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.305558:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa16e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b938 expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.305560:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73aa19f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b94d expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.305565:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.305570:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.305570:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b94d expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.305571:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.305574:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->3690495] (req 3145728->3690495) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.305575:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143784.305577:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143784.305579:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550e00, rc 0) 00010000:00010000:3.0:1746143784.305594:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143784.305596:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32364:x1830963622698496:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 12609us (13027us total) trans 8589943737 rc 0/0 00000100:00100000:1.0:1746143784.305602:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12970 00010000:00010000:3.0:1746143784.305603:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 13 pid: 9587 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143784.305613:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626819200:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143784.305660:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa16e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b938 expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.305668:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa16e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b938 expref: 8 pid: 9839 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143784.305675:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626819328:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143784.305698:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 22 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.305706:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 22 pid: 9839 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143784.305713:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626819456:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143784.305728:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.314020:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.314190:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626819200:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143784.314200:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626819328:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143784.314206:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626819456:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143784.314232:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->3690495] (req 3145728->3690495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.314247:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1800, rc 0) 00000100:00100000:3.0:1746143784.314281:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32357:x1830963622699776:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8769us (9824us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.314288:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12309 00000100:00100000:2.0:1746143784.314442:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622699904 00000100:00100000:2.0:1746143784.314448:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622699904 00010000:00010000:2.0:1746143784.314474:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa16e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b938 expref: 9 pid: 9839 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143784.314501:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5812 00000100:00100000:2.0:1746143784.314507:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622699904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.314518:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.314532:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa16e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b938 expref: 9 pid: 9839 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143784.314541:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa16e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b938 expref: 9 pid: 9839 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143784.314559:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73aa16e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b938 expref: 9 pid: 9839 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143784.314572:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.314589:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622699904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 82us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.314595:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5812 00000100:00100000:1.0:1746143784.317433:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.317453:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622700544 00000100:00100000:1.0:1746143784.317458:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622700544 00000100:00100000:0.0:1746143784.317484:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622699648:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12888us (13268us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143784.317490:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12971 00000100:00100000:0.0:1746143784.317492:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3608 00000100:00100000:1.0:1746143784.317496:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32364:x1830963622700544:12345-192.168.202.3@tcp:101:mirror_io.0 00002000:00100000:0.0:1746143784.317500:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880093912680 x1830963622699648/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143784.317509:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093912680 with x1830963622699648 ext(3145728->4194303) 00002000:00010000:0.0:1746143784.317513:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093912680 00010000:00010000:1.0:1746143784.317514:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.317516:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143784.317535:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550e00/0x87925e4cb73aa1a6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b94d expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.317557:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143784.317561:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143784.317572:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73aa1d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b970 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143784.317726:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.317737:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622700160 00000100:00100000:0.0:1746143784.317740:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622700160 00002000:00100000:0.0:1746143784.317756:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8800921cc380 x1830963622700160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143784.317762:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc380 with x1830963622700160 ext(1048576->2097151) 00002000:00010000:0.0:1746143784.317765:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cc380 00000100:00100000:0.0:1746143784.317781:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3609 00000100:00100000:0.0:1746143784.317786:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622700160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143784.318404:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.318780:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622700288 00000100:00100000:3.0:1746143784.318784:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622700288 00010000:00010000:3.0:1746143784.318800:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 23 pid: 9839 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143784.318824:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5813 00000100:00100000:3.0:1746143784.318829:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622700288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143784.318837:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.318849:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 23 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.318865:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 23 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.318879:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73aa0e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8e4 expref: 23 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.318897:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.318928:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963622700288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 98us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.318934:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5813 00010000:00010000:1.0:1746143784.318980:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73aa1d7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.318992:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73aa1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.319001:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73aa1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143784.319003:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622699520:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14417us (14811us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143784.319008:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3607 00010000:00010000:1.0:1746143784.319010:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73aa1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00002000:00100000:3.0:1746143784.319014:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880093912d80 x1830963622699520/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143784.319015:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73aa1d7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00002000:00100000:3.0:1746143784.319020:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093912d80 with x1830963622699520 ext(3145728->4194303) 00010000:00010000:1.0:1746143784.319020:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73aa1d7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.319025:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 11 pid: 9587 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143784.319026:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143784.319029:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73aa1d7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.319035:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73aa1d7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.319038:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 11 pid: 9587 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143784.319041:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00002000:00010000:3.0:1746143784.319043:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093912d80 00010000:00010000:1.0:1746143784.319044:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143784.319046:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73aa1d7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.319051:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73aa1d7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.319072:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73aa1d0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b970 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.319079:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73aa1d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b970 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.319086:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550000, rc 0) 00000100:00100000:1.0:1746143784.319104:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32364:x1830963622700544:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 1607us (1678us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143784.319110:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12971 00000100:00100000:0.0:1746143784.322139:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.322195:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622700800 00000100:00100000:3.0:1746143784.322203:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622700800 00002000:00100000:3.0:1746143784.322241:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800921cf100 x1830963622700800/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.322249:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cf100 with x1830963622700800 ext(1048576->2097151) 00002000:00010000:3.0:1746143784.322253:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cf100 00000100:00100000:3.0:1746143784.322280:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3610 00000100:00100000:3.0:1746143784.322287:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622700800:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143784.322737:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.322887:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622701056 00000100:00100000:1.0:1746143784.322890:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622701056 00000100:00100000:1.0:1746143784.322938:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12972 00000100:00100000:1.0:1746143784.322944:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:32369:x1830963622701056:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143784.322955:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.322974:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73aa1de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b977 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.323030:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323040:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323049:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323058:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73aa1ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323063:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73aa1ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323068:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73aa1ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323135:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323142:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323147:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143784.323154:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143784.323206:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323212:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323220:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323225:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323229:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143784.323232:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323238:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323247:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143784.323249:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143784.323253:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323257:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551400/0x87925e4cb73aa1e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323266:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73aa1ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323271:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73aa1ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323275:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73aa1ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323279:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d550800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143784.323281:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73aa1ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323288:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73aa1ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323293:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5bd5400) 00010000:00010000:1.0:1746143784.323295:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143784.323296:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73aa1ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323300:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73aa1ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143784.323326:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73aa1de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b977 expref: 275 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.323335:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b977 expref: 274 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.323340:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143784.323342:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143784.323344:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551a00, rc 0) 00000100:00100000:1.0:1746143784.323364:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+274:32369:x1830963622701056:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 421us (629us total) trans 8589943738 rc 0/0 00000100:00100000:1.0:1746143784.323370:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12972 00000100:00100000:2.0:1746143784.326732:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.326769:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.326821:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.326841:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622701568 00000100:00100000:2.0:1746143784.326847:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622701568 00010000:00010000:2.0:1746143784.326896:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 11 pid: 9587 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143784.326942:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5814 00000100:00100000:2.0:1746143784.326950:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137108850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622701568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.326965:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.326982:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 11 pid: 9587 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143784.326992:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 11 pid: 9587 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143784.327002:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622701312 00000100:00100000:3.0:1746143784.327006:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622701312 00010000:00010000:2.0:1746143784.327010:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73aa0fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8f9 expref: 11 pid: 9587 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143784.327024:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.327026:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143784.327036:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4774 00000100:00100000:3.0:1746143784.327041:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32364:x1830963622701312:12345-192.168.202.3@tcp:35:mirror_io.0 00010000:00010000:2.0:1746143784.327111:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.327119:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.327147:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.327158:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626819584:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143784.327173:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32364:x1830963622701312:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 132us (449us total) trans 8589943739 rc 0/0 00000100:00100000:3.0:1746143784.327179:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4774 00000100:00100000:0.0:1746143784.327215:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622701440 00000100:00100000:0.0:1746143784.327220:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622701440 00000100:00100000:0.0:1746143784.327249:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12310 00000100:00100000:0.0:1746143784.327254:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622701440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143784.327263:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143784.327272:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27000/0x87925e4cb73aa201 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b97e expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143784.327298:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626819712:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143784.327351:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.327365:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.329260:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963622700160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11468us (11528us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143784.329269:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3609 00002000:00100000:2.0:1746143784.329277:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff8800921cc380 x1830963622700160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.329284:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc380 with x1830963622700160 ext(1048576->2097151) 00002000:00010000:2.0:1746143784.329288:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cc380 00000100:00100000:2.0:1746143784.331723:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626819584:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.331738:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.331780:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137108850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622701568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4829us (4956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.331788:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5814 00000100:00100000:3.0:1746143784.332446:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622700800:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10155us (10310us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143784.332455:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3610 00002000:00100000:3.0:1746143784.332462:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800921cf100 x1830963622700800/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.332474:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cf100 with x1830963622700800 ext(1048576->2097151) 00002000:00010000:3.0:1746143784.332479:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cf100 00000100:00100000:1.0:1746143784.334629:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.334651:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626819712:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143784.334675:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b27000/0x87925e4cb73aa201 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b97e expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143784.334686:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27000/0x87925e4cb73aa201 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b97e expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143784.334693:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622701824 00000100:00100000:3.0:1746143784.334698:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622701824 00010000:00010000:0.0:1746143784.334707:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27000, rc 0) 00002000:00100000:3.0:1746143784.334728:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3686400->3690495) req@ffff880093415880 x1830963622701824/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143784.334734:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622701440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7479us (7964us total) trans 0 rc 301/301 00002000:00100000:3.0:1746143784.334735:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415880 with x1830963622701824 ext(3686400->3690495) 00002000:00010000:3.0:1746143784.334739:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093415880 00000100:00100000:0.0:1746143784.334740:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12310 00000100:00100000:3.0:1746143784.334751:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3611 00000100:00100000:3.0:1746143784.334756:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622701824:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143784.335194:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2010:x1830963622701824:12345-192.168.202.3@tcp:3:cat.0 Request processed in 436us (568us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143784.335200:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3611 00002000:00100000:3.0:1746143784.335205:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3686400->3690495) req@ffff880093415880 x1830963622701824/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.335212:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415880 with x1830963622701824 ext(3686400->3690495) 00002000:00010000:3.0:1746143784.335215:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093415880 00000100:00100000:0.0:1746143784.338908:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.339126:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622702080 00000100:00100000:3.0:1746143784.339134:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622702080 00002000:00100000:3.0:1746143784.339167:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8800921ced80 x1830963622702080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.339176:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ced80 with x1830963622702080 ext(4194304->4968447) 00002000:00010000:3.0:1746143784.339180:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921ced80 00000100:00100000:3.0:1746143784.339209:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3612 00000100:00100000:3.0:1746143784.339217:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622702080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143784.341998:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.342053:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.342204:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622702208 00000100:00100000:2.0:1746143784.342210:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622702208 00000100:00100000:2.0:1746143784.342248:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622702336 00000100:00100000:2.0:1746143784.342250:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622702336 00000100:00100000:2.0:1746143784.342266:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12311 00000100:00100000:2.0:1746143784.342271:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622702208:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143784.342275:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12312 00000100:00100000:1.0:1746143784.342282:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622702336:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.342283:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.342290:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.342295:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73aa208 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b985 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.342298:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73aa20f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b98c expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.342330:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626819968:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143784.342331:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626819840:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143784.342383:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e561a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.342732:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.343827:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.344016:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622702592 00000100:00100000:3.0:1746143784.344020:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622702592 00000100:00100000:3.0:1746143784.344063:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4775 00000100:00100000:3.0:1746143784.344068:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32357:x1830963622702592:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143784.344982:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32357:x1830963622702592:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 911us (1154us total) trans 8589943740 rc 0/0 00000100:00100000:3.0:1746143784.344990:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4775 00000100:00100000:0.0:1746143784.345255:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626819840:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143784.345277:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73aa20f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b98c expref: 32 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143784.345287:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550e00/0x87925e4cb73aa20f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b98c expref: 32 pid: 9839 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143784.345388:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622702080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6172us (6488us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143784.345395:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3612 00002000:00100000:3.0:1746143784.345402:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8800921ced80 x1830963622702080/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.345410:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ced80 with x1830963622702080 ext(4194304->4968447) 00002000:00010000:3.0:1746143784.345414:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921ced80 00010000:00010000:0.0:1746143784.345457:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550e00, rc 0) 00000100:00100000:0.0:1746143784.345474:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963622702336:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3193us (3421us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143784.345479:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12312 00000100:00100000:2.0:1746143784.346240:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626819968:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143784.346257:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73aa208 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b985 expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.346267:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73aa208 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b985 expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.346288:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085a00, rc 0) 00000100:00100000:2.0:1746143784.346319:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622702208:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4046us (4328us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143784.346324:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12311 00000100:00100000:0.0:1746143784.355426:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.356743:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622702720 00000100:00100000:2.0:1746143784.356750:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622702720 00000100:00100000:2.0:1746143784.356794:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12313 00000100:00100000:2.0:1746143784.356801:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:32367:x1830963622702720:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.356817:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.356831:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b993 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.356855:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 9 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.356871:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.356872:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.356875:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.356902:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 9 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.356930:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 9 pid: 1945 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.356941:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626820096:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.357018:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.365498:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626820096:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.365523:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.365538:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084c00, rc 0) 00000100:00100000:2.0:1746143784.365572:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:32367:x1830963622702720:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8771us (10153us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.365580:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12313 00000100:00100000:0.0:1746143784.365778:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.366735:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622702848 00000100:00100000:3.0:1746143784.366743:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622702848 00002000:00100000:3.0:1746143784.366773:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3690495) req@ffff8800921cd180 x1830963622702848/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.366780:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cd180 with x1830963622702848 ext(3145728->3690495) 00010000:00010000:3.0:1746143784.366786:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 10 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.366796:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 10 pid: 1945 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143784.366801:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800921cd180 00000100:00100000:3.0:1746143784.366828:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1485 00000100:00100000:3.0:1746143784.366834:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2008:x1830963622702848:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143784.380086:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622702848:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13240us (14295us total) trans 21474840431 rc 0/0 00000100:00100000:0.0:1746143784.380100:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1485 00002000:00100000:0.0:1746143784.380113:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3690495) req@ffff8800921cd180 x1830963622702848/t21474840431(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/448 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143784.380123:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cd180 with x1830963622702848 ext(3145728->3690495) 00010000:00010000:0.0:1746143784.380135:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 12 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.380151:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 12 pid: 1945 timeout: 943 lvb_type: 0 00002000:00010000:0.0:1746143784.380158:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800921cd180 00000100:00100000:0.0:1746143784.384634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.385531:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622702976 00000100:00100000:2.0:1746143784.385542:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622702976 00010000:00010000:2.0:1746143784.385586:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 12 pid: 1945 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.385629:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5815 00000100:00100000:2.0:1746143784.385637:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622702976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.385654:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.385675:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 12 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.385692:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 12 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.385718:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa1c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3690495) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b969 expref: 12 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.385747:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.385749:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.385758:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.385766:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.385863:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.385876:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626820224:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143784.386345:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.390107:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963626820224:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.390133:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143784.390144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.390185:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622702976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4548us (5562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.390196:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5815 00000100:00100000:0.0:1746143784.390222:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622703232 00000100:00100000:0.0:1746143784.390230:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622703232 00002000:00100000:0.0:1746143784.390452:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880093725500 x1830963622703232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143784.390461:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725500 with x1830963622703232 ext(2097152->3145727) 00002000:00010000:0.0:1746143784.390466:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093725500 00000100:00100000:0.0:1746143784.390492:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3613 00000100:00100000:0.0:1746143784.390499:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622703232:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143784.399717:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622703232:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9210us (9574us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143784.399727:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3613 00002000:00100000:2.0:1746143784.399736:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880093725500 x1830963622703232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.399745:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093725500 with x1830963622703232 ext(2097152->3145727) 00002000:00010000:2.0:1746143784.399750:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093725500 00000100:00100000:0.0:1746143784.407378:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.409469:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622703360 00000100:00100000:2.0:1746143784.409478:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622703360 00000100:00100000:2.0:1746143784.409529:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12314 00000100:00100000:2.0:1746143784.409536:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:32367:x1830963622703360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.409551:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.409563:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b99a expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.409585:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.409592:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.409593:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.409596:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.409618:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 9 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.409626:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 9 pid: 9839 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.409640:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626820352:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.409716:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.413193:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626820352:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.413222:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.413238:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7800, rc 0) 00000100:00100000:2.0:1746143784.413279:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:32367:x1830963622703360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3742us (5908us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.413286:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12314 00000100:00100000:0.0:1746143784.414079:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.414171:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622703488 00000100:00100000:2.0:1746143784.414180:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622703488 00002000:00100000:2.0:1746143784.414224:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3043328->3145727) req@ffff8800921cea00 x1830963622703488/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.414233:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cea00 with x1830963622703488 ext(3043328->3145727) 00010000:00010000:2.0:1746143784.414243:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 10 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.414257:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 10 pid: 9839 timeout: 943 lvb_type: 0 00002000:00010000:2.0:1746143784.414264:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921cea00 00000100:00100000:2.0:1746143784.414284:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1486 00000100:00100000:2.0:1746143784.414291:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622703488:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143784.419303:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622703488:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5004us (5223us total) trans 17179873099 rc 0/0 00000100:00100000:0.0:1746143784.419316:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1486 00002000:00100000:0.0:1746143784.419326:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (3043328->3145727) req@ffff8800921cea00 x1830963622703488/t17179873099(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/448 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143784.419334:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cea00 with x1830963622703488 ext(3043328->3145727) 00010000:00010000:0.0:1746143784.419342:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 12 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.419354:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 12 pid: 9839 timeout: 943 lvb_type: 0 00002000:00010000:0.0:1746143784.419360:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921cea00 00000100:00100000:0.0:1746143784.425458:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.425563:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622703616 00000100:00100000:2.0:1746143784.425571:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622703616 00010000:00010000:2.0:1746143784.425602:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 12 pid: 9839 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.425641:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5816 00000100:00100000:2.0:1746143784.425647:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622703616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.425659:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.425674:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 12 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.425685:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 12 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.425703:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73aa13d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b91c expref: 12 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.425718:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.425720:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.425725:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.425732:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.425759:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.425775:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626820480:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143784.426666:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.432905:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626820480:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.432950:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.432990:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622703616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7342us (7538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.432999:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5816 00000100:00100000:0.0:1746143784.434095:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.434130:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.434186:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.434204:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622704256 00000100:00100000:0.0:1746143784.434209:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622704256 00002000:00100000:0.0:1746143784.434249:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800921cf800 x1830963622704256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143784.434258:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cf800 with x1830963622704256 ext(3145728->4194303) 00002000:00010000:0.0:1746143784.434262:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cf800 00000100:00100000:0.0:1746143784.434275:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622704128 00000100:00100000:0.0:1746143784.434277:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622704128 00002000:00100000:0.0:1746143784.434288:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800921ce680 x1830963622704128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143784.434299:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ce680 with x1830963622704128 ext(2097152->4194303) 00002000:00010000:0.0:1746143784.434302:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921ce680 00000100:00100000:0.0:1746143784.434312:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3614 00000100:00100000:0.0:1746143784.434318:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622704256:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143784.434957:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3615 00000100:00100000:0.0:1746143784.434964:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622704128:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143784.437322:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622703744 00000100:00100000:2.0:1746143784.437332:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622703744 00000100:00100000:2.0:1746143784.437372:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12315 00000100:00100000:2.0:1746143784.437378:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:32369:x1830963622703744:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143784.437393:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.437413:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9a1 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.437437:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.437445:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73aa1bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b95b expref: 35 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.437451:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73aa167 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b931 expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.437461:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.437463:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.437466:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1253376->2056191] (req 1253376->2056191) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.437489:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73aa167 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b931 expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.437499:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73aa167 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b931 expref: 8 pid: 9839 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143784.437509:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626820608:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.437578:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73aa1bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b95b expref: 35 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.437586:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73aa1bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b95b expref: 35 pid: 9839 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143784.437592:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626820736:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.437615:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 10 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.437622:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 10 pid: 9839 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.437633:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626820864:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.437645:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.446779:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.447010:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626820608:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.447020:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626820736:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143784.447088:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622704384 00000100:00100000:3.0:1746143784.447094:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622704384 00010000:00010000:3.0:1746143784.447121:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73aa167 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b931 expref: 9 pid: 9839 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143784.447146:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5817 00000100:00100000:3.0:1746143784.447152:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622704384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143784.447163:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.447178:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73aa167 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b931 expref: 9 pid: 9839 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143784.447187:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73aa167 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b931 expref: 9 pid: 9839 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143784.447206:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73aa167 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b931 expref: 9 pid: 9839 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143784.447221:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143784.447275:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622704256:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 12955us (13142us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143784.447283:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3614 00002000:00100000:1.0:1746143784.447290:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800921cf800 x1830963622704256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.447298:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cf800 with x1830963622704256 ext(3145728->4194303) 00002000:00010000:1.0:1746143784.447301:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cf800 00000100:00100000:2.0:1746143784.447431:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626820864:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.447453:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [1253376->2056191] (req 1253376->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.447463:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7e00, rc 0) 00000100:00100000:3.0:1746143784.448234:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622704384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1080us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.448240:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5817 00000100:00100000:2.0:1746143784.448348:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:32369:x1830963622703744:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10969us (14254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.448354:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12315 00000100:00100000:0.0:1746143784.448868:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.449294:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622704512 00000100:00100000:3.0:1746143784.449300:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622704512 00010000:00010000:3.0:1746143784.449317:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73aa1bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b95b expref: 35 pid: 9839 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143784.449341:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5818 00000100:00100000:3.0:1746143784.449346:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622704512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143784.449357:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.449368:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73aa1bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b95b expref: 35 pid: 9839 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143784.449377:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73aa1bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b95b expref: 35 pid: 9839 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143784.449389:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73aa1bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b95b expref: 35 pid: 9839 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143784.449399:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.449429:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622704512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 82us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.449434:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5818 00000100:00100000:0.0:1746143784.451030:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.451254:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622704640 00000100:00100000:2.0:1746143784.451260:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622704640 00010000:00010000:2.0:1746143784.451280:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 11 pid: 9839 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.451312:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5819 00000100:00100000:2.0:1746143784.451319:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622704640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.451329:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.451342:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 11 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.451356:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 11 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.451370:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73aa136 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b915 expref: 11 pid: 9839 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.451420:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.451422:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.451428:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 33 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.451436:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 33 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.451468:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 33 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.451478:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626820992:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143784.451543:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.453076:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626820992:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.453088:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.453110:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622704640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1792us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.453117:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5819 00000100:00100000:0.0:1746143784.453403:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.453454:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622704896 00000100:00100000:1.0:1746143784.453459:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622704896 00002000:00100000:1.0:1746143784.453482:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1253376->1257471) req@ffff880092b23800 x1830963622704896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.453491:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b23800 with x1830963622704896 ext(1253376->1257471) 00002000:00010000:1.0:1746143784.453495:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b23800 00000100:00100000:1.0:1746143784.453508:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3616 00000100:00100000:1.0:1746143784.453513:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622704896:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143784.453593:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622704896:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 80us (191us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143784.453599:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3616 00002000:00100000:1.0:1746143784.453603:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x396:0x0] (1253376->1257471) req@ffff880092b23800 x1830963622704896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.453616:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b23800 with x1830963622704896 ext(1253376->1257471) 00002000:00010000:1.0:1746143784.453619:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b23800 00000100:00100000:2.0:1746143784.453775:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963622704128:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 18812us (19588us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143784.453782:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3615 00002000:00100000:2.0:1746143784.453786:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800921ce680 x1830963622704128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.453793:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ce680 with x1830963622704128 ext(2097152->4194303) 00002000:00010000:2.0:1746143784.453796:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921ce680 00000100:00100000:0.0:1746143784.468960:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.469016:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.469058:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622705152 00000100:00100000:2.0:1746143784.469071:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622705152 00000100:00100000:1.0:1746143784.469102:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622705408 00000100:00100000:1.0:1746143784.469109:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622705408 00002000:00100000:2.0:1746143784.469113:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092b20380 x1830963622705152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.469122:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20380 with x1830963622705152 ext(4194304->4968447) 00002000:00010000:2.0:1746143784.469126:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b20380 00002000:00100000:1.0:1746143784.469141:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (2052096->2056191) req@ffff880092b22a00 x1830963622705408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.469151:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b22a00 with x1830963622705408 ext(2052096->2056191) 00000100:00100000:2.0:1746143784.469154:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3617 00002000:00010000:1.0:1746143784.469155:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b22a00 00000100:00100000:2.0:1746143784.469161:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622705152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143784.469181:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3618 00000100:00100000:1.0:1746143784.469187:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963622705408:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143784.469646:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963622705408:12345-192.168.202.3@tcp:3:cat.0 Request processed in 456us (627us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143784.469653:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3618 00002000:00100000:1.0:1746143784.469659:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (2052096->2056191) req@ffff880092b22a00 x1830963622705408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.469666:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b22a00 with x1830963622705408 ext(2052096->2056191) 00002000:00010000:1.0:1746143784.469668:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b22a00 00000100:00100000:1.0:1746143784.471780:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.472809:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622705664 00000100:00100000:2.0:1746143784.472822:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622705664 00000100:00100000:2.0:1746143784.472886:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12973 00000100:00100000:2.0:1746143784.472892:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32374:x1830963622705664:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143784.472926:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.472941:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73aa22b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9a8 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.473001:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473012:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473021:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473031:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa239 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473036:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473041:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473115:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473123:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473128:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143784.473135:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143784.473187:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473193:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473197:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473202:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473206:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a3a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143784.473210:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473216:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473225:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143784.473227:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143784.473229:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473234:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73aa232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473260:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473264:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa239 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473267:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473271:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143784.473273:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473277:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa239 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473283:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092b11300) 00010000:00010000:2.0:1746143784.473284:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143784.473286:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa239 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473293:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa239 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.473322:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73aa22b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a8 expref: 19 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.473332:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a8 expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.473338:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143784.473340:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143784.473341:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2000, rc 0) 00000100:00100000:2.0:1746143784.473391:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32374:x1830963622705664:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 498us (1617us total) trans 8589943741 rc 0/0 00000100:00100000:2.0:1746143784.473397:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12973 00000100:00100000:0.0:1746143784.478522:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.478772:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622705920 00000100:00100000:3.0:1746143784.478780:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622705920 00000100:00100000:3.0:1746143784.478825:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4776 00000100:00100000:3.0:1746143784.478832:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b496850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+274:32369:x1830963622705920:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143784.479509:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622705152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10345us (10603us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143784.479516:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3617 00002000:00100000:2.0:1746143784.479524:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880092b20380 x1830963622705152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.479532:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20380 with x1830963622705152 ext(4194304->4968447) 00002000:00010000:2.0:1746143784.479538:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b20380 00000100:00100000:3.0:1746143784.479635:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b496850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:32369:x1830963622705920:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 803us (1120us total) trans 8589943742 rc 0/0 00000100:00100000:3.0:1746143784.479644:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4776 00000100:00100000:0.0:1746143784.499895:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.500150:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622706048 00000100:00100000:2.0:1746143784.500163:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622706048 00000100:00100000:2.0:1746143784.500219:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12316 00000100:00100000:2.0:1746143784.500229:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32374:x1830963622706048:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143784.500251:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.500272:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9af expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.500305:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.500313:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.500315:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.500318:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3256320->3702783] (req 3256320->3702783) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.500350:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.500363:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 22 pid: 1945 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.500376:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626821120:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.500492:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.504325:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963626821120:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.504361:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3256320->3702783] (req 3256320->3702783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.504380:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2e00, rc 0) 00000100:00100000:2.0:1746143784.504443:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32374:x1830963622706048:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4215us (4562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.504455:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12316 00000100:00100000:0.0:1746143784.512278:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.512350:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622706176 00000100:00100000:2.0:1746143784.512362:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622706176 00010000:00010000:2.0:1746143784.512406:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 23 pid: 1945 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.512448:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5820 00000100:00100000:2.0:1746143784.512457:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622706176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.512475:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.512496:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 23 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.512508:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 23 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.512531:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73aa216 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b993 expref: 23 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.512565:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.512567:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.512574:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.512587:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.512624:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.512638:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626821248:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143784.512740:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.516326:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.516522:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622706432 00000100:00100000:3.0:1746143784.516532:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622706432 00002000:00100000:3.0:1746143784.516580:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3256320->3260415) req@ffff880092b20700 x1830963622706432/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.516590:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20700 with x1830963622706432 ext(3256320->3260415) 00002000:00010000:3.0:1746143784.516595:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b20700 00000100:00100000:3.0:1746143784.516631:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3619 00000100:00100000:3.0:1746143784.516649:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622706432:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143784.516798:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622706432:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 159us (482us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143784.516805:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3619 00002000:00100000:3.0:1746143784.516810:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3256320->3260415) req@ffff880092b20700 x1830963622706432/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.516816:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b20700 with x1830963622706432 ext(3256320->3260415) 00002000:00010000:3.0:1746143784.516819:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b20700 00000100:00100000:2.0:1746143784.516825:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626821248:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.516847:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.516894:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963622706176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4437us (4627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.516903:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5820 00000100:00100000:0.0:1746143784.521566:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.522409:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622706688 00000100:00100000:3.0:1746143784.522421:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622706688 00002000:00100000:3.0:1746143784.522470:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3698688->3702783) req@ffff880092b22680 x1830963622706688/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.522479:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b22680 with x1830963622706688 ext(3698688->3702783) 00002000:00010000:3.0:1746143784.522485:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b22680 00000100:00100000:3.0:1746143784.522519:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3620 00000100:00100000:3.0:1746143784.522527:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622706688:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143784.522673:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622706688:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 146us (1118us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143784.522679:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3620 00002000:00100000:3.0:1746143784.522685:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3698688->3702783) req@ffff880092b22680 x1830963622706688/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.522691:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b22680 with x1830963622706688 ext(3698688->3702783) 00002000:00010000:3.0:1746143784.522694:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b22680 00000100:00100000:0.0:1746143784.529555:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.529741:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622706944 00000100:00100000:3.0:1746143784.529753:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622706944 00000100:00100000:3.0:1746143784.529819:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4777 00000100:00100000:3.0:1746143784.529828:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32374:x1830963622706944:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143784.530127:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:32374:x1830963622706944:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 299us (583us total) trans 8589943743 rc 0/0 00000100:00100000:3.0:1746143784.530134:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4777 00000100:00100000:0.0:1746143784.584408:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.585044:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622707072 00000100:00100000:2.0:1746143784.585056:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622707072 00000100:00100000:2.0:1746143784.585118:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12317 00000100:00100000:2.0:1746143784.585126:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2009:x1830963622707072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.585146:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.585165:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73aa255 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9b6 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.585222:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626821376:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143784.585270:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.585322:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143784.585394:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622707200 00000100:00100000:1.0:1746143784.585398:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622707200 00000100:00100000:1.0:1746143784.585429:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12318 00000100:00100000:1.0:1746143784.585434:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622707200:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143784.585441:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.585449:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73aa25c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9bd expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.585462:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.585463:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.585472:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73aa25c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9bd expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.585486:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73aa25c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9bd expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.585496:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512a00, rc 0) 00000100:00100000:1.0:1746143784.585531:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622707200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.585537:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12318 00000100:00100000:2.0:1746143784.587111:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626821376:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143784.587141:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73aa255 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9b6 expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.587153:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73aa255 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9b6 expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.587182:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2200, rc 0) 00000100:00100000:2.0:1746143784.587222:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2009:x1830963622707072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2097us (2823us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143784.587229:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12317 00000100:00100000:0.0:1746143784.593885:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.594175:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622707328 00000100:00100000:2.0:1746143784.594190:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622707328 00000100:00100000:2.0:1746143784.594550:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12319 00000100:00100000:2.0:1746143784.594560:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32380:x1830963622707328:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.594579:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.594599:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9c4 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.594636:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.594643:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.594645:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.594649:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.594680:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.594692:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 31 pid: 1945 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.594710:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626821504:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.594811:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.600419:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963626821504:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.600458:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.600477:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3e00, rc 0) 00000100:00100000:2.0:1746143784.600538:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32380:x1830963622707328:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5978us (6662us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.600548:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12319 00000100:00100000:0.0:1746143784.601411:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.601803:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622707456 00000100:00100000:2.0:1746143784.601811:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622707456 00002000:00100000:2.0:1746143784.601864:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1253376->2056191) req@ffff8800911fb100 x1830963622707456/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.601873:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911fb100 with x1830963622707456 ext(1253376->2056191) 00010000:00010000:2.0:1746143784.601882:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 32 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.601895:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 32 pid: 1945 timeout: 943 lvb_type: 0 00002000:00010000:2.0:1746143784.601902:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800911fb100 00000100:00100000:3.0:1746143784.602774:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1487 00000100:00100000:3.0:1746143784.602785:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963622707456:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143784.615723:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622707456:12345-192.168.202.3@tcp:4:cat.0 Request processed in 12926us (14301us total) trans 17179873100 rc 0/0 00000100:00100000:3.0:1746143784.615737:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1487 00002000:00100000:3.0:1746143784.615750:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1253376->2056191) req@ffff8800911fb100 x1830963622707456/t17179873100(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/448 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.615760:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911fb100 with x1830963622707456 ext(1253376->2056191) 00010000:00010000:3.0:1746143784.615771:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 34 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.615785:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 34 pid: 1945 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143784.615791:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800911fb100 00000100:00100000:1.0:1746143784.627194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.627300:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622707584 00000100:00100000:2.0:1746143784.627311:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622707584 00010000:00010000:2.0:1746143784.627357:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 34 pid: 1945 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.627452:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5821 00000100:00100000:2.0:1746143784.627461:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b41f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622707584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.627492:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.627516:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 34 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.627528:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 34 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.627551:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73aa224 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->2056191) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a1 expref: 34 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.627646:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.627648:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.627656:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.627663:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.627698:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.627711:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626821632:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143784.629062:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.632132:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.632182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.632362:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622707712 00000100:00100000:3.0:1746143784.632373:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622707712 00000100:00100000:3.0:1746143784.632426:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622707840 00000100:00100000:3.0:1746143784.632428:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622707840 00000100:00100000:3.0:1746143784.632448:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12320 00000100:00100000:3.0:1746143784.632456:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622707712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143784.632475:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.632493:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73aa26a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9cb expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.632516:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.632518:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.632526:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73aa26a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9cb expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.632540:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73aa26a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9cb expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.632550:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33800, rc 0) 00000100:00100000:3.0:1746143784.632607:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622707712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 151us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.632614:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12320 00000100:00100000:3.0:1746143784.632632:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12321 00000100:00100000:3.0:1746143784.632637:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622707840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143784.632645:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.632654:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33400/0x87925e4cb73aa271 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9d2 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143784.633633:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626821760:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143784.633690:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626821632:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.633709:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.633821:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b41f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622707584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6360us (6638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.633830:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5821 00000100:00100000:3.0:1746143784.634206:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.636292:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.636474:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622708096 00000100:00100000:3.0:1746143784.636483:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622708096 00002000:00100000:3.0:1746143784.636530:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800911fa300 x1830963622708096/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.636540:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911fa300 with x1830963622708096 ext(1048576->2097151) 00002000:00010000:3.0:1746143784.636544:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800911fa300 00000100:00100000:3.0:1746143784.636988:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3621 00000100:00100000:3.0:1746143784.636997:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622708096:12345-192.168.202.3@tcp:3:cat.0 00002000:00010000:2.0:1746143784.639058:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143784 -> 1746143785 00000100:00100000:2.0:1746143784.639089:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626821760:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143784.639131:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33400/0x87925e4cb73aa271 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d2 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.639145:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33400/0x87925e4cb73aa271 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d2 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.639166:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33400, rc 0) 00000100:00100000:2.0:1746143784.639208:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622707840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6569us (7023us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143784.639217:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12321 00000100:00100000:0.0:1746143784.652412:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.652484:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622708352 00000100:00100000:2.0:1746143784.652495:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622708352 00002000:00100000:2.0:1746143784.652542:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800911f8a80 x1830963622708352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.652552:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911f8a80 with x1830963622708352 ext(1048576->2097151) 00002000:00010000:2.0:1746143784.652557:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800911f8a80 00000100:00100000:2.0:1746143784.652875:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3622 00000100:00100000:2.0:1746143784.652883:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622708352:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143784.654125:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622708096:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17126us (17838us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143784.654134:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3621 00002000:00100000:3.0:1746143784.654143:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800911fa300 x1830963622708096/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.654150:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911fa300 with x1830963622708096 ext(1048576->2097151) 00002000:00010000:3.0:1746143784.654154:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800911fa300 00000100:00100000:2.0:1746143784.663251:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622708352:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10356us (10837us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143784.663264:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3622 00002000:00100000:2.0:1746143784.663276:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8800911f8a80 x1830963622708352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.663286:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911f8a80 with x1830963622708352 ext(1048576->2097151) 00002000:00010000:2.0:1746143784.663292:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800911f8a80 00000100:00100000:0.0:1746143784.669775:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.669814:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.669877:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.669946:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622708480 00000100:00100000:2.0:1746143784.669956:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622708480 00000100:00100000:2.0:1746143784.670013:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12322 00000100:00100000:2.0:1746143784.670022:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:32383:x1830963622708480:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.670042:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.670062:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9d9 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.670089:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.670095:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.670097:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.670100:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.670131:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.670147:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 11 pid: 1945 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.670158:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626821888:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.670233:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.670260:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622708736 00000100:00100000:2.0:1746143784.670263:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622708736 00002000:00100000:2.0:1746143784.670289:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800911f8700 x1830963622708736/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 504/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.670299:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911f8700 with x1830963622708736 ext(2097152->4194303) 00010000:00010000:2.0:1746143784.670304:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 12 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.670314:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 12 pid: 1945 timeout: 943 lvb_type: 0 00002000:00010000:2.0:1746143784.670320:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800911f8700 00000100:00100000:2.0:1746143784.670331:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622708992 00000100:00100000:2.0:1746143784.670333:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622708992 00002000:00100000:2.0:1746143784.670343:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800911f8000 x1830963622708992/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.670350:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911f8000 with x1830963622708992 ext(2097152->4194303) 00002000:00010000:2.0:1746143784.670353:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800911f8000 00000100:00100000:2.0:1746143784.670362:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1488 00000100:00100000:2.0:1746143784.670367:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622708736:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143784.670523:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3623 00000100:00100000:1.0:1746143784.670530:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622708992:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143784.677668:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626821888:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.677705:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.677722:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323be00, rc 0) 00000100:00100000:2.0:1746143784.680405:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:32383:x1830963622708480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 10372us (10628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.680419:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12322 00000100:00100000:1.0:1746143784.682076:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.682871:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622709120 00000100:00100000:2.0:1746143784.682881:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622709120 00002000:00100000:2.0:1746143784.682943:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3256320->3702783) req@ffff880093724a80 x1830963622709120/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.682952:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724a80 with x1830963622709120 ext(3256320->3702783) 00010000:00010000:2.0:1746143784.682962:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 14 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.682976:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 14 pid: 1945 timeout: 943 lvb_type: 0 00002000:00010000:2.0:1746143784.682983:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093724a80 00000100:00100000:2.0:1746143784.683700:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1489 00000100:00100000:2.0:1746143784.683710:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622709120:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143784.686876:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2010:x1830963622708992:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16337us (16989us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143784.686888:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3623 00002000:00100000:1.0:1746143784.686898:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8800911f8000 x1830963622708992/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.686907:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911f8000 with x1830963622708992 ext(2097152->4194303) 00002000:00010000:1.0:1746143784.686929:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800911f8000 00000100:00100000:3.0:1746143784.687196:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622708736:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16827us (17381us total) trans 0 rc 1650688/1650688 00000100:00100000:3.0:1746143784.687204:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1488 00002000:00100000:3.0:1746143784.687209:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800911f8700 x1830963622708736/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 504/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 1650688/1650688 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.687216:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911f8700 with x1830963622708736 ext(2097152->4194303) 00010000:00010000:3.0:1746143784.687225:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 14 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.687239:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 14 pid: 1945 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143784.687245:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800911f8700 00000100:00100000:0.0:1746143784.691479:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.691882:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622709248 00000100:00100000:2.0:1746143784.691893:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622709248 00000100:00100000:2.0:1746143784.691974:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12323 00000100:00100000:2.0:1746143784.691983:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32380:x1830963622709248:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.692004:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.692021:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9e0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.692049:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.692051:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.692056:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.692068:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.692077:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086a00, rc 0) 00000100:00100000:2.0:1746143784.692131:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32380:x1830963622709248:12345-192.168.202.3@tcp:101:cat.0 Request processed in 149us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.692137:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12323 00000100:00100000:3.0:1746143784.698632:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622709120:12345-192.168.202.3@tcp:4:cat.0 Request processed in 14912us (16549us total) trans 21474840432 rc 0/0 00000100:00100000:3.0:1746143784.698647:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1489 00002000:00100000:3.0:1746143784.698660:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3256320->3702783) req@ffff880093724a80 x1830963622709120/t21474840432(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/448 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.698670:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724a80 with x1830963622709120 ext(3256320->3702783) 00010000:00010000:3.0:1746143784.698680:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 15 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.698696:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 15 pid: 1945 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143784.698703:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093724a80 00000100:00100000:0.0:1746143784.703022:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.703132:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622709376 00000100:00100000:2.0:1746143784.703143:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622709376 00010000:00010000:2.0:1746143784.703187:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 15 pid: 1945 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.703233:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5822 00000100:00100000:2.0:1746143784.703243:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2010:x1830963622709376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.703261:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.703283:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 15 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.703299:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 15 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.703325:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2e00/0x87925e4cb73aa24e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3256320->3702783) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9af expref: 15 pid: 1945 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.703579:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.703581:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.703589:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.703598:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.703606:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.703607:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.703610:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 14 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.703616:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 14 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.703650:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 14 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.703662:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626822016:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.704164:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.704173:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626822144:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143784.704193:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.708948:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626822016:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143784.708960:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626822144:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.708981:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.709026:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2010:x1830963622709376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5784us (6015us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.709036:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5822 00000100:00100000:0.0:1746143784.709269:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.709342:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.709393:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622709888 00000100:00100000:2.0:1746143784.709399:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622709888 00000100:00100000:2.0:1746143784.709429:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12974 00000100:00100000:2.0:1746143784.709435:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:32385:x1830963622709888:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:3.0:1746143784.709455:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622709632 00010000:00010000:2.0:1746143784.709458:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143784.709460:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622709632 00010000:00010000:2.0:1746143784.709476:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73aa286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9e7 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143784.709488:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800911fad80 x1830963622709632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.709497:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911fad80 with x1830963622709632 ext(2097152->4194303) 00002000:00010000:3.0:1746143784.709502:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800911fad80 00000100:00100000:3.0:1746143784.709524:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3624 00000100:00100000:3.0:1746143784.709530:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622709632:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143784.709580:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.709595:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b977 expref: 276 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.709602:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a8 expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.709613:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.709638:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a8 expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.709648:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a8 expref: 18 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.709658:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626822272:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.709710:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b977 expref: 276 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.709717:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b977 expref: 276 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.709724:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626822400:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.709739:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1b9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.714802:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.714887:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.714895:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622710144 00000100:00100000:3.0:1746143784.714903:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622710144 00000100:00100000:0.0:1746143784.714950:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:3.0:1746143784.714986:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800911f9500 x1830963622710144/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.714996:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911f9500 with x1830963622710144 ext(3145728->4194303) 00002000:00010000:3.0:1746143784.715001:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800911f9500 00000100:00100000:3.0:1746143784.715034:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622710400 00000100:00100000:3.0:1746143784.715037:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622710400 00010000:00010000:3.0:1746143784.715058:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b977 expref: 277 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143784.715087:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622710272 00000100:00100000:3.0:1746143784.715089:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622710272 00010000:00010000:3.0:1746143784.715100:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a8 expref: 19 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143784.715116:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5823 00000100:00100000:3.0:1746143784.715123:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+277:2008:x1830963622710400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143784.715231:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5824 00000100:00100000:0.0:1746143784.715240:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2008:x1830963622710272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143784.715249:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143784.715256:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a8 expref: 19 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.715385:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.715392:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b977 expref: 277 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.715396:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626822272:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143784.715401:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b977 expref: 277 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.715407:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626822400:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143784.715465:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3625 00000100:00100000:1.0:1746143784.715473:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622710144:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143784.715741:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.715744:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa1f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b977 expref: 277 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143784.715764:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143784.715769:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.715776:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.715782:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.715823:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+276:2008:x1830963622710400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 700us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.715830:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5823 00010000:00010000:0.0:1746143784.716230:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a8 expref: 19 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.717042:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73aa240 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9a8 expref: 19 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.717068:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143784.717073:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143784.717080:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143784.717086:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143784.717109:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143784.717139:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622710272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1901us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143784.717147:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5824 00010000:00010000:2.0:1746143784.717455:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.717462:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143784.717484:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143784.717614:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73aa286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e7 expref: 277 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.717636:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e7 expref: 276 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.717643:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143784.717646:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143784.717648:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087800, rc 0) 00000100:00100000:2.0:1746143784.717679:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:32385:x1830963622709888:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8243us (8336us total) trans 8589943744 rc 0/0 00000100:00100000:2.0:1746143784.717685:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12974 00000100:00100000:0.0:1746143784.725402:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622710144:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9919us (10600us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143784.725415:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3625 00002000:00100000:0.0:1746143784.725429:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff8800911f9500 x1830963622710144/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143784.725439:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911f9500 with x1830963622710144 ext(3145728->4194303) 00002000:00010000:0.0:1746143784.725445:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800911f9500 00000100:00100000:3.0:1746143784.725459:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622709632:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15928us (16188us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143784.725467:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3624 00002000:00100000:3.0:1746143784.725473:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff8800911fad80 x1830963622709632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.725480:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800911fad80 with x1830963622709632 ext(2097152->4194303) 00002000:00010000:3.0:1746143784.725484:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800911fad80 00000100:00100000:0.0:1746143784.733764:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.733838:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622710656 00000100:00100000:3.0:1746143784.733850:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622710656 00002000:00100000:3.0:1746143784.733909:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095e33480 x1830963622710656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.733960:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33480 with x1830963622710656 ext(4194304->4968447) 00002000:00010000:3.0:1746143784.733965:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e33480 00000100:00100000:3.0:1746143784.733991:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3626 00000100:00100000:3.0:1746143784.733998:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622710656:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143784.739064:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.742646:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622710912 00000100:00100000:2.0:1746143784.742660:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622710912 00002000:00100000:2.0:1746143784.742722:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095e30000 x1830963622710912/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.742733:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30000 with x1830963622710912 ext(4194304->4968447) 00002000:00010000:2.0:1746143784.742739:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e30000 00000100:00100000:2.0:1746143784.742776:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3627 00000100:00100000:2.0:1746143784.742784:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2010:x1830963622710912:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143784.745230:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622710656:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11222us (11468us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143784.745242:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3626 00002000:00100000:2.0:1746143784.745253:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095e33480 x1830963622710656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.745263:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33480 with x1830963622710656 ext(4194304->4968447) 00002000:00010000:2.0:1746143784.745269:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e33480 00000100:00100000:0.0:1746143784.747666:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.747792:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622711040 00000100:00100000:2.0:1746143784.747802:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622711040 00000100:00100000:2.0:1746143784.747869:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12975 00000100:00100000:2.0:1746143784.747878:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32386:x1830963622711040:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143784.747904:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.749059:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73aa29b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9ee expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.749129:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.749140:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.749150:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.749162:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73aa2a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.749166:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73aa2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.749171:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73aa2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.749241:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.749255:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e7 expref: 275 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.749260:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.749291:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e7 expref: 275 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.749302:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e7 expref: 275 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.749313:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626822528:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.749396:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1b96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.750034:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2010:x1830963622710912:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7245us (10974us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746143784.750044:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3627 00002000:00100000:2.0:1746143784.750055:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095e30000 x1830963622710912/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.750063:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30000 with x1830963622710912 ext(4194304->4968447) 00002000:00010000:2.0:1746143784.750068:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e30000 00000100:00100000:0.0:1746143784.750793:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.750850:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622711296 00000100:00100000:0.0:1746143784.750866:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.750878:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622711296 00000100:00100000:0.0:1746143784.750898:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.750937:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1103 00000100:00100000:1.0:1746143784.750942:0:8215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622711168 00000100:00100000:3.0:1746143784.750945:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+276:2008:x1830963622711296:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143784.750952:0:8215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622711168 00000100:00100000:0.0:1746143784.750959:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.750967:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622711808 00000100:00100000:0.0:1746143784.750969:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622711808 00000100:00100000:0.0:1746143784.750986:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1104 00000100:00100000:3.0:1746143784.750990:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+276:2008:x1830963622711296:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 47us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143784.750991:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622711808:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1746143784.750996:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1103 00000100:00100000:1.0:1746143784.751001:0:8215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 192 00000100:00100000:1.0:1746143784.751010:0:8215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d56e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2009:x1830963622711168:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143784.751012:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622711808:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 21us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143784.751018:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1104 00000100:00100000:3.0:1746143784.751021:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.751027:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622711424 00000100:00100000:0.0:1746143784.751029:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622711424 00000100:00100000:0.0:1746143784.751055:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1105 00000100:00100000:0.0:1746143784.751059:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+20:2009:x1830963622711424:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143784.751085:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+20:2009:x1830963622711424:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.751286:0:8215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d56e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2009:x1830963622711168:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 230us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.751292:0:8215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 192 00000100:00100000:0.0:1746143784.751364:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1105 00000100:00100000:3.0:1746143784.751376:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143784.751378:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746143784.751406:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.751413:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622711552 00000100:00100000:2.0:1746143784.751417:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622711552 00000100:00100000:3.0:1746143784.751425:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.751433:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622711936 00000100:00100000:3.0:1746143784.751435:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622711936 00000100:00100000:2.0:1746143784.751436:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622711680 00000100:00100000:2.0:1746143784.751438:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622711680 00000100:00100000:3.0:1746143784.751449:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622712192 00000100:00100000:3.0:1746143784.751452:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622712192 00000100:00100000:2.0:1746143784.751452:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 671 00000100:00100000:2.0:1746143784.751456:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622711552:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1746143784.751465:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1106 00000100:00100000:1.0:1746143784.751468:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 672 00000100:00100000:3.0:1746143784.751469:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2009:x1830963622711936:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143784.751475:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622711680:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143784.751480:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622711552:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 24us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.751484:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2009:x1830963622711936:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 16us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.751486:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 671 00000100:00100000:3.0:1746143784.751492:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1106 00000100:00100000:3.0:1746143784.751500:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1107 00000100:00100000:1.0:1746143784.751501:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622711680:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 28us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.751504:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2009:x1830963622712192:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143784.751507:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 672 00000100:00100000:3.0:1746143784.751523:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2009:x1830963622712192:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 18us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.751528:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1107 00000100:00080000:0.0:1746143784.751531:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746143784.751552:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.751596:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.751835:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622712448 00000100:00100000:2.0:1746143784.751838:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622712448 00000100:00100000:2.0:1746143784.751869:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622712064 00000100:00100000:2.0:1746143784.751872:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622712064 00000100:00100000:2.0:1746143784.751888:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 673 00000100:00100000:2.0:1746143784.751893:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622712448:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143784.751980:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622712448:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 85us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.751985:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 673 00000100:00100000:1.0:1746143784.751997:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 674 00000100:00100000:1.0:1746143784.752003:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622712064:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143784.752025:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622712064:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143784.752113:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.752134:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622712320 00000100:00100000:3.0:1746143784.752137:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622712320 00000100:00100000:1.0:1746143784.752190:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 674 00000100:00100000:3.0:1746143784.752240:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 675 00000100:00100000:3.0:1746143784.752246:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622712320:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1746143784.752269:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622712320:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 24us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.752274:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 675 00000100:00100000:0.0:1746143784.752700:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.752717:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622712576 00000100:00100000:2.0:1746143784.752719:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626822528:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143784.752720:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622712576 00010000:00010000:0.0:1746143784.752738:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e7 expref: 276 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.752741:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143784.752768:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5825 00000100:00100000:0.0:1746143784.752773:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+276:2008:x1830963622712576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143784.752783:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143784.752788:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e7 expref: 276 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.752798:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e7 expref: 276 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.753195:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73aa28d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e7 expref: 276 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143784.754038:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143784.754044:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143784.754054:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143784.754061:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143784.754093:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143784.754119:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754126:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143784.754181:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:2.0:1746143784.754186:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143784.754203:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754213:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754229:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754235:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754240:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754246:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754252:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b7a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143784.754256:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754262:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754271:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143784.754273:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143784.754276:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754280:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73aa2a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754293:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73aa2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754297:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73aa2a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754301:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73aa2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754306:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b6000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143784.754308:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73aa2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754312:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73aa2a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754316:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092b11400) 00010000:00010000:2.0:1746143784.754318:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143784.754319:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73aa2a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754323:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73aa2a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.754353:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73aa29b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9ee expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.754362:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9ee expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.754367:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143784.754369:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143784.754371:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de82600, rc 0) 00000100:00100000:0.0:1746143784.754410:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+275:2008:x1830963622712576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1635us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143784.754419:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5825 00000100:00100000:2.0:1746143784.754436:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32386:x1830963622711040:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 6560us (6783us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.754442:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12975 00000100:00100000:0.0:1746143784.760875:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.760953:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.760983:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622712704 00000100:00100000:1.0:1746143784.760993:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622712704 00000100:00100000:1.0:1746143784.761050:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622712832 00000100:00100000:1.0:1746143784.761052:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622712832 00000100:00100000:1.0:1746143784.761073:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12324 00000100:00100000:1.0:1746143784.761081:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622712704:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143784.761085:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12325 00000100:00100000:2.0:1746143784.761093:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2010:x1830963622712832:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143784.761103:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.761103:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.761122:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73aa2be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9fc expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.761122:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73aa2b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840b9f5 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143784.761125:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143784.761145:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.761145:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.761147:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.761147:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.761156:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73aa2be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9fc expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.761156:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73aa2b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9f5 expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.761172:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73aa2b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9f5 expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.761173:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73aa2be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9fc expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.761183:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b25a00, rc 0) 00010000:00010000:1.0:1746143784.761183:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ec00, rc 0) 00000100:00100000:3.0:1746143784.761218:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622712960 00000100:00100000:3.0:1746143784.761223:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622712960 00000100:00100000:1.0:1746143784.761227:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622712704:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 147us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.761234:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12324 00000100:00100000:1.0:1746143784.761250:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12326 00000100:00100000:1.0:1746143784.761255:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622712960:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143784.761261:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.761268:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73aa2c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba03 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.761277:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.761279:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.761283:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73aa2c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba03 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.761295:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73aa2c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba03 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.761302:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7f200, rc 0) 00000100:00100000:2.0:1746143784.761376:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622712832:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 283us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.761382:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12325 00000100:00100000:1.0:1746143784.762953:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622712960:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 1685us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.762961:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12326 00000100:00100000:0.0:1746143784.765217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.766013:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622713216 00000100:00100000:2.0:1746143784.766023:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622713216 00000100:00100000:2.0:1746143784.766092:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12976 00000100:00100000:2.0:1746143784.766106:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32386:x1830963622713216:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143784.766133:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.766155:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011de83000/0x87925e4cb73aa2cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba0a expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.766264:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa2d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.766279:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9ee expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.766287:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa2d3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.766318:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9ee expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.766328:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9ee expref: 10 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.766340:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626822656:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.766607:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1b96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.767647:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963626822656:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.767666:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa2d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143784.767982:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.768131:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622713344 00000100:00100000:2.0:1746143784.768137:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622713344 00010000:00010000:2.0:1746143784.768165:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9ee expref: 11 pid: 7244 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143784.768198:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5826 00000100:00100000:2.0:1746143784.768204:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622713344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.768217:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.768222:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9ee expref: 11 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.768232:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9ee expref: 11 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.768252:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73aa2b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9ee expref: 11 pid: 7244 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143784.768267:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143784.768272:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa2d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.768279:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa2d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.768285:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa2d3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143784.768308:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143784.768325:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa2d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.768331:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa2d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143784.768348:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000100:00100000:2.0:1746143784.768350:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622713344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 146us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.768356:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5826 00010000:00010000:3.0:1746143784.768470:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de83000/0x87925e4cb73aa2cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba0a expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.768489:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa2d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba0a expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.768495:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143784.768498:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143784.768500:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de82400, rc 0) 00000100:00100000:3.0:1746143784.768524:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32386:x1830963622713216:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 2424us (3315us total) trans 8589943745 rc 0/0 00000100:00100000:3.0:1746143784.768530:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12976 00000100:00100000:0.0:1746143784.771339:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.771544:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622713600 00000100:00100000:3.0:1746143784.771554:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622713600 00000100:00100000:3.0:1746143784.771604:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12977 00000100:00100000:3.0:1746143784.771611:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32386:x1830963622713600:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143784.771637:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.771640:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143784.773748:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa2d3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba0a expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.773772:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143784.773778:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143784.773796:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba11 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.773924:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2e8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.773938:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.773946:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.773957:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.773962:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2e8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.773968:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2e8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.773973:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143784.773976:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2e8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.773982:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2e8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.773989:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143784.773991:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143784.773993:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2e8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.773997:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2e8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.774018:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2e1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba11 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.774024:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba11 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.774035:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32a00, rc 0) 00000100:00100000:3.0:1746143784.774113:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32386:x1830963622713600:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 2501us (2783us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143784.774121:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12977 00000100:00100000:0.0:1746143784.780493:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.780751:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622713856 00000100:00100000:3.0:1746143784.780761:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622713856 00000100:00100000:3.0:1746143784.780809:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12978 00000100:00100000:3.0:1746143784.780818:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32388:x1830963622713856:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143784.780841:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.780869:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73aa2ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba18 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.780980:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.780993:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781007:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781021:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781026:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781031:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781133:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781141:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781146:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143784.781154:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143784.781231:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781236:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781241:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781247:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781251:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143784.781255:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781261:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781271:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143784.781274:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143784.781278:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781286:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32a00/0x87925e4cb73aa2f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781299:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781303:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781306:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781310:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143784.781313:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781317:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781322:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22700) 00010000:00010000:3.0:1746143784.781324:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143784.781326:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781330:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73aa2fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143784.781361:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73aa2ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba18 expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.781372:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba18 expref: 20 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.781383:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143784.781385:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143784.781387:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32600, rc 0) 00000100:00100000:3.0:1746143784.781439:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:32388:x1830963622713856:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 622us (957us total) trans 8589943746 rc 0/0 00000100:00100000:3.0:1746143784.781445:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12978 00000100:00100000:0.0:1746143784.781713:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.781871:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622714112 00000100:00100000:2.0:1746143784.781876:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622714112 00000100:00100000:2.0:1746143784.781937:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4778 00000100:00100000:2.0:1746143784.781945:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32386:x1830963622714112:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143784.782037:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32386:x1830963622714112:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 92us (323us total) trans 8589943747 rc 0/0 00000100:00100000:2.0:1746143784.782043:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4778 00000100:00100000:0.0:1746143784.798321:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.798394:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622714240 00000100:00100000:1.0:1746143784.798405:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622714240 00000100:00100000:1.0:1746143784.798472:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12327 00000100:00100000:1.0:1746143784.798481:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:32385:x1830963622714240:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143784.798507:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.798529:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba1f expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.798567:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.798576:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1200/0x87925e4cb73aa1ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b954 expref: 35 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.798583:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73aa160 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b92a expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.798589:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.798592:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.798596:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1871872->2097151] (req 1871872->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 35 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.798630:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73aa160 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b92a expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.798642:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73aa160 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b92a expref: 9 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143784.798656:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626822784:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143784.798772:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c1200/0x87925e4cb73aa1ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b954 expref: 35 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.798780:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1200/0x87925e4cb73aa1ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b954 expref: 35 pid: 1945 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143784.798788:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626822912:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143784.798813:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 11 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.798821:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 11 pid: 9839 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143784.798827:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626823040:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143784.798841:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acddca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143784.803897:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626822784:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143784.803909:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626822912:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143784.803951:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626823040:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143784.804126:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [1871872->2097151] (req 1871872->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 35 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.804144:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7fe00, rc 0) 00000100:00100000:1.0:1746143784.804556:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:32385:x1830963622714240:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6075us (6244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.804564:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12327 00000100:00100000:0.0:1746143784.807139:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.807217:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622714624 00000100:00100000:2.0:1746143784.807226:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622714624 00010000:00010000:2.0:1746143784.807266:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1200/0x87925e4cb73aa1ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b954 expref: 35 pid: 1945 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143784.807313:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5827 00000100:00100000:2.0:1746143784.807322:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963622714624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.807338:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.807360:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1200/0x87925e4cb73aa1ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b954 expref: 35 pid: 1945 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143784.807371:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c1200/0x87925e4cb73aa1ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b954 expref: 35 pid: 1945 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143784.807396:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1200/0x87925e4cb73aa1ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b954 expref: 35 pid: 1945 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143784.807423:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.807464:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622714624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 143us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.807470:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5827 00000100:00100000:0.0:1746143784.808670:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.808727:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622714368 00000100:00100000:2.0:1746143784.808733:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622714368 00010000:00010000:2.0:1746143784.808759:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73aa160 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b92a expref: 10 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143784.809416:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.810076:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622714496 00000100:00100000:2.0:1746143784.810083:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622714496 00010000:00010000:2.0:1746143784.810108:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 12 pid: 9839 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143784.810171:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5828 00000100:00100000:2.0:1746143784.810190:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b41fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622714368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143784.810209:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5829 00010000:00010000:2.0:1746143784.810211:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143784.810218:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622714496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143784.810230:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.810235:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73aa160 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b92a expref: 10 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143784.810240:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 12 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.810246:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73aa160 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b92a expref: 10 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143784.810268:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 12 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.810300:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73aa160 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b92a expref: 10 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143784.810303:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73aa12f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b90e expref: 12 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.810317:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.810319:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.810328:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.810337:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143784.810346:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143784.810379:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.810394:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626823168:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143784.810397:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622714496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 180us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143784.810404:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5829 00000100:00100000:2.0:1746143784.810486:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.814064:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626823168:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.814093:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.814179:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b41fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622714368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3988us (5507us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.814192:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5828 00000100:00100000:1.0:1746143784.814777:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.814836:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622714880 00000100:00100000:3.0:1746143784.814843:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622714880 00002000:00100000:3.0:1746143784.814895:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1871872->1875967) req@ffff880093724000 x1830963622714880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.814905:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724000 with x1830963622714880 ext(1871872->1875967) 00002000:00010000:3.0:1746143784.814909:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093724000 00000100:00100000:3.0:1746143784.814955:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3628 00000100:00100000:3.0:1746143784.814962:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622714880:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143784.815811:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622714880:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 849us (1035us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143784.815817:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3628 00002000:00100000:3.0:1746143784.815822:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1871872->1875967) req@ffff880093724000 x1830963622714880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.815829:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093724000 with x1830963622714880 ext(1871872->1875967) 00002000:00010000:3.0:1746143784.815832:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093724000 00000100:00100000:0.0:1746143784.819877:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.819947:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622715008 00000100:00100000:1.0:1746143784.819956:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622715008 00000100:00100000:1.0:1746143784.820007:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12328 00000100:00100000:1.0:1746143784.820015:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:32385:x1830963622715008:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143784.820033:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.820050:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba26 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.820079:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.820087:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73aa2b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9f5 expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.820098:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73aa26a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9cb expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.820104:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.820105:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.820108:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->1507327] (req 1048576->1507327) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 35 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.820136:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73aa26a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9cb expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.820147:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73aa26a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9cb expref: 35 pid: 9587 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143784.820158:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626823296:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143784.820257:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73aa2b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9f5 expref: 8 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.820266:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73aa2b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9f5 expref: 8 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143784.820274:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626823424:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143784.820299:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.820310:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 10 pid: 1945 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143784.820317:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626823552:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143784.820329:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acddca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143784.824799:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.825305:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.825370:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626823296:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.825379:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094194700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626823424:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.825385:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626823552:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.825417:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [1048576->1507327] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 35 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.825434:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52a00, rc 0) 00000100:00100000:3.0:1746143784.826164:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622715264 00000100:00100000:3.0:1746143784.826172:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622715264 00010000:00010000:3.0:1746143784.826200:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73aa26a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9cb expref: 36 pid: 9587 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143784.826228:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622715136 00000100:00100000:3.0:1746143784.826230:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622715136 00010000:00010000:3.0:1746143784.826239:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73aa2b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9f5 expref: 9 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143784.826766:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:32385:x1830963622715008:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6749us (6899us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.826775:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12328 00000100:00100000:1.0:1746143784.826925:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.827225:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622715392 00000100:00100000:3.0:1746143784.827229:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622715392 00000100:00100000:3.0:1746143784.827243:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5830 00000100:00100000:3.0:1746143784.827249:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622715264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143784.827263:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.827283:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73aa26a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9cb expref: 35 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143784.827293:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73aa26a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9cb expref: 35 pid: 9587 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143784.827463:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5831 00000100:00100000:2.0:1746143784.827471:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622715136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.827478:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.827566:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e33800/0x87925e4cb73aa26a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9cb expref: 35 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143784.827601:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73aa2b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9f5 expref: 9 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143784.827609:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73aa2b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9f5 expref: 9 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143784.827620:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73aa2b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9f5 expref: 9 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143784.827633:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.827660:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622715136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 192us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.827665:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5831 00010000:00010000:3.0:1746143784.827773:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.827788:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622715264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 540us (3000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.827793:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5830 00010000:00010000:3.0:1746143784.827813:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 11 pid: 1945 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143784.827830:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5832 00000100:00100000:3.0:1746143784.827834:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622715392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143784.827839:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.827845:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 11 pid: 1945 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143784.827863:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 11 pid: 1945 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143784.827875:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73aa263 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9c4 expref: 11 pid: 1945 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143784.827884:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.827887:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.827892:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.827899:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.828126:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143784.828137:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626823680:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143784.828325:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143784.832346:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626823680:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143784.832372:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.834121:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622715392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6274us (7197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.834134:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5832 00000100:00100000:0.0:1746143784.834892:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.835036:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622715648 00000100:00100000:3.0:1746143784.835045:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622715648 00002000:00100000:3.0:1746143784.835086:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1503232->1507327) req@ffff8800939a4700 x1830963622715648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.835096:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a4700 with x1830963622715648 ext(1503232->1507327) 00002000:00010000:3.0:1746143784.835101:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a4700 00000100:00100000:3.0:1746143784.835128:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3629 00000100:00100000:3.0:1746143784.835134:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622715648:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143784.835268:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963622715648:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 134us (379us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143784.835274:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3629 00002000:00100000:3.0:1746143784.835278:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1503232->1507327) req@ffff8800939a4700 x1830963622715648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.835285:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a4700 with x1830963622715648 ext(1503232->1507327) 00002000:00010000:3.0:1746143784.835288:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a4700 00000100:00100000:0.0:1746143784.840314:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.840586:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622715904 00000100:00100000:3.0:1746143784.840597:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622715904 00000100:00100000:3.0:1746143784.841234:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4779 00000100:00100000:3.0:1746143784.841309:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:32385:x1830963622715904:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143784.841565:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:32385:x1830963622715904:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 261us (1263us total) trans 8589943748 rc 0/0 00000100:00100000:3.0:1746143784.841573:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4779 00010000:00010000:3.0:1746143784.841595:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143784.894716:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.894880:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.895059:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622716032 00000100:00100000:2.0:1746143784.895070:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622716032 00000100:00100000:2.0:1746143784.895112:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622716160 00000100:00100000:2.0:1746143784.895114:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622716160 00000100:00100000:2.0:1746143784.895135:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12329 00000100:00100000:2.0:1746143784.895142:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2011:x1830963622716032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.895164:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.895184:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73aa320 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba2d expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.895243:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626823808:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143784.895344:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.895362:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12330 00000100:00100000:2.0:1746143784.895367:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622716160:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.895373:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.895380:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73aa327 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba34 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.895399:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626823936:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143784.895417:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00002000:00010000:3.0:1746143784.898544:0:9839:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime: 1746143784 -> 1746143785 00002000:00010000:3.0:1746143784.898552:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime: 1746143784 -> 1746143785 00002000:00010000:3.0:1746143784.898554:0:9839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime: 1746143784 -> 1746143785 00000100:00100000:3.0:1746143784.898578:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963626823936:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143784.898612:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73aa327 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba34 expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.898627:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73aa327 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba34 expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143784.898642:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8aa00, rc 0) 00000100:00100000:3.0:1746143784.898696:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2011:x1830963622716160:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3327us (3814us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143784.898704:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12330 00002000:00010000:2.0:1746143784.898788:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime: 1746143784 -> 1746143785 00002000:00010000:2.0:1746143784.898792:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime: 1746143784 -> 1746143785 00002000:00010000:2.0:1746143784.898794:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime: 1746143784 -> 1746143785 00000100:00100000:2.0:1746143784.898801:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626823808:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143784.898815:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73aa320 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba2d expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.898824:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73aa320 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba2d expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.898835:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de83000, rc 0) 00000100:00100000:2.0:1746143784.898880:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:2011:x1830963622716032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3711us (4149us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143784.898885:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12329 00000100:00100000:0.0:1746143784.910188:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.910632:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622716288 00000100:00100000:2.0:1746143784.910643:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622716288 00000100:00100000:2.0:1746143784.910696:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12331 00000100:00100000:2.0:1746143784.910704:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+10:32396:x1830963622716288:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.910725:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.910743:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba3b expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.910776:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.910784:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.910785:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.910788:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 11 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.910819:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.910831:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 33 pid: 9839 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143784.910843:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626824064:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.911489:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.913988:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626824064:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.914024:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 11 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.914138:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8b800, rc 0) 00000100:00100000:2.0:1746143784.914193:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32396:x1830963622716288:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3487us (4015us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.914202:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12331 00000100:00100000:0.0:1746143784.914433:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.914668:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622716416 00000100:00100000:3.0:1746143784.914676:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622716416 00002000:00100000:3.0:1746143784.914717:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1871872->2097151) req@ffff8800939a5c00 x1830963622716416/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.914728:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5c00 with x1830963622716416 ext(1871872->2097151) 00010000:00010000:3.0:1746143784.914735:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 34 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143784.914748:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 34 pid: 9839 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143784.914755:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800939a5c00 00000100:00100000:3.0:1746143784.914772:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1490 00000100:00100000:3.0:1746143784.914778:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963622716416:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143784.923475:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622716416:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8681us (9028us total) trans 17179873101 rc 0/0 00000100:00100000:3.0:1746143784.923491:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1490 00002000:00100000:3.0:1746143784.923504:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1871872->2097151) req@ffff8800939a5c00 x1830963622716416/t17179873101(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/448 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.923515:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5c00 with x1830963622716416 ext(1871872->2097151) 00010000:00010000:3.0:1746143784.923526:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 36 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143784.923543:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 36 pid: 9839 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143784.923552:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800939a5c00 00000100:00100000:0.0:1746143784.929988:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.930581:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622716544 00000100:00100000:2.0:1746143784.930591:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622716544 00000100:00100000:2.0:1746143784.930655:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12332 00000100:00100000:2.0:1746143784.930664:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32388:x1830963622716544:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143784.930685:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.930705:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba42 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.930742:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.930750:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73aa2c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba03 expref: 7 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.930757:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73aa25c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9bd expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.930762:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.930764:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.930767:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3928064->4194303] (req 3928064->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 12 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.930798:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73aa25c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9bd expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.930809:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73aa25c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9bd expref: 12 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143784.930820:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626824192:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.930936:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73aa2c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba03 expref: 7 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.930944:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73aa2c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba03 expref: 7 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143784.930958:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626824320:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.930984:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.930992:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 35 pid: 1945 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143784.931000:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626824448:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.931016:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.932724:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.932801:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622716672 00000100:00100000:3.0:1746143784.932809:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622716672 00010000:00010000:3.0:1746143784.932841:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 36 pid: 9839 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143784.932880:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5833 00000100:00100000:3.0:1746143784.932887:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963622716672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143784.932904:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.932942:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 36 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143784.932953:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 36 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143784.932972:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa312 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba1f expref: 36 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143784.932999:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.933001:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143784.933008:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 12 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.933015:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 12 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.933043:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 12 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143784.933054:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626824576:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143784.933119:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.935547:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.935609:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622716800 00000100:00100000:1.0:1746143784.935617:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622716800 00010000:00010000:1.0:1746143784.935650:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73aa25c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9bd expref: 13 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143784.935684:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5834 00000100:00100000:1.0:1746143784.935691:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622716800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143784.935704:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143784.935726:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73aa25c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9bd expref: 13 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143784.935736:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73aa25c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9bd expref: 13 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143784.935756:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143784.935803:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622716800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 112us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.935812:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5834 00010000:00010000:2.0:1746143784.937617:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124512a00/0x87925e4cb73aa25c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9bd expref: 12 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143784.937654:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626824192:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143784.938945:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.939080:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963626824576:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143784.939097:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626824320:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143784.939100:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.939147:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963622716672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6254us (6424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.939158:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5833 00000100:00100000:3.0:1746143784.939189:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622716928 00000100:00100000:3.0:1746143784.939194:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622716928 00010000:00010000:3.0:1746143784.939218:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73aa2c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba03 expref: 8 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143784.939238:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5835 00000100:00100000:3.0:1746143784.939244:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622716928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143784.939256:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143784.939276:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73aa2c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba03 expref: 8 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143784.939286:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73aa2c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba03 expref: 8 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143784.939305:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73aa2c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba03 expref: 8 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143784.939317:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.939333:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2009:x1830963622716928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.939337:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5835 00000100:00100000:2.0:1746143784.941402:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.941431:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626824448:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.941442:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143784.941466:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3928064->4194303] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 11 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143784.941485:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8b000, rc 0) 00000100:00100000:1.0:1746143784.941521:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622717312 00000100:00100000:0.0:1746143784.941522:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32388:x1830963622716544:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10859us (11547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.941528:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622717312 00000100:00100000:0.0:1746143784.941531:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12332 00010000:00010000:1.0:1746143784.941552:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 35 pid: 1945 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143784.941574:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5836 00000100:00100000:1.0:1746143784.941581:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963622717312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143784.941593:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143784.941610:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 35 pid: 1945 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143784.941620:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 35 pid: 1945 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143784.941638:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7800/0x87925e4cb73aa21d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b99a expref: 35 pid: 1945 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143784.941665:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.941668:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.941675:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 10 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.941684:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 10 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.941714:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 10 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143784.941726:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626824704:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143784.941782:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acddca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143784.941842:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622717184 00000100:00100000:3.0:1746143784.941846:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622717184 00002000:00100000:3.0:1746143784.941888:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88009719d500 x1830963622717184/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.941902:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719d500 with x1830963622717184 ext(1048576->2097151) 00002000:00010000:3.0:1746143784.941906:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719d500 00000100:00100000:3.0:1746143784.942428:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3630 00000100:00100000:3.0:1746143784.942436:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622717184:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143784.946461:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626824704:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143784.946488:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143784.946536:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963622717312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4954us (5092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.946548:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5836 00000100:00100000:2.0:1746143784.948867:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.949006:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622717568 00000100:00100000:3.0:1746143784.949017:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622717568 00002000:00100000:3.0:1746143784.949064:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3928064->3932159) req@ffff88009719e680 x1830963622717568/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.949079:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719e680 with x1830963622717568 ext(3928064->3932159) 00002000:00010000:3.0:1746143784.949085:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719e680 00000100:00100000:3.0:1746143784.949175:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3631 00000100:00100000:3.0:1746143784.949186:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622717568:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143784.949345:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622717568:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 161us (499us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143784.949351:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3631 00002000:00100000:3.0:1746143784.949357:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3928064->3932159) req@ffff88009719e680 x1830963622717568/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.949363:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719e680 with x1830963622717568 ext(3928064->3932159) 00002000:00010000:3.0:1746143784.949365:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719e680 00000100:00100000:3.0:1746143784.951286:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2010:x1830963622717184:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8843us (9886us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143784.951295:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3630 00002000:00100000:3.0:1746143784.951304:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88009719d500 x1830963622717184/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143784.951313:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719d500 with x1830963622717184 ext(1048576->2097151) 00002000:00010000:3.0:1746143784.951317:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719d500 00000100:00100000:0.0:1746143784.954155:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.954322:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622717696 00000100:00100000:2.0:1746143784.954332:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622717696 00000100:00100000:2.0:1746143784.954391:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12333 00000100:00100000:2.0:1746143784.954399:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32388:x1830963622717696:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143784.954420:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.954439:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba49 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.954472:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.954480:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73aa2be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9fc expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.954485:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.954491:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.954493:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.954496:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->4882431] (req 4194304->4882431) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.954525:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.954536:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 15 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143784.954548:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626824832:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.954640:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73aa2be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9fc expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143784.954647:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73aa2be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9fc expref: 8 pid: 9587 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143784.954659:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626824960:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.954684:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.954696:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 22 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143784.954703:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626825088:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.954729:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.960943:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626824832:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143784.960956:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626824960:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143784.962060:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.962091:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.962112:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.962189:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626825088:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.962226:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [4194304->4882431] (req 4194304->4882431) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.962244:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8a200, rc 0) 00000100:00100000:2.0:1746143784.962297:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32388:x1830963622717696:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7898us (8152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.962306:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12333 00000100:00100000:2.0:1746143784.962335:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622717952 00000100:00100000:2.0:1746143784.962341:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622717952 00000100:00100000:2.0:1746143784.962373:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12334 00000100:00100000:2.0:1746143784.962379:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:32396:x1830963622717952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143784.962395:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143784.962412:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba50 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.962434:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.962442:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.962443:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143784.962446:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 12 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.962472:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.962481:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 33 pid: 9839 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143784.962493:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626825216:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143784.963782:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622717824 00000100:00100000:1.0:1746143784.963790:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622717824 00010000:00010000:1.0:1746143784.963817:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73aa2be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9fc expref: 9 pid: 9587 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143784.963845:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622718080 00000100:00100000:1.0:1746143784.963847:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622718080 00010000:00010000:1.0:1746143784.963863:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 15 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143784.963879:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5837 00000100:00100000:1.0:1746143784.963885:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622717824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143784.963897:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143784.963939:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73aa2be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9fc expref: 9 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143784.963949:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73aa2be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9fc expref: 9 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143784.963971:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b25a00/0x87925e4cb73aa2be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9fc expref: 9 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143784.963989:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.964056:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143784.964076:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5838 00000100:00100000:2.0:1746143784.964081:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622718080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.964089:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.964097:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 15 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.964109:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 15 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.964118:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73aa27f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9e0 expref: 15 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.964128:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143784.964648:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622717824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 760us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.964654:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5837 00000100:00100000:2.0:1746143784.965707:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622718080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1623us (3590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.965714:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5838 00000100:00100000:0.0:1746143784.972348:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.972456:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143784.972516:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.972527:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622718592 00000100:00100000:3.0:1746143784.972536:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622718592 00000100:00100000:3.0:1746143784.972592:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12979 00000100:00100000:3.0:1746143784.972600:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+276:32398:x1830963622718592:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143784.972628:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143784.972660:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011de83000/0x87925e4cb73aa34a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba57 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.972745:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.972757:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00000100:00100000:1.0:1746143784.972760:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622718336 00000100:00100000:1.0:1746143784.972764:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622718336 00010000:00010000:3.0:1746143784.972768:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.972782:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73aa358 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.972787:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73aa358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.972793:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73aa358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00002000:00100000:1.0:1746143784.972797:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1507327) req@ffff880092b62d80 x1830963622718336/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.972807:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62d80 with x1830963622718336 ext(1048576->1507327) 00010000:00010000:1.0:1746143784.972815:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 34 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143784.972825:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 34 pid: 9839 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143784.972831:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b62d80 00000100:00100000:1.0:1746143784.972846:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1491 00010000:00010000:3.0:1746143784.972905:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.972943:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.972950:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143784.972959:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143784.973031:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973036:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973042:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973047:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00000100:00100000:1.0:1746143784.973049:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963622718336:12345-192.168.202.3@tcp:4:multiop.0 00010000:00010000:3.0:1746143784.973052:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011de82400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143784.973056:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973062:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00000100:00100000:2.0:1746143784.973330:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622718208 00000100:00100000:2.0:1746143784.973335:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622718208 00010000:00010000:2.0:1746143784.973355:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 23 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143784.973383:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5839 00000100:00100000:2.0:1746143784.973389:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622718208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.973398:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.973413:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 23 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.973423:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 23 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.973441:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012323be00/0x87925e4cb73aa278 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b9d9 expref: 23 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.973461:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.973463:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143784.973464:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626825216:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143784.973469:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.973477:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.973490:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 12 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.973505:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c400, rc 0) 00010000:00010000:2.0:1746143784.973511:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.973522:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626825344:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143784.973529:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:32396:x1830963622717952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11150us (11437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.973537:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12334 00000100:00100000:2.0:1746143784.973575:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00010000:00010000:3.0:1746143784.973649:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143784.973652:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143784.973655:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973661:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73aa351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973684:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73aa358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973841:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73aa358 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973846:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73aa358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973861:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad35800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143784.973864:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73aa358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973869:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73aa358 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973876:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22c00) 00010000:00010000:3.0:1746143784.973878:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143784.973880:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73aa358 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973885:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73aa358 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143784.973944:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de83000/0x87925e4cb73aa34a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba57 expref: 279 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.973952:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba57 expref: 278 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143784.973958:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143784.973960:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143784.973962:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad34000, rc 0) 00000100:00100000:3.0:1746143784.973987:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+278:32398:x1830963622718592:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1389us (1532us total) trans 8589943749 rc 0/0 00000100:00100000:3.0:1746143784.973993:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12979 00000100:00100000:0.0:1746143784.980941:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.981004:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626825344:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143784.981027:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143784.981072:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622718208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7682us (8800us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143784.981082:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5839 00000100:00100000:1.0:1746143784.981272:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622718720 00000100:00100000:1.0:1746143784.981280:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622718720 00000100:00100000:1.0:1746143784.981329:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12335 00000100:00100000:1.0:1746143784.981337:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:32398:x1830963622718720:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143784.981356:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.981374:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba5e expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.981403:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 11 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.981412:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143784.981414:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143784.981419:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2527232->2695167] (req 2527232->2695167) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 37 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.981448:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 11 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.981459:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 11 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143784.981477:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626825472:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143784.981538:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acddca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143784.986471:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963622718336:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 13606us (13942us total) trans 17179873102 rc 0/0 00000100:00100000:1.0:1746143784.986486:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1491 00002000:00100000:1.0:1746143784.986500:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->1507327) req@ffff880092b62d80 x1830963622718336/t17179873102(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:180/0 lens 488/448 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.986515:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b62d80 with x1830963622718336 ext(1048576->1507327) 00010000:00010000:1.0:1746143784.986525:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 38 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143784.986541:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 38 pid: 9839 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143784.986547:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b62d80 00000100:00100000:0.0:1746143784.986786:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.986802:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626825472:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143784.986830:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2527232->2695167] (req 2527232->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 37 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.986845:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52c00, rc 0) 00000100:00100000:1.0:1746143784.986879:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:32398:x1830963622718720:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5543us (5970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.986886:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12335 00000100:00100000:2.0:1746143784.986944:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622718976 00000100:00100000:2.0:1746143784.986951:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622718976 00002000:00100000:2.0:1746143784.986984:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4878336->4882431) req@ffff880092b61180 x1830963622718976/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.986992:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61180 with x1830963622718976 ext(4878336->4882431) 00002000:00010000:2.0:1746143784.986995:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b61180 00000100:00100000:2.0:1746143784.987010:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3632 00000100:00100000:2.0:1746143784.987018:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622718976:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143784.987147:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622718976:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 129us (361us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143784.987153:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3632 00002000:00100000:2.0:1746143784.987157:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4878336->4882431) req@ffff880092b61180 x1830963622718976/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/4536 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143784.987164:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b61180 with x1830963622718976 ext(4878336->4882431) 00002000:00010000:2.0:1746143784.987167:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b61180 00000100:00100000:0.0:1746143784.987260:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.987347:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622719104 00000100:00100000:1.0:1746143784.987350:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622719104 00002000:00100000:1.0:1746143784.987367:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3928064->4194303) req@ffff8801373b9f80 x1830963622719104/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.987374:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9f80 with x1830963622719104 ext(3928064->4194303) 00010000:00010000:1.0:1746143784.987379:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 12 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143784.987387:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 12 pid: 9587 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143784.987393:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801373b9f80 00000100:00100000:1.0:1746143784.987414:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1492 00000100:00100000:1.0:1746143784.987420:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2009:x1830963622719104:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143784.988756:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.988806:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622719360 00000100:00100000:2.0:1746143784.988811:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622719360 00000100:00100000:0.0:1746143784.988834:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143784.988835:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 37 pid: 9839 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143784.988870:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5840 00000100:00100000:2.0:1746143784.988876:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963622719360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.988889:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.988904:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 37 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.989009:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 37 pid: 9839 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.989031:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73aa319 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba26 expref: 37 pid: 9839 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143784.989233:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143784.989621:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.989624:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.989632:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.989640:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.989674:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.989687:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626825600:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143784.989750:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143784.990106:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143784.990271:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622719232 00000100:00100000:1.0:1746143784.990272:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622719488 00000100:00100000:3.0:1746143784.990277:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622719232 00000100:00100000:1.0:1746143784.990277:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622719488 00000100:00100000:0.0:1746143784.990301:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622719616 00000100:00100000:0.0:1746143784.990304:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622719616 00000100:00100000:2.0:1746143784.990359:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.990457:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622719744 00000100:00100000:1.0:1746143784.990460:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622719744 00000100:00100000:1.0:1746143784.990477:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12336 00000100:00100000:1.0:1746143784.990483:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963622719232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143784.990498:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.990511:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73aa374 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba65 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.990527:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.990528:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.990534:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73aa374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba65 expref: 40 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.990546:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73aa374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba65 expref: 40 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.990555:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53200, rc 0) 00000100:00100000:1.0:1746143784.990580:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622719232:12345-192.168.202.3@tcp:101:cat.0 Request processed in 96us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.990585:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12336 00000100:00100000:1.0:1746143784.990601:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12337 00000100:00100000:1.0:1746143784.990606:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622719488:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143784.990611:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.990618:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73aa37b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba6c expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143784.990626:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.990628:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143784.990632:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73aa37b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba6c expref: 40 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.990640:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73aa37b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba6c expref: 40 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.990646:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53e00, rc 0) 00000100:00100000:1.0:1746143784.990659:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963622719488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 53us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143784.990664:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12337 00000100:00100000:1.0:1746143784.990673:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12338 00000100:00100000:1.0:1746143784.990678:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622719616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143784.990684:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.990692:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73aa382 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba73 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143784.990720:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626825728:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143784.990748:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143784.990763:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12339 00000100:00100000:1.0:1746143784.990768:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622719744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143784.990774:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143784.990780:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa389 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba7a expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143784.990800:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626825856:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143784.990817:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143784.993292:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622719104:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5862us (6021us total) trans 17179873103 rc 0/0 00000100:00100000:1.0:1746143784.993303:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1492 00002000:00100000:1.0:1746143784.993316:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (3928064->4194303) req@ffff8801373b9f80 x1830963622719104/t17179873103(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/448 e 0 to 0 dl 1746143795 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.993325:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9f80 with x1830963622719104 ext(3928064->4194303) 00000100:00100000:3.0:1746143784.993567:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626825600:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143784.993586:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143784.993610:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622719360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4734us (4856us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143784.993619:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5840 00000100:00100000:2.0:1746143784.993750:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143784.993794:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143784.993811:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143784.993817:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801373b9f80 00000100:00100000:3.0:1746143784.993832:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622720000 00000100:00100000:3.0:1746143784.993838:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622720000 00002000:00010000:1.0:1746143784.993863:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143784 -> 1746143785 00002000:00010000:1.0:1746143784.993865:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143784 -> 1746143785 00002000:00010000:1.0:1746143784.993867:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143784 -> 1746143785 00000100:00100000:1.0:1746143784.993880:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963626825856:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143784.993881:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4780 00000100:00100000:3.0:1746143784.993887:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:32388:x1830963622720000:12345-192.168.202.3@tcp:35:multiop.0 00010000:00010000:1.0:1746143784.993902:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa389 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba7a expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.993931:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7fe00/0x87925e4cb73aa389 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba7a expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.993945:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7fe00, rc 0) 00000100:00100000:1.0:1746143784.993965:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963622719744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3197us (3607us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143784.993971:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12339 00002000:00010000:1.0:1746143784.993998:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143784 -> 1746143785 00002000:00010000:1.0:1746143784.994000:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143784 -> 1746143785 00000100:00100000:1.0:1746143784.994010:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626825728:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143784.994026:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73aa382 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba73 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.994040:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73aa382 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba73 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143784.994047:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52600, rc 0) 00000100:00100000:3.0:1746143784.994056:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32388:x1830963622720000:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 169us (307us total) trans 8589943750 rc 0/0 00000100:00100000:3.0:1746143784.994062:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4780 00000100:00100000:1.0:1746143784.994064:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622719616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3385us (3958us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143784.994069:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12338 00000100:00100000:0.0:1746143784.994863:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143784.994957:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622720256 00000100:00100000:1.0:1746143784.994961:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622720256 00002000:00100000:1.0:1746143784.994983:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8801373bbb80 x1830963622720256/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/0 e 0 to 0 dl 1746143795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143784.994992:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bbb80 with x1830963622720256 ext(1048576->2097151) 00002000:00010000:1.0:1746143784.994995:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373bbb80 00000100:00100000:1.0:1746143784.995018:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3633 00000100:00100000:1.0:1746143784.995024:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622720256:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143784.996064:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143784.996108:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622720384 00000100:00100000:2.0:1746143784.996113:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622720384 00010000:00010000:2.0:1746143784.996134:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 16 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143784.996163:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5841 00000100:00100000:2.0:1746143784.996169:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622720384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143784.996180:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143784.996192:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 16 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.996207:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 16 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.996226:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73aa335 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba42 expref: 16 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143784.996240:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.996242:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143784.996251:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 37 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.996259:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 37 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143784.996293:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 37 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143784.996305:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626825984:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143784.996363:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.002197:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626825984:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143785.002212:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622720256:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7184us (7356us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746143785.002221:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143785.002224:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3633 00002000:00100000:1.0:1746143785.002235:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff8801373bbb80 x1830963622720256/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:180/0 lens 488/440 e 0 to 0 dl 1746143795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143785.002245:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622720384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6077us (6182us total) trans 0 rc 0/0 00002000:00100000:1.0:1746143785.002245:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bbb80 with x1830963622720256 ext(1048576->2097151) 00002000:00010000:1.0:1746143785.002249:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373bbb80 00000100:00100000:2.0:1746143785.002254:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5841 00000100:00100000:0.0:1746143785.002414:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.002488:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622720640 00000100:00100000:1.0:1746143785.002496:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622720640 00002000:00100000:1.0:1746143785.002530:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2527232->2531327) req@ffff88007f64b480 x1830963622720640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.002537:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64b480 with x1830963622720640 ext(2527232->2531327) 00002000:00010000:1.0:1746143785.002540:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f64b480 00000100:00100000:1.0:1746143785.002565:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3634 00000100:00100000:1.0:1746143785.002572:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622720640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143785.002671:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622720640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 100us (258us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143785.002676:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3634 00002000:00100000:1.0:1746143785.002681:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2527232->2531327) req@ffff88007f64b480 x1830963622720640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.002687:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64b480 with x1830963622720640 ext(2527232->2531327) 00002000:00010000:1.0:1746143785.002690:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f64b480 00000100:00080000:0.0:1746143785.002819:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143785.005179:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.005227:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.005303:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622721024 00000100:00100000:2.0:1746143785.005312:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622721024 00002000:00100000:2.0:1746143785.005348:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88007f649880 x1830963622721024/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.005358:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649880 with x1830963622721024 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.005362:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f649880 00000100:00100000:2.0:1746143785.005673:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622720896 00000100:00100000:2.0:1746143785.005676:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622720896 00000100:00100000:1.0:1746143785.005682:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3635 00002000:00100000:2.0:1746143785.005688:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88007f64ad80 x1830963622720896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143785.005693:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963622721024:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143785.005809:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64ad80 with x1830963622720896 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.005813:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f64ad80 00000100:00100000:2.0:1746143785.005876:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3636 00000100:00100000:2.0:1746143785.005882:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622720896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143785.008197:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.008250:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622721408 00000100:00100000:3.0:1746143785.008258:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622721408 00002000:00100000:3.0:1746143785.008298:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2691072->2695167) req@ffff88007f648000 x1830963622721408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.008306:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648000 with x1830963622721408 ext(2691072->2695167) 00002000:00010000:3.0:1746143785.008311:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648000 00000100:00100000:3.0:1746143785.008343:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3637 00000100:00100000:3.0:1746143785.008351:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622721408:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143785.008447:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622721408:12345-192.168.202.3@tcp:3:cat.0 Request processed in 97us (260us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143785.008454:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3637 00002000:00100000:3.0:1746143785.008460:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2691072->2695167) req@ffff88007f648000 x1830963622721408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.008466:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648000 with x1830963622721408 ext(2691072->2695167) 00002000:00010000:3.0:1746143785.008469:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648000 00000100:00100000:2.0:1746143785.016847:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622720896:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10952us (11605us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143785.016872:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3636 00002000:00100000:2.0:1746143785.016886:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff88007f64ad80 x1830963622720896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.016896:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64ad80 with x1830963622720896 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.016902:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f64ad80 00000100:00100000:1.0:1746143785.017203:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963622721024:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11513us (12031us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143785.017209:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3635 00002000:00100000:1.0:1746143785.017213:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff88007f649880 x1830963622721024/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.017218:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649880 with x1830963622721024 ext(1048576->2097151) 00002000:00010000:1.0:1746143785.017221:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f649880 00000100:00100000:0.0:1746143785.018292:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.018410:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622721664 00000100:00100000:2.0:1746143785.018419:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622721664 00000100:00100000:2.0:1746143785.018477:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4781 00000100:00100000:2.0:1746143785.018485:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:32398:x1830963622721664:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143785.018693:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:32398:x1830963622721664:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 209us (405us total) trans 8589943751 rc 0/0 00000100:00100000:2.0:1746143785.018701:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4781 00000100:00080000:0.0:1746143785.018950:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143785.020061:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.020180:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622721920 00000100:00100000:1.0:1746143785.020191:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622721920 00000100:00080000:0.0:1746143785.020238:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1746143785.020240:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88012e358e00 x1830963622721920/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.020250:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358e00 with x1830963622721920 ext(2097152->3145727) 00002000:00010000:1.0:1746143785.020255:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e358e00 00000100:00100000:1.0:1746143785.020376:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3638 00000100:00100000:1.0:1746143785.020383:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622721920:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143785.029824:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.030051:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622722048 00000100:00100000:1.0:1746143785.030061:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622722048 00000100:00100000:1.0:1746143785.030132:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12340 00000100:00100000:1.0:1746143785.030141:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+22:32401:x1830963622722048:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.030162:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.030186:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba81 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.030218:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.030226:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143785.030228:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143785.030231:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.030264:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 15 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.030281:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 15 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143785.030294:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626826112:192.168.202.3@tcp:104: 00000100:00080000:0.0:1746143785.030769:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143785.031005:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143785.031105:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622721920:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10720us (11045us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143785.031162:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3638 00002000:00100000:1.0:1746143785.031175:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88012e358e00 x1830963622721920/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.031184:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358e00 with x1830963622721920 ext(2097152->3145727) 00010000:00010000:1.0:1746143785.031191:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.031202:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143785.031209:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e358e00 00000100:00100000:1.0:1746143785.032415:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626826112:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.032442:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 23 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.032459:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3600, rc 0) 00000100:00100000:1.0:1746143785.032502:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:32401:x1830963622722048:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2362us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.032510:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12340 00000100:00100000:0.0:1746143785.033413:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.033629:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622722176 00000100:00100000:1.0:1746143785.033636:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622722176 00002000:00100000:1.0:1746143785.033674:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4882431) req@ffff88012e358a80 x1830963622722176/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.033683:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358a80 with x1830963622722176 ext(4194304->4882431) 00010000:00010000:1.0:1746143785.033690:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.033701:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143785.033707:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e358a80 00000100:00100000:1.0:1746143785.033735:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1493 00000100:00100000:1.0:1746143785.033742:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622722176:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143785.038577:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.039278:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622722304 00000100:00100000:1.0:1746143785.039288:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622722304 00000100:00100000:1.0:1746143785.039343:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12341 00000100:00100000:1.0:1746143785.039352:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32396:x1830963622722304:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.039372:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.039391:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba88 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.039421:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 37 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.039430:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143785.039431:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143785.039435:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 14 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.039467:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 37 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.039478:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 37 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143785.039491:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626826240:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.039582:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00080000:0.0:1746143785.040241:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143785.043125:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963626826240:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.043159:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 14 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.043179:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3e00, rc 0) 00000100:00100000:1.0:1746143785.044174:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32396:x1830963622722304:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4818us (5603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.044185:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12341 00000100:00100000:2.0:1746143785.044261:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622722176:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10518us (10851us total) trans 21474840433 rc 0/0 00000100:00100000:2.0:1746143785.044272:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1493 00002000:00100000:2.0:1746143785.044283:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4882431) req@ffff88012e358a80 x1830963622722176/t21474840433(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/448 e 0 to 0 dl 1746143796 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.044291:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358a80 with x1830963622722176 ext(4194304->4882431) 00010000:00010000:2.0:1746143785.044301:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 16 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.044314:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 16 pid: 9587 timeout: 944 lvb_type: 0 00002000:00010000:2.0:1746143785.044320:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e358a80 00000100:00100000:0.0:1746143785.044622:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.044670:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622722432 00000100:00100000:2.0:1746143785.044677:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622722432 00002000:00100000:2.0:1746143785.044712:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2527232->2695167) req@ffff88012e35aa00 x1830963622722432/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.044720:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35aa00 with x1830963622722432 ext(2527232->2695167) 00010000:00010000:2.0:1746143785.044725:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 38 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.044734:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 38 pid: 9587 timeout: 944 lvb_type: 0 00002000:00010000:2.0:1746143785.044745:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e35aa00 00000100:00100000:2.0:1746143785.044771:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1494 00000100:00100000:2.0:1746143785.044779:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622722432:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143785.047087:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.047312:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963622722432:12345-192.168.202.3@tcp:4:cat.0 Request processed in 2531us (2689us total) trans 17179873104 rc 0/0 00000100:00100000:3.0:1746143785.047323:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1494 00002000:00100000:3.0:1746143785.047336:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x397:0x0] (2527232->2695167) req@ffff88012e35aa00 x1830963622722432/t17179873104(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/448 e 0 to 0 dl 1746143796 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.047345:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35aa00 with x1830963622722432 ext(2527232->2695167) 00010000:00010000:3.0:1746143785.047355:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 40 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.047366:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 40 pid: 9587 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143785.047372:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e35aa00 00000100:00100000:2.0:1746143785.047789:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622722560 00000100:00100000:2.0:1746143785.047796:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622722560 00010000:00010000:2.0:1746143785.047824:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 16 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.047867:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5842 00000100:00100000:2.0:1746143785.047875:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622722560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.047889:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.047905:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 16 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.047941:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 16 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.047966:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a200/0x87925e4cb73aa33c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4882431) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba49 expref: 16 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.047998:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.048000:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.048009:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.048021:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.048316:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.048331:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626826368:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143785.048419:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ffaf180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.048824:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.048943:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622722688 00000100:00100000:2.0:1746143785.048947:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622722688 00010000:00010000:2.0:1746143785.048964:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 40 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.048995:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5843 00000100:00100000:2.0:1746143785.049002:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622722688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.049012:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.049024:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 40 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.049034:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 40 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.049047:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a52c00/0x87925e4cb73aa36d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->2695167) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba5e expref: 40 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.049063:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.049065:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.049069:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.049076:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.049099:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.049106:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626826496:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143785.049155:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.050355:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626826368:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143785.050374:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.050403:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4da1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622722560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2529us (3323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.050411:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5842 00000100:00100000:2.0:1746143785.053859:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626826496:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143785.053886:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.053996:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622722688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4991us (5170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.054007:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5843 00000100:00100000:2.0:1746143785.055132:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.055182:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.055242:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622722944 00000100:00100000:0.0:1746143785.055251:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622722944 00000100:00100000:3.0:1746143785.055265:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622723200 00000100:00100000:3.0:1746143785.055269:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622723200 00002000:00100000:3.0:1746143785.055295:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88009719d880 x1830963622723200/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143785.055295:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff88009719fb80 x1830963622722944/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143785.055305:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719fb80 with x1830963622722944 ext(2097152->3145727) 00002000:00100000:3.0:1746143785.055309:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719d880 with x1830963622723200 ext(2097152->3145727) 00002000:00010000:0.0:1746143785.055310:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719fb80 00002000:00010000:3.0:1746143785.055312:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719d880 00000100:00100000:3.0:1746143785.055520:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3639 00000100:00100000:3.0:1746143785.055531:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622723200:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143785.055813:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3640 00000100:00100000:0.0:1746143785.055820:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622722944:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.066668:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622722944:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10834us (11526us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143785.066682:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3640 00002000:00100000:2.0:1746143785.066696:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff88009719fb80 x1830963622722944/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.066707:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719fb80 with x1830963622722944 ext(2097152->3145727) 00002000:00010000:2.0:1746143785.066713:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719fb80 00000100:00100000:3.0:1746143785.069392:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622723200:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13852us (14196us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143785.069529:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3639 00002000:00100000:3.0:1746143785.069542:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff88009719d880 x1830963622723200/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.069553:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719d880 with x1830963622723200 ext(2097152->3145727) 00002000:00010000:3.0:1746143785.069558:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719d880 00000100:00100000:0.0:1746143785.072040:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.072134:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622723328 00000100:00100000:1.0:1746143785.072144:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622723328 00000100:00100000:1.0:1746143785.072212:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12342 00000100:00100000:1.0:1746143785.072221:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32396:x1830963622723328:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.072243:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.072262:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73aa39e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba8f expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.072289:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.072291:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.072298:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73aa39e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba8f expref: 16 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.072313:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73aa39e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba8f expref: 16 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.072325:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2800, rc 0) 00000100:00100000:1.0:1746143785.072376:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32396:x1830963622723328:12345-192.168.202.3@tcp:101:cat.0 Request processed in 156us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.072382:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12342 00000100:00100000:0.0:1746143785.076690:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.077383:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.077421:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.077539:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622723456 00000100:00100000:2.0:1746143785.077549:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622723456 00000100:00100000:2.0:1746143785.077602:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12343 00000100:00100000:2.0:1746143785.077611:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:32401:x1830963622723456:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143785.077631:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.077847:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73aa3a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba96 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.077883:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.077885:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.077892:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73aa3a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba96 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.077907:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73aa3a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba96 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.078072:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622723840 00000100:00100000:3.0:1746143785.078077:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622723840 00000100:00100000:0.0:1746143785.078093:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622723968 00000100:00100000:0.0:1746143785.078097:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622723968 00002000:00100000:3.0:1746143785.078108:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff88012e359880 x1830963622723840/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.078116:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359880 with x1830963622723840 ext(3145728->4194303) 00002000:00100000:0.0:1746143785.078116:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff88012e358380 x1830963622723968/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746143785.078121:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e359880 00002000:00100000:0.0:1746143785.078128:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358380 with x1830963622723968 ext(3145728->4194303) 00002000:00010000:0.0:1746143785.078132:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e358380 00000100:00100000:3.0:1746143785.078136:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3641 00000100:00100000:3.0:1746143785.078142:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622723840:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143785.078172:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c000, rc 0) 00000100:00100000:2.0:1746143785.078219:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:32401:x1830963622723456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 609us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.078224:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12343 00000100:00100000:1.0:1746143785.078417:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3642 00000100:00100000:1.0:1746143785.078424:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622723968:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143785.089047:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.089092:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.089143:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622724224 00000100:00100000:2.0:1746143785.089156:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622724224 00002000:00100000:2.0:1746143785.089200:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880094197b80 x1830963622724224/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.089209:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197b80 with x1830963622724224 ext(2097152->4194303) 00002000:00010000:2.0:1746143785.089214:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094197b80 00000100:00100000:2.0:1746143785.089238:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622724480 00000100:00100000:2.0:1746143785.089240:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622724480 00002000:00100000:2.0:1746143785.089253:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880094196a00 x1830963622724480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.089260:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196a00 with x1830963622724480 ext(3145728->4194303) 00002000:00010000:2.0:1746143785.089263:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196a00 00000100:00100000:2.0:1746143785.089275:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3643 00000100:00100000:2.0:1746143785.089281:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622724224:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143785.089347:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622723840:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11203us (11963us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143785.089358:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3641 00002000:00100000:3.0:1746143785.089369:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff88012e359880 x1830963622723840/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143785.089369:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3644 00002000:00100000:3.0:1746143785.089377:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359880 with x1830963622723840 ext(3145728->4194303) 00000100:00100000:1.0:1746143785.089379:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622724480:12345-192.168.202.3@tcp:3:cat.0 00002000:00010000:3.0:1746143785.089382:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e359880 00000100:00100000:0.0:1746143785.091295:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622723968:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12862us (13864us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143785.091308:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3642 00002000:00100000:0.0:1746143785.091319:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff88012e358380 x1830963622723968/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143785.091328:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358380 with x1830963622723968 ext(3145728->4194303) 00002000:00010000:0.0:1746143785.091333:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e358380 00000100:00100000:1.0:1746143785.103069:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622724480:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13680us (13963us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143785.103083:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3644 00002000:00100000:1.0:1746143785.103097:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880094196a00 x1830963622724480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.103107:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196a00 with x1830963622724480 ext(3145728->4194303) 00002000:00010000:1.0:1746143785.103114:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196a00 00000100:00100000:0.0:1746143785.105415:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.105654:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622724736 00000100:00100000:1.0:1746143785.105664:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622724736 00002000:00100000:1.0:1746143785.105709:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095c69880 x1830963622724736/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.105719:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69880 with x1830963622724736 ext(4194304->4968447) 00002000:00010000:1.0:1746143785.105725:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c69880 00000100:00100000:1.0:1746143785.105747:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3645 00000100:00100000:1.0:1746143785.105755:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622724736:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.111453:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622724224:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22164us (22411us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143785.111463:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3643 00002000:00100000:2.0:1746143785.111473:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880094197b80 x1830963622724224/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.111480:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197b80 with x1830963622724224 ext(2097152->4194303) 00002000:00010000:2.0:1746143785.111486:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094197b80 00000100:00100000:1.0:1746143785.116155:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622724736:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10389us (10737us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143785.116167:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3645 00002000:00100000:1.0:1746143785.116178:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095c69880 x1830963622724736/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.116188:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69880 with x1830963622724736 ext(4194304->4968447) 00002000:00010000:1.0:1746143785.116194:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c69880 00000100:00100000:0.0:1746143785.125041:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.125290:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622724992 00000100:00100000:1.0:1746143785.125300:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622724992 00002000:00100000:1.0:1746143785.125344:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095c68000 x1830963622724992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.125354:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68000 with x1830963622724992 ext(4194304->4968447) 00002000:00010000:1.0:1746143785.125360:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c68000 00000100:00100000:1.0:1746143785.125690:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3646 00000100:00100000:1.0:1746143785.125698:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622724992:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143785.134827:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622724992:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9115us (9783us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143785.134839:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3646 00002000:00100000:1.0:1746143785.134862:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095c68000 x1830963622724992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.134873:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68000 with x1830963622724992 ext(4194304->4968447) 00002000:00010000:1.0:1746143785.134879:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c68000 00000100:00100000:0.0:1746143785.143044:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.143692:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622725248 00000100:00100000:3.0:1746143785.143703:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622725248 00000100:00100000:3.0:1746143785.143778:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12980 00000100:00100000:3.0:1746143785.143786:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+21:32405:x1830963622725248:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143785.143806:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.143822:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa3ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ba9d expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746143785.143882:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746143785.143945:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.143957:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba18 expref: 22 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.143965:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba57 expref: 278 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.143972:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.143997:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba57 expref: 278 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.144006:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba57 expref: 278 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.144020:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626826624:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.144123:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba18 expref: 22 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.144130:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba18 expref: 22 pid: 7244 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.144136:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626826752:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.144153:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143785.147896:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626826624:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.147935:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626826752:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.147962:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143785.148159:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.148194:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.148264:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622725376 00000100:00100000:2.0:1746143785.148271:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622725376 00010000:00010000:2.0:1746143785.148302:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba18 expref: 23 pid: 7244 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.148888:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622725504 00000100:00100000:2.0:1746143785.148892:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622725504 00010000:00010000:2.0:1746143785.148907:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba57 expref: 279 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.148964:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5844 00000100:00100000:3.0:1746143785.148972:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2009:x1830963622725376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.148987:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.148994:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba18 expref: 23 pid: 7244 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.149005:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba18 expref: 23 pid: 7244 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.149026:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73aa304 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba18 expref: 23 pid: 7244 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.149052:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.149056:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.149065:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.149070:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.149162:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5845 00000100:00100000:2.0:1746143785.149168:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:2008:x1830963622725504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.149175:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.149179:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba57 expref: 279 pid: 10936 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.149188:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba57 expref: 279 pid: 10936 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.149200:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73aa35f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba57 expref: 279 pid: 10936 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.149212:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.149215:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143785.149221:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143785.149228:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143785.149246:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.149528:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2009:x1830963622725376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 555us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.149534:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5844 00010000:00010000:3.0:1746143785.149570:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.149577:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143785.149596:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000100:00100000:2.0:1746143785.149767:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+278:2008:x1830963622725504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 599us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.149773:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5845 00010000:00010000:3.0:1746143785.150118:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa3ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba9d expref: 23 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.150131:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba9d expref: 22 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.150137:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.150139:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143785.150142:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513600, rc 0) 00000100:00100000:3.0:1746143785.150177:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:32405:x1830963622725248:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6392us (7145us total) trans 8589943752 rc 0/0 00000100:00100000:3.0:1746143785.150187:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12980 00000100:00100000:0.0:1746143785.153418:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.153463:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622725632 00000100:00100000:2.0:1746143785.153476:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622725632 00000100:00100000:2.0:1746143785.153522:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12344 00000100:00100000:2.0:1746143785.153530:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32405:x1830963622725632:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143785.153548:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.153568:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840baa4 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.153599:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.153606:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73aa39e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba8f expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.153612:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.153613:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.153617:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3026944->3141631] (req 3026944->3141631) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.153648:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73aa39e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba8f expref: 17 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.153659:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73aa39e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba8f expref: 17 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.153676:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626826880:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.154088:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.154097:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 22 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.154105:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626827008:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.154284:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.155310:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626826880:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143785.157732:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.157821:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622725760 00000100:00100000:3.0:1746143785.157829:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622725760 00010000:00010000:3.0:1746143785.157875:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73aa39e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba8f expref: 18 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.157933:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5846 00000100:00100000:3.0:1746143785.157944:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622725760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.157960:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.157981:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73aa39e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba8f expref: 18 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.157992:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73aa39e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba8f expref: 18 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.158012:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73aa39e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba8f expref: 18 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.158032:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.158175:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963626827008:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.158205:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [3026944->3141631] (req 3026944->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.158216:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5aa400, rc 0) 00000100:00100000:3.0:1746143785.158508:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622725760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 563us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.158510:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:32405:x1830963622725632:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4981us (5104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.158516:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5846 00000100:00100000:2.0:1746143785.158516:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12344 00000100:00100000:2.0:1746143785.158930:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.159044:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622725888 00000100:00100000:0.0:1746143785.159049:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622725888 00010000:00010000:0.0:1746143785.159069:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 23 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143785.159089:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5847 00000100:00100000:0.0:1746143785.159095:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622725888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143785.159103:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143785.159116:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 23 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.159126:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 23 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.159140:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3600/0x87925e4cb73aa390 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba81 expref: 23 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.159203:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.159205:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.159212:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.159221:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.159253:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.159266:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626827136:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143785.159606:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.160764:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626827136:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143785.160790:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.160829:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963622725888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1732us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.160840:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5847 00000100:00100000:0.0:1746143785.160871:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.161181:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622726144 00000100:00100000:1.0:1746143785.161188:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622726144 00002000:00100000:1.0:1746143785.161339:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3026944->3031039) req@ffff880095c68380 x1830963622726144/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.161349:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68380 with x1830963622726144 ext(3026944->3031039) 00002000:00010000:1.0:1746143785.161354:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c68380 00000100:00100000:1.0:1746143785.161381:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3647 00000100:00100000:1.0:1746143785.161388:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622726144:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143785.161520:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622726144:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 132us (648us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143785.161526:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3647 00002000:00100000:1.0:1746143785.161531:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3026944->3031039) req@ffff880095c68380 x1830963622726144/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.161538:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68380 with x1830963622726144 ext(3026944->3031039) 00002000:00010000:1.0:1746143785.161542:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c68380 00000100:00100000:0.0:1746143785.163185:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.163281:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622726400 00000100:00100000:1.0:1746143785.163288:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622726400 00002000:00100000:1.0:1746143785.163321:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3137536->3141631) req@ffff880095c6aa00 x1830963622726400/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.163329:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6aa00 with x1830963622726400 ext(3137536->3141631) 00002000:00010000:1.0:1746143785.163333:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c6aa00 00000100:00100000:1.0:1746143785.163365:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3648 00000100:00100000:1.0:1746143785.163372:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622726400:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143785.163478:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2010:x1830963622726400:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 106us (298us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143785.163485:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3648 00002000:00100000:1.0:1746143785.163490:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3b6:0x0] (3137536->3141631) req@ffff880095c6aa00 x1830963622726400/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.163497:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6aa00 with x1830963622726400 ext(3137536->3141631) 00002000:00010000:1.0:1746143785.163499:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c6aa00 00000100:00100000:0.0:1746143785.195451:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.195648:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622726528 00000100:00100000:3.0:1746143785.195658:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622726528 00000100:00100000:3.0:1746143785.195719:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12981 00000100:00100000:3.0:1746143785.195728:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32409:x1830963622726528:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143785.195757:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.195777:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73aa3c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840baab expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.195837:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.195859:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.195871:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.195883:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa3d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.195889:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.195894:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.196003:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.196013:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba9d expref: 21 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.196020:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.196050:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba9d expref: 21 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.196065:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba9d expref: 21 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.196078:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626827264:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.196165:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.203960:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.204067:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622726784 00000100:00100000:2.0:1746143785.204077:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622726784 00000100:00100000:2.0:1746143785.204139:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4782 00000100:00100000:3.0:1746143785.204146:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626827264:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.204148:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b496450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:26342:x1830963622726784:12345-192.168.202.3@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746143785.204173:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:2.0:1746143785.204622:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b496450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:26342:x1830963622726784:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 475us (673us total) trans 8589943753 rc 0/0 00000100:00100000:2.0:1746143785.204629:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4782 00000100:00100000:0.0:1746143785.209205:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.209394:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622726912 00000100:00100000:2.0:1746143785.209404:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622726912 00010000:00010000:2.0:1746143785.209450:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba9d expref: 23 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.209490:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5848 00000100:00100000:2.0:1746143785.209502:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:2008:x1830963622726912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.209521:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.209527:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba9d expref: 23 pid: 10936 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.209539:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba9d expref: 23 pid: 10936 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.209562:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73aa3b3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba9d expref: 23 pid: 10936 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.209593:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.209598:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143785.209607:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143785.209615:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143785.209635:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.209687:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:2008:x1830963622726912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 189us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.209692:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5848 00010000:00010000:3.0:1746143785.209890:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.209897:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143785.210168:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:3.0:1746143785.210173:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143785.210193:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210203:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210213:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210218:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210224:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210230:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210235:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e513e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143785.210238:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210244:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210252:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143785.210254:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143785.210257:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210260:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa3cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210446:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210452:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210457:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210461:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e512200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143785.210464:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210468:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa3d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210479:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22100) 00010000:00010000:3.0:1746143785.210481:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143785.210483:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa3d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210486:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa3d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.210520:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73aa3c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baab expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.210533:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baab expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.210538:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.210540:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143785.210543:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513200, rc 0) 00000100:00100000:3.0:1746143785.210580:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32409:x1830963622726528:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 14854us (15140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.210587:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12981 00000100:00100000:0.0:1746143785.212486:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.212520:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.212544:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.212567:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622727168 00000100:00100000:0.0:1746143785.212576:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622727168 00000100:00100000:2.0:1746143785.212584:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622727040 00000100:00100000:2.0:1746143785.212589:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622727040 00000100:00100000:0.0:1746143785.212629:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622727296 00000100:00100000:0.0:1746143785.212631:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622727296 00000100:00100000:1.0:1746143785.212641:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12345 00000100:00080000:3.0:1746143785.212698:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143785.212702:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143785.212739:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622727168:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143785.212757:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.212776:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73aa3e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bab9 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.212804:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.212806:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.212816:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73aa3e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab9 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.212832:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73aa3e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab9 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.212842:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2400, rc 0) 00000100:00100000:2.0:1746143785.212858:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12346 00000100:00100000:2.0:1746143785.212874:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622727040:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143785.212893:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143785.212895:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2009:x1830963622727168:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 246us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.212901:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12345 00010000:00010000:2.0:1746143785.212908:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73aa3eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bab2 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.212945:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12347 00000100:00100000:1.0:1746143785.212950:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622727296:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143785.212958:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.212966:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.212968:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.212969:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73aa3f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bac0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.212973:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143785.212976:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73aa3eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab2 expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143785.212984:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622727424 00000100:00100000:0.0:1746143785.212987:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622727424 00010000:00010000:2.0:1746143785.212989:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73aa3eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab2 expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.212998:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124adfc00, rc 0) 00000100:00100000:0.0:1746143785.213001:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12348 00000100:00100000:0.0:1746143785.213006:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622727424:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:1.0:1746143785.213007:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626827392:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143785.213013:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143785.213020:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73aa3f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bac7 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.213032:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.213033:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.213039:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73aa3f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac7 expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143785.213040:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622727040:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 172us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.213046:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12346 00010000:00010000:0.0:1746143785.213048:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73aa3f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac7 expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143785.213055:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00010000:00010000:0.0:1746143785.213055:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96800, rc 0) 00000100:00100000:0.0:1746143785.213070:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622727424:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 63us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.213075:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12348 00000100:00100000:1.0:1746143785.214373:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963626827392:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143785.214395:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73aa3f2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac0 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.214406:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73aa3f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac0 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.214419:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2600, rc 0) 00000100:00100000:1.0:1746143785.214595:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2009:x1830963622727296:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 1642us (2047us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143785.214602:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12347 00000100:00100000:0.0:1746143785.217791:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.217890:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622727680 00000100:00100000:3.0:1746143785.217900:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622727680 00000100:00100000:3.0:1746143785.217980:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12982 00000100:00100000:3.0:1746143785.217989:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:32409:x1830963622727680:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143785.218008:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.218028:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512e00/0x87925e4cb73aa400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bace expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.218139:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73aa407 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.218152:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baab expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.218160:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73aa407 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.218192:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baab expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.218204:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baab expref: 12 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.218216:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626827520:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.218303:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.220249:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.220319:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622727808 00000100:00100000:1.0:1746143785.220328:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622727808 00010000:00010000:1.0:1746143785.220359:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baab expref: 13 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143785.220393:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5849 00000100:00100000:1.0:1746143785.220400:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622727808:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143785.220413:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143785.220419:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baab expref: 13 pid: 10936 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.220430:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baab expref: 13 pid: 10936 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.220451:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143785.220455:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73aa407 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143785.220464:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73aa407 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143785.220470:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73aa407 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143785.220486:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143785.220518:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622727808:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 118us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.220524:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5849 00010000:00010000:3.0:1746143785.221055:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73aa3dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baab expref: 12 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.221082:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626827520:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.221097:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73aa407 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.221105:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73aa407 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.221110:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73aa407 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143785.221140:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143785.221267:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512e00/0x87925e4cb73aa400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bace expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.221280:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73aa407 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bace expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.221286:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.221289:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143785.221291:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513400, rc 0) 00000100:00100000:3.0:1746143785.222180:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32409:x1830963622727680:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 4189us (4398us total) trans 8589943754 rc 0/0 00000100:00100000:3.0:1746143785.222189:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12982 00000100:00100000:0.0:1746143785.225766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.225844:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622728064 00000100:00100000:3.0:1746143785.225863:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622728064 00000100:00100000:3.0:1746143785.225928:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12983 00000100:00100000:3.0:1746143785.225938:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32409:x1830963622728064:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143785.225967:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.225971:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143785.226001:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73aa407 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bace expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.226019:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.226023:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143785.226034:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512800/0x87925e4cb73aa415 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bad5 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.226959:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.226978:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.226989:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143785.227000:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143785.227109:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512800/0x87925e4cb73aa415 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bad5 expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.227123:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bad5 expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.227129:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.227132:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143785.227134:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513a00, rc 0) 00000100:00100000:3.0:1746143785.227197:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:32409:x1830963622728064:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 1261us (1440us total) trans 8589943755 rc 0/0 00000100:00100000:3.0:1746143785.227203:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12983 00000100:00100000:0.0:1746143785.229130:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.229264:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622728192 00000100:00100000:3.0:1746143785.229275:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622728192 00000100:00100000:3.0:1746143785.229320:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12984 00000100:00100000:3.0:1746143785.229329:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:32409:x1830963622728192:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143785.229351:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.229368:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa42a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840badc expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.229420:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa42a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840badc expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.229433:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa42a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840badc expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.229449:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.229452:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143785.229455:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512200, rc 0) 00000100:00100000:3.0:1746143785.229506:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32409:x1830963622728192:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 177us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.229512:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12984 00000100:00100000:0.0:1746143785.235175:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.235212:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.235239:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.235264:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.235278:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.235305:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622728320 00000100:00100000:0.0:1746143785.235319:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622728320 00000100:00100000:3.0:1746143785.235341:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622728448 00000100:00100000:3.0:1746143785.235349:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622728448 00000100:00100000:0.0:1746143785.235358:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622728704 00000100:00100000:0.0:1746143785.235360:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622728704 00000100:00100000:0.0:1746143785.235370:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622728960 00000100:00100000:0.0:1746143785.235372:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622728960 00000100:00100000:0.0:1746143785.235381:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622728576 00000100:00100000:0.0:1746143785.235382:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622728576 00000100:00100000:0.0:1746143785.235396:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12349 00000100:00100000:0.0:1746143785.235403:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622728320:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143785.235451:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.235469:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093716c00/0x87925e4cb73a9eab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b77f expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.235478:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9fc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b812 expref: 21 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.235485:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a9f4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b7 expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.235497:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.235499:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.235502:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.235513:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12350 00000100:00100000:3.0:1746143785.235522:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622728704:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143785.235533:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a9f4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b7 expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.235545:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a9f4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b7 expref: 15 pid: 12327 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746143785.235558:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626827648:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.235630:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.235636:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b812 expref: 21 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.235643:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a9e9d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b794 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.235645:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b812 expref: 21 pid: 3135 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.235651:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9fd1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b827 expref: 21 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143785.235652:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626827776:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.235658:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a9f61 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7d3 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.235664:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.235666:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.235668:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.235676:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093716c00/0x87925e4cb73a9eab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b77f expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.235684:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093716c00/0x87925e4cb73a9eab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b77f expref: 9 pid: 3134 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746143785.235697:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626827904:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143785.235712:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.235750:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143785.235863:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a9f61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7d3 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.235873:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a9f61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7d3 expref: 15 pid: 9586 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.235880:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622728832 00000100:00100000:3.0:1746143785.235882:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626828032:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.235884:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622728832 00000100:00100000:1.0:1746143785.235903:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12351 00000100:00100000:1.0:1746143785.235909:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622728960:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143785.235936:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9fd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b827 expref: 21 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.235945:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9fd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b827 expref: 21 pid: 3135 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.235949:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.235953:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626828160:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.235959:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.235967:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73aa3f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac7 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.235974:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73aa3a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba96 expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.235979:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.235981:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.235983:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.235984:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a9e9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b794 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.235992:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a9e9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b794 expref: 10 pid: 3134 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.236000:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73aa3a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba96 expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.236005:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626828288:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.236008:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73aa3a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba96 expref: 39 pid: 13436 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143785.236016:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626828416:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.236024:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143785.236039:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12352 00000100:00100000:3.0:1746143785.236044:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622728576:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143785.236046:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73aa3f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac7 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.236053:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73aa3f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac7 expref: 12 pid: 1947 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.236060:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.236061:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626828544:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.236069:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.236076:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73aa3e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab9 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.236080:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.236083:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73aa37b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba6c expref: 39 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.236087:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.236088:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 13 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.236089:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.236091:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.236095:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626828672:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.236104:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73aa37b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba6c expref: 39 pid: 9587 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143785.236108:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00010000:00010000:3.0:1746143785.236111:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73aa37b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba6c expref: 39 pid: 9587 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143785.236118:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626828800:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.236123:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12353 00000100:00100000:1.0:1746143785.236129:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622728448:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143785.236143:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.236153:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.236160:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73aa3eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab2 expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.236172:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73aa374 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba65 expref: 39 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.236178:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.236179:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.236181:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.236194:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73aa374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba65 expref: 39 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.236201:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73aa374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba65 expref: 39 pid: 9587 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.236209:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626828928:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.236230:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73aa3eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab2 expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.236237:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73aa3eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab2 expref: 12 pid: 13436 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.236245:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626829056:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.236279:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.236291:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 13 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143785.236299:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626829184:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.236310:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143785.236325:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12354 00000100:00100000:1.0:1746143785.236331:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622728832:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143785.236352:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.236362:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.236367:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143785.236368:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143785.236370:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.236384:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.236392:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 15 pid: 13436 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143785.236400:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626829312:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.236413:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00010000:00010000:3.0:1746143785.236665:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73aa3e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab9 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.236673:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73aa3e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab9 expref: 12 pid: 9587 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143785.236681:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626829440:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.236698:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 13 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.236705:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 13 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.236714:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626829568:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.236725:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.238146:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626827648:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.238157:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626827776:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.238164:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626827904:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.238186:0:1947:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.247454:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.247495:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.247516:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.247653:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622729216 00000100:00100000:2.0:1746143785.247663:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622729216 00010000:00010000:2.0:1746143785.247702:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b812 expref: 22 pid: 3135 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.247731:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622729344 00000100:00100000:2.0:1746143785.247732:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622729344 00010000:00010000:2.0:1746143785.247741:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093716c00/0x87925e4cb73a9eab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b77f expref: 11 pid: 3134 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.247751:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622729088 00000100:00100000:2.0:1746143785.247753:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622729088 00010000:00010000:2.0:1746143785.247760:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a9f4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b7 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.247781:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5850 00000100:00100000:2.0:1746143785.247788:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963622729216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.247805:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.247827:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9fc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b812 expref: 22 pid: 3135 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.247838:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9fc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b812 expref: 22 pid: 3135 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.247870:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73a9fc3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b812 expref: 22 pid: 3135 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.247894:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.247963:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+21:2011:x1830963622729216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 175us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.247970:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5850 00000100:00100000:2.0:1746143785.247992:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5851 00000100:00100000:2.0:1746143785.247997:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622729344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.248005:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.248012:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093716c00/0x87925e4cb73a9eab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b77f expref: 11 pid: 3134 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.248019:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093716c00/0x87925e4cb73a9eab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b77f expref: 11 pid: 3134 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.248020:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5852 00000100:00100000:1.0:1746143785.248027:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622729088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.248030:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093716c00/0x87925e4cb73a9eab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b77f expref: 11 pid: 3134 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.248034:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.248044:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143785.248046:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a9f4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b7 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.248054:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a9f4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b7 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.248057:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622729344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 61us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.248062:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5851 00010000:00010000:1.0:1746143785.248065:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73a9f4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7b7 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.248078:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.248080:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.248085:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.248094:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.248126:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143785.248143:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.248143:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622729088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 116us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.248148:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5852 00010000:00010000:2.0:1746143785.248151:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.248168:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.248175:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.248182:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.248188:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143785.248192:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.248200:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.248213:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.248218:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73aa431 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.248232:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626828032:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.248242:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626828160:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.248250:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963626828288:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.248254:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622728320:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 12853us (13091us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.248261:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12349 00010000:00010000:1.0:1746143785.248271:0:9839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.249966:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.249997:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626828416:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143785.249999:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.250008:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626828544:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143785.250012:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.250016:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626828672:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143785.250027:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622729472 00000100:00100000:0.0:1746143785.250031:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622729472 00010000:00010000:1.0:1746143785.250038:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.250058:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a9e9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b794 expref: 9 pid: 3134 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.250065:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622729856 00000100:00100000:1.0:1746143785.250068:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622729856 00000100:00100000:0.0:1746143785.250076:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622729984 00000100:00100000:0.0:1746143785.250077:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622729984 00010000:00010000:1.0:1746143785.250081:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73aa374 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba65 expref: 40 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.250085:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a9f61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7d3 expref: 15 pid: 9586 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.250096:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5853 00000100:00100000:0.0:1746143785.250099:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5854 00000100:00100000:1.0:1746143785.250101:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622729472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143785.250102:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622729856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143785.250111:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143785.250111:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143785.250124:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a9e9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b794 expref: 9 pid: 3134 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.250124:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73aa374 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba65 expref: 40 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.250132:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a9e9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b794 expref: 9 pid: 3134 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.250137:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73aa374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba65 expref: 40 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.250148:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093717800/0x87925e4cb73a9e9d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b794 expref: 9 pid: 3134 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.250151:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143785.250160:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143785.250177:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963622729856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 74us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.250178:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622729472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.250183:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5853 00000100:00100000:0.0:1746143785.250185:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5854 00000100:00100000:0.0:1746143785.250194:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5855 00000100:00100000:0.0:1746143785.250198:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622729984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.250408:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73aa374 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba65 expref: 39 pid: 9587 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.250418:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626828928:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143785.250465:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143785.250474:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a9f61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7d3 expref: 15 pid: 9586 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.250482:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a9f61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7d3 expref: 15 pid: 9586 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.250493:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73a9f61 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b7d3 expref: 15 pid: 9586 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.250507:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143785.250523:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622729984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 323us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.250795:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.252054:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5855 00000100:00100000:0.0:1746143785.253987:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622729600 00000100:00100000:0.0:1746143785.253999:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622729600 00010000:00010000:0.0:1746143785.254033:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9fd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b827 expref: 21 pid: 3135 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.254055:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.254259:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622730112 00000100:00100000:0.0:1746143785.254262:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622730112 00000100:00100000:1.0:1746143785.254263:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143785.254279:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143785.254289:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622729728 00000100:00100000:0.0:1746143785.254291:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622729728 00010000:00010000:0.0:1746143785.254299:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73aa3f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac7 expref: 13 pid: 1947 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746143785.254308:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5856 00000100:00100000:0.0:1746143785.254315:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+21:2011:x1830963622729600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143785.254330:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143785.254351:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9fd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b827 expref: 21 pid: 3135 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.254362:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143785.254363:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9fd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b827 expref: 21 pid: 3135 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.254385:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73a9fd1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b827 expref: 21 pid: 3135 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.254402:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.254404:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143785.254407:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626829312:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143785.254409:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.254416:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.254428:0:3134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.254436:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143785.254444:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.254450:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.254465:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.254472:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.254478:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+20:2011:x1830963622729600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 163us (3683us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143785.254479:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.254484:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5856 00010000:00010000:1.0:1746143785.254486:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e513e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143785.254490:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.254496:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.254505:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.254511:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e513e00/0x87925e4cb73aa438 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.254519:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622730368 00000100:00100000:0.0:1746143785.254521:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622730368 00010000:00010000:0.0:1746143785.254531:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73aa3eb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab2 expref: 14 pid: 13436 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746143785.254540:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5857 00000100:00100000:0.0:1746143785.254544:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622730112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143785.254546:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622728704:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 19025us (19306us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143785.254552:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143785.254554:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12350 00010000:00010000:0.0:1746143785.254563:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.254571:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143785.254583:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143785.254583:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73aa397 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba88 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.254592:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143785.254604:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2011:x1830963622730112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.254605:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.254610:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5857 00000100:00100000:0.0:1746143785.254618:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622730240 00000100:00100000:0.0:1746143785.254620:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622730240 00010000:00010000:0.0:1746143785.254628:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73aa3a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba96 expref: 39 pid: 13436 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143785.254636:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622730496 00000100:00100000:0.0:1746143785.254638:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622730496 00010000:00010000:0.0:1746143785.254645:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 13 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143785.254654:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5858 00000100:00100000:0.0:1746143785.254659:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622729728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143785.254661:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143785.254665:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143785.254671:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73aa3f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac7 expref: 14 pid: 1947 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.254675:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143785.254678:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73aa3f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac7 expref: 14 pid: 1947 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.254688:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73aa3f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bac7 expref: 14 pid: 1947 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.254691:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622730624 00000100:00100000:1.0:1746143785.254694:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622730624 00010000:00010000:0.0:1746143785.254696:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143785.254708:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622729728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 49us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.254715:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5858 00002000:00100000:1.0:1746143785.254721:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3026944->3141631) req@ffff88012b1d9c00 x1830963622730624/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746143785.254722:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622730880 00000100:00100000:0.0:1746143785.254724:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622730880 00002000:00100000:1.0:1746143785.254730:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9c00 with x1830963622730624 ext(3026944->3141631) 00010000:00010000:0.0:1746143785.254730:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.254736:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 14 pid: 13436 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143785.254739:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5859 00000100:00100000:0.0:1746143785.254743:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622730368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143785.254745:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 14 pid: 13436 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.254748:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143785.254751:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1d9c00 00010000:00010000:0.0:1746143785.254755:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73aa3eb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab2 expref: 12 pid: 13436 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.254761:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1495 00010000:00010000:0.0:1746143785.254761:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73aa3eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab2 expref: 12 pid: 13436 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.254765:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622730624:12345-192.168.202.3@tcp:4:multiop.0 00010000:00010000:0.0:1746143785.254770:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143785.254781:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2008:x1830963622730368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 37us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.254785:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5859 00000100:00100000:0.0:1746143785.254808:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5860 00000100:00100000:0.0:1746143785.254813:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963622730240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143785.254818:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143785.254823:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73aa3a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba96 expref: 39 pid: 13436 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.254835:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73aa3a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba96 expref: 39 pid: 13436 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.254846:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c000/0x87925e4cb73aa3a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba96 expref: 39 pid: 13436 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.254864:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.254865:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143785.254867:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143785.254868:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.254874:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.254893:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143785.254906:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963622730240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.254927:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5860 00000100:00100000:1.0:1746143785.254930:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.254935:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622731008 00000100:00100000:0.0:1746143785.254937:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622731008 00010000:00010000:1.0:1746143785.254941:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.254944:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73aa37b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba6c expref: 38 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.254949:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.254952:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622730752 00000100:00100000:0.0:1746143785.254953:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622730752 00010000:00010000:0.0:1746143785.254959:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73aa3e4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab9 expref: 12 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.254962:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.254969:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.254971:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5861 00010000:00010000:1.0:1746143785.254975:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.254975:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622730496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143785.254979:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143785.254981:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143785.254983:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.254986:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.254989:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.254993:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.254997:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.255002:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.255003:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2200/0x87925e4cb73aa43f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.255003:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.255006:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.255011:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.255019:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.255428:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5862 00000100:00100000:2.0:1746143785.255437:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622730880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.255444:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.255454:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.255461:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 14 pid: 9587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.255472:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.255575:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5863 00000100:00100000:3.0:1746143785.255583:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622731008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.255595:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.255603:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73aa37b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba6c expref: 38 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.255611:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73aa37b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba6c expref: 38 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.255623:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.256217:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622730880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 781us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.256223:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5862 00000100:00100000:3.0:1746143785.256225:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963622731008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 644us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.256230:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5863 00000100:00100000:2.0:1746143785.256236:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5864 00000100:00100000:2.0:1746143785.256241:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622730752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.256248:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.256255:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73aa3e4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab9 expref: 12 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.256262:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73aa3e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab9 expref: 12 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.256266:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73aa37b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba6c expref: 37 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.256271:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.256272:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.256275:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.256280:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626828800:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.256281:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.256291:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73aa3e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab9 expref: 12 pid: 9587 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.256292:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.256297:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626829440:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.256305:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622730752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 64us (1375us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143785.256307:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c400/0x87925e4cb73aa343 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba50 expref: 13 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.256310:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5864 00000100:00100000:3.0:1746143785.256314:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963626829568:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.256332:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124adfc00/0x87925e4cb73aa3eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bab2 expref: 10 pid: 13436 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.256334:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.256340:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094194700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626829056:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.256341:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.256346:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.256349:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b800/0x87925e4cb73aa32e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ba3b expref: 12 pid: 9587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.256356:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963626829184:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.256362:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.256369:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.256371:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.256375:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.256377:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.256380:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb2e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143785.256382:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.256383:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.256388:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.256392:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.256395:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.256398:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.256400:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2e00/0x87925e4cb73aa446 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.256403:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.256407:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143785.256409:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.256414:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.256422:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.256427:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622728576:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 20383us (21148us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143785.256427:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa44d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.256434:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12352 00000100:00100000:2.0:1746143785.256447:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622728448:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 20319us (21235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.256452:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12353 00000100:00100000:0.0:1746143785.256488:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622730496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1230us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.256493:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5861 00000100:00100000:1.0:1746143785.258183:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2008:x1830963622728960:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 19123us (19766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.258196:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12351 00000100:00100000:0.0:1746143785.261873:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622730624:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7094us (7184us total) trans 21474840434 rc 0/0 00000100:00100000:0.0:1746143785.261886:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1495 00002000:00100000:0.0:1746143785.261899:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b6:0x0] (3026944->3141631) req@ffff88012b1d9c00 x1830963622730624/t21474840434(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/448 e 0 to 0 dl 1746143796 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143785.261927:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9c00 with x1830963622730624 ext(3026944->3141631) 00010000:00010000:0.0:1746143785.261938:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 16 pid: 13436 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.261953:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 16 pid: 13436 timeout: 944 lvb_type: 0 00002000:00010000:0.0:1746143785.261960:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1d9c00 00000100:00100000:2.0:1746143785.266084:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.266084:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.266133:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.266268:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622731648 00000100:00100000:1.0:1746143785.266278:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622731648 00010000:00010000:1.0:1746143785.266317:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 16 pid: 13436 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.266325:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622731264 00000100:00100000:3.0:1746143785.266331:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622731264 00000100:00100000:1.0:1746143785.266346:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5865 00000100:00100000:1.0:1746143785.266354:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622731648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143785.266358:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622731520 00000100:00100000:3.0:1746143785.266360:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622731520 00010000:00010000:1.0:1746143785.266367:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143785.266388:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 16 pid: 13436 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.266389:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12985 00000100:00100000:3.0:1746143785.266395:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+278:32411:x1830963622731264:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143785.266399:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 16 pid: 13436 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.266417:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.266420:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa3c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3141631) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baa4 expref: 16 pid: 13436 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.266432:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73aa45b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bae3 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266434:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.266436:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.266441:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266449:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266471:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143785.266509:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2009:x1830963622731648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 156us (429us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143785.266513:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00000100:00100000:1.0:1746143785.266515:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5865 00010000:00010000:3.0:1746143785.266525:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143785.266535:0:3134:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266542:0:3134:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266556:0:3134:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266563:0:3134:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266573:0:3134:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266579:0:3134:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880123268400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143785.266583:0:3134:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266591:0:3134:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266601:0:3134:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.266606:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123268400/0x87925e4cb73aa454 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.266643:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2008:x1830963622728832:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 30311us (30892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.266651:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12354 00000100:00100000:2.0:1746143785.266736:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12986 00000100:00100000:2.0:1746143785.266749:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+22:32415:x1830963622731520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143785.266758:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.266766:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73aa469 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840baea expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.266796:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143785.267205:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.267220:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73aa477 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.267226:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73aa477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.267231:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73aa477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.267334:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.267345:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bad5 expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.267356:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.267382:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bad5 expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.267392:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bad5 expref: 13 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.267404:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626829696:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.267476:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143785.267706:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267716:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267725:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73aa485 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267732:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73aa485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267737:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73aa485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267776:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73aa48c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267783:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73aa48c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267789:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73aa48c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143785.267797:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143785.267875:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73aa48c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267881:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73aa48c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267886:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73aa48c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267890:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143785.267893:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73aa48c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267898:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73aa48c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267905:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.267908:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143785.267926:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143785.267933:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73aa48c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267937:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73aa48c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267949:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267954:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267959:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267964:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267967:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143785.267970:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267975:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267981:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143785.267983:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143785.267985:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267990:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73aa470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.267997:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73aa485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.268002:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73aa485 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.268006:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73aa485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.268010:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143785.268012:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73aa485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.268016:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73aa485 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.268020:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22400) 00010000:00010000:2.0:1746143785.268022:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143785.268023:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73aa485 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.268027:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73aa485 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.268055:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73aa469 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baea expref: 24 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.268062:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73aa469 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baea expref: 24 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.268069:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97200, rc 0) 00000100:00100000:2.0:1746143785.268106:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32415:x1830963622731520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1363us (1972us total) trans 8589943756 rc 301/301 00000100:00100000:2.0:1746143785.268114:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12986 00000100:00100000:0.0:1746143785.271646:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.273545:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622731904 00000100:00100000:2.0:1746143785.273558:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622731904 00000100:00100000:2.0:1746143785.273620:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12987 00000100:00100000:2.0:1746143785.273628:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32409:x1830963622731904:12345-192.168.202.3@tcp:36:mirror_io.0 00000100:00100000:0.0:1746143785.273665:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143785.273681:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143785.273705:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622732160 00010000:00010000:2.0:1746143785.273708:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73aa42a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840badc expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.273709:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622732160 00010000:00010000:2.0:1746143785.273723:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.273727:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143785.273735:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143785.273788:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.273791:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:32409:x1830963622731904:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 164us (2155us total) trans 0 rc -16/-16 00000100:00100000:2.0:1746143785.273796:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12987 00000100:00100000:0.0:1746143785.273810:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622732288 00000100:00100000:0.0:1746143785.273813:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622732288 00010000:00010000:0.0:1746143785.273830:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bad5 expref: 13 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143785.273859:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5866 00000100:00100000:0.0:1746143785.273864:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622732288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143785.273873:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143785.273877:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bad5 expref: 13 pid: 10936 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143785.273887:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bad5 expref: 13 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143785.273901:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4783 00010000:00010000:0.0:1746143785.273902:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143785.273905:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00000100:00100000:1.0:1746143785.273908:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+23:32415:x1830963622732160:12345-192.168.202.3@tcp:35:cat.0 00010000:00010000:0.0:1746143785.273928:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143785.273935:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143785.273956:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143785.273972:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622732288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 108us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.273978:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5866 00000100:00100000:1.0:1746143785.274065:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32415:x1830963622732160:12345-192.168.202.3@tcp:35:cat.0 Request processed in 158us (401us total) trans 8589943757 rc 0/0 00000100:00100000:1.0:1746143785.274075:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4783 00010000:00010000:3.0:1746143785.274248:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73aa41c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bad5 expref: 12 pid: 10936 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.274266:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963626829696:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.274284:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274296:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274302:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143785.274317:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:3.0:1746143785.274356:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274363:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274369:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274375:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093716200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143785.274379:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274385:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274393:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.274395:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143785.274397:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274402:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716200/0x87925e4cb73aa47e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274417:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274422:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274427:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274431:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274435:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093717600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143785.274437:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274445:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274452:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143785.274454:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143785.274456:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274460:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73aa462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274467:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73aa477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274471:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73aa477 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274476:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73aa477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274480:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093716600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143785.274482:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73aa477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274486:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73aa477 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274491:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea22400) 00010000:00010000:3.0:1746143785.274493:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143785.274494:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73aa477 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274498:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73aa477 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143785.274532:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73aa45b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bae3 expref: 280 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.274539:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73aa45b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bae3 expref: 280 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.274546:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717a00, rc 0) 00000100:00100000:3.0:1746143785.274815:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+279:32411:x1830963622731264:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8419us (8742us total) trans 8589943758 rc 301/301 00000100:00100000:3.0:1746143785.274821:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12985 00000100:00100000:0.0:1746143785.276341:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.276460:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622732544 00000100:00100000:2.0:1746143785.276467:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622732544 00000100:00100000:2.0:1746143785.276515:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4784 00000100:00100000:2.0:1746143785.276522:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:32409:x1830963622732544:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143785.276678:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:32409:x1830963622732544:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 156us (340us total) trans 8589943759 rc 0/0 00000100:00100000:2.0:1746143785.276684:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4784 00000100:00100000:0.0:1746143785.277600:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.277638:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.277695:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622732672 00000100:00100000:2.0:1746143785.277699:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622732672 00000100:00100000:2.0:1746143785.277743:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622732928 00000100:00100000:2.0:1746143785.277745:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622732928 00000100:00100000:2.0:1746143785.277763:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12988 00000100:00100000:2.0:1746143785.277768:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+24:32415:x1830963622732672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143785.277784:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.277801:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73aa4a1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840baf1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.277882:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.277896:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.277908:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143785.277955:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:2.0:1746143785.277958:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143785.277972:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.277992:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73aa4a1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf1 expref: 26 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.278006:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf1 expref: 25 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.278013:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.278016:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143785.278019:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96a00, rc 0) 00000100:00100000:2.0:1746143785.278048:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32415:x1830963622732672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 279us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.278053:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12988 00000100:00100000:2.0:1746143785.278066:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12989 00000100:00100000:2.0:1746143785.278071:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+279:32417:x1830963622732928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143785.278080:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.278087:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73aa4af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840baf8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.278128:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278136:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278143:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278154:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73aa4bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278159:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73aa4bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278164:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73aa4bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278234:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278242:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278250:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143785.278257:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143785.278313:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278318:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278323:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278329:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278335:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143785.278339:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278344:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278352:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143785.278354:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143785.278358:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278362:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73aa4b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278370:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73aa4bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278378:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73aa4bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278383:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73aa4bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278387:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143785.278389:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73aa4bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278394:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73aa4bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278400:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880092b11900) 00010000:00010000:2.0:1746143785.278402:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143785.278404:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73aa4bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.278408:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73aa4bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.280286:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73aa4af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf8 expref: 282 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.280468:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf8 expref: 281 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.280468:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143785.280478:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.280480:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143785.280484:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717e00, rc 0) 00000100:00100000:2.0:1746143785.280536:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+281:32417:x1830963622732928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2462us (2895us total) trans 8589943760 rc 0/0 00000100:00100000:2.0:1746143785.280546:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12989 00000100:00100000:3.0:1746143785.280555:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622733184 00000100:00100000:3.0:1746143785.280564:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622733184 00000100:00100000:3.0:1746143785.280611:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4785 00000100:00100000:3.0:1746143785.280618:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:32409:x1830963622733184:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:0.0:1746143785.281299:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.281330:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.281427:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622733312 00000100:00100000:1.0:1746143785.281433:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622733312 00000100:00100000:1.0:1746143785.281456:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622733440 00000100:00100000:1.0:1746143785.281458:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622733440 00000100:00100000:1.0:1746143785.281473:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12355 00000100:00100000:1.0:1746143785.281478:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622733312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.281490:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.281510:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa4d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840baff expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143785.281531:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x7d8 00010000:00010000:1.0:1746143785.281547:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.281549:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.281559:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baff expref: 16 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.281574:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baff expref: 16 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.281582:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2c00, rc 0) 00000100:00100000:1.0:1746143785.281609:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622733312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 130us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.281611:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32409:x1830963622733184:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 993us (1144us total) trans 8589943761 rc 0/0 00000100:00100000:1.0:1746143785.281614:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12355 00000100:00100000:3.0:1746143785.281618:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4785 00000100:00100000:1.0:1746143785.281628:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12356 00000100:00100000:1.0:1746143785.281632:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+11:2008:x1830963622733440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.281642:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.281653:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa4d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb06 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143785.281666:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a29, atime: 0x68140a28, ctime: 0x68140a29, blocks: 0x808 00010000:00010000:1.0:1746143785.281674:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.281676:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.281680:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa4d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb06 expref: 12 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.281691:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa4d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb06 expref: 12 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.281698:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3800, rc 0) 00000100:00100000:1.0:1746143785.281719:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+12:2008:x1830963622733440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 86us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.281724:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12356 00000100:00100000:0.0:1746143785.282885:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.282948:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.282969:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.282976:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622733568 00000100:00100000:1.0:1746143785.282983:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622733568 00000100:00100000:1.0:1746143785.283018:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622733696 00000100:00100000:1.0:1746143785.283021:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622733696 00000100:00100000:0.0:1746143785.283031:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.283032:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622733952 00000100:00100000:1.0:1746143785.283033:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622733952 00000100:00100000:1.0:1746143785.283042:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622733824 00000100:00100000:1.0:1746143785.283043:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622733824 00000100:00100000:1.0:1746143785.283055:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12357 00000100:00100000:1.0:1746143785.283061:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622733568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.283071:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.283083:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73aa4e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb0d expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143785.283099:0:3135:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a29, atime: 0x68140a28, ctime: 0x68140a29, blocks: 0x800 00010000:00010000:1.0:1746143785.283109:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.283111:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.283116:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73aa4e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb0d expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.283126:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73aa4e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb0d expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.283139:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2a00, rc 0) 00000100:00100000:2.0:1746143785.283163:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12358 00000100:00100000:1.0:1746143785.283166:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622733568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 106us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.283171:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622733696:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143785.283172:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12357 00010000:00010000:2.0:1746143785.283179:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143785.283183:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12359 00000100:00100000:1.0:1746143785.283188:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2009:x1830963622733952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143785.283191:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73aa4e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb14 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.283193:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.283200:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73aa4ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb22 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143785.283206:0:1947:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x808 00002000:00010000:1.0:1746143785.283209:0:3135:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a29, atime: 0x68140a29, ctime: 0x68140a29, blocks: 0x1008 00010000:00010000:2.0:1746143785.283214:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.283216:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.283217:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.283218:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.283220:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73aa4e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb14 expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.283222:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73aa4ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb22 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.283231:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73aa4e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb14 expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.283234:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73aa4ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb22 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.283238:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96800, rc 0) 00010000:00010000:1.0:1746143785.283241:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2000, rc 0) 00000100:00100000:2.0:1746143785.283254:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622733696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.283258:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622733952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 70us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.283260:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12358 00000100:00100000:1.0:1746143785.283263:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12359 00000100:00100000:2.0:1746143785.283272:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12360 00000100:00100000:2.0:1746143785.283277:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2008:x1830963622733824:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143785.283282:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.283289:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73aa4f5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb1b expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143785.283308:0:1947:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4964768, mtime: 0x68140a29, atime: 0x68140a29, ctime: 0x68140a29, blocks: 0x15f0 00010000:00010000:2.0:1746143785.283314:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.283316:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.283319:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73aa4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb1b expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.283327:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73aa4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb1b expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.283334:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124adfc00, rc 0) 00000100:00100000:2.0:1746143785.283348:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622733824:12345-192.168.202.3@tcp:101:cat.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.283353:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12360 00000100:00100000:2.0:1746143785.285758:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.286001:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622734208 00000100:00100000:3.0:1746143785.286011:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622734208 00000100:00100000:3.0:1746143785.286064:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4786 00000100:00100000:3.0:1746143785.286072:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+281:32417:x1830963622734208:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143785.286281:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+282:32417:x1830963622734208:12345-192.168.202.3@tcp:35:cat.0 Request processed in 209us (530us total) trans 8589943762 rc 0/0 00000100:00100000:3.0:1746143785.286288:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4786 00000100:00100000:0.0:1746143785.289092:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.289134:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.290722:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622734336 00000100:00100000:1.0:1746143785.290732:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.290734:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622734336 00000100:00100000:1.0:1746143785.290774:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.290777:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622734464 00000100:00100000:3.0:1746143785.290780:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622734464 00000100:00100000:1.0:1746143785.290791:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.290792:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622734592 00000100:00100000:3.0:1746143785.290794:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622734592 00000100:00100000:3.0:1746143785.290809:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622734720 00000100:00100000:3.0:1746143785.290811:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622734720 00000100:00100000:1.0:1746143785.290822:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12361 00000100:00100000:1.0:1746143785.290837:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+21:2011:x1830963622734336:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143785.290867:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12362 00010000:00010000:1.0:1746143785.290868:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143785.290873:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963622734464:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143785.290883:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.290888:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73aa4fc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb29 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.290892:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73aa503 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb30 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.290925:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.290926:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.290927:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.290928:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.290936:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73aa503 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb30 expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.290937:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73aa4fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb29 expref: 22 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.290953:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73aa503 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb30 expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.290953:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73aa4fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb29 expref: 22 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.290962:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9400, rc 0) 00010000:00010000:1.0:1746143785.290963:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2200, rc 0) 00000100:00100000:3.0:1746143785.291003:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963622734464:12345-192.168.202.3@tcp:101:cat.0 Request processed in 130us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.291004:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963622734336:12345-192.168.202.3@tcp:101:cat.0 Request processed in 174us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.291009:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12362 00000100:00100000:1.0:1746143785.291012:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12361 00000100:00100000:3.0:1746143785.291026:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12363 00000100:00100000:1.0:1746143785.291029:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12364 00000100:00100000:3.0:1746143785.291031:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963622734592:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143785.291034:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+21:2010:x1830963622734720:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143785.291037:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.291040:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.291044:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73aa50a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb37 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.291047:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73aa511 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb3e expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.291054:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.291055:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.291057:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.291059:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73aa50a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb37 expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.291059:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.291063:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73aa511 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb3e expref: 22 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.291067:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73aa50a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb37 expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.291072:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73aa511 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb3e expref: 22 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.291074:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9200, rc 0) 00010000:00010000:1.0:1746143785.291078:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2400, rc 0) 00000100:00100000:3.0:1746143785.291088:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963622734592:12345-192.168.202.3@tcp:101:cat.0 Request processed in 57us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.291093:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12363 00000100:00100000:1.0:1746143785.291094:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622734720:12345-192.168.202.3@tcp:101:cat.0 Request processed in 60us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.291106:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12364 00000100:00100000:1.0:1746143785.291129:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.291142:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622734848 00000100:00100000:1.0:1746143785.291145:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622734848 00000100:00100000:2.0:1746143785.291211:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12365 00000100:00100000:2.0:1746143785.291220:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963622734848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143785.291227:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.291235:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124adf400/0x87925e4cb73aa518 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb45 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.291245:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.291246:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.291251:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124adf400/0x87925e4cb73aa518 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb45 expref: 23 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.291259:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124adf400/0x87925e4cb73aa518 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb45 expref: 23 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.291267:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124adf400, rc 0) 00000100:00100000:2.0:1746143785.291283:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622734848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 66us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.291288:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12365 00000100:00100000:2.0:1746143785.291310:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622735232 00000100:00100000:2.0:1746143785.291313:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622735232 00000100:00100000:0.0:1746143785.291445:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.291458:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622734976 00000100:00100000:0.0:1746143785.291461:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622734976 00000100:00100000:0.0:1746143785.291483:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12366 00000100:00100000:0.0:1746143785.291488:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963622734976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143785.291493:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143785.291500:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb4c expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.291510:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.291511:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.291515:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 40 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.291525:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 40 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.291531:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3d400, rc 0) 00000100:00100000:0.0:1746143785.291545:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622734976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 58us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.291550:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12366 00000100:00100000:2.0:1746143785.291619:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12990 00000100:00100000:2.0:1746143785.291625:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+25:32419:x1830963622735232:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143785.291634:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.291646:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa526 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb53 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.291717:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.291729:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.291738:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.291750:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73aa534 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.291756:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73aa534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.291761:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73aa534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.291873:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73aa53b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.291882:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73aa53b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.291887:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73aa53b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143785.291896:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143785.291985:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.291991:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.291996:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292002:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292008:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5aa000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143785.292012:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292018:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292027:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143785.292030:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143785.292033:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292041:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa000/0x87925e4cb73aa52d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292052:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73aa534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292056:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73aa534 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292060:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73aa534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292064:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097384e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143785.292066:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73aa534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292069:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73aa534 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292074:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e015000) 00010000:00010000:2.0:1746143785.292076:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143785.292077:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73aa534 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292081:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73aa534 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.292112:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5aa400/0x87925e4cb73aa526 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb53 expref: 28 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.292120:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73aa53b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb53 expref: 27 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.292130:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.292132:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143785.292134:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76a00, rc 0) 00000100:00100000:2.0:1746143785.292154:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:32419:x1830963622735232:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 530us (1380us total) trans 8589943763 rc 0/0 00000100:00100000:2.0:1746143785.292160:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12990 00000100:00100000:0.0:1746143785.300377:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.300488:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.301134:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.301592:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622735488 00000100:00100000:2.0:1746143785.301603:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622735488 00002000:00100000:2.0:1746143785.301652:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880091bdc700 x1830963622735488/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.301661:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc700 with x1830963622735488 ext(0->1048575) 00002000:00010000:2.0:1746143785.301667:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdc700 00000100:00100000:2.0:1746143785.301694:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622735872 00000100:00100000:2.0:1746143785.301696:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622735872 00002000:00100000:2.0:1746143785.301709:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880091bdc000 x1830963622735872/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.301716:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc000 with x1830963622735872 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.301719:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdc000 00000100:00100000:2.0:1746143785.301728:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622735744 00000100:00100000:2.0:1746143785.301731:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622735744 00002000:00100000:2.0:1746143785.301740:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880091bded80 x1830963622735744/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.301746:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bded80 with x1830963622735744 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.301749:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bded80 00000100:00100000:2.0:1746143785.301760:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3649 00000100:00100000:2.0:1746143785.301769:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622735488:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.302586:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3650 00000100:00100000:2.0:1746143785.302593:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622735872:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143785.302762:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3651 00000100:00100000:1.0:1746143785.302771:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622735744:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.303318:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.303435:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622736384 00000100:00100000:1.0:1746143785.303441:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622736384 00000100:00100000:1.0:1746143785.303481:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 762 00000100:00100000:1.0:1746143785.303486:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2009:x1830963622736384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143785.303496:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143785.303521:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76a00/0x87925e4cb73aa53b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb53 expref: 27 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.303549:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143785.303555:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143785.303583:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2009:x1830963622736384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 96us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.303589:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 762 00000100:00100000:0.0:1746143785.305295:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.305314:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622736256 00000100:00100000:0.0:1746143785.305320:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622736256 00002000:00100000:0.0:1746143785.305357:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880091bdce00 x1830963622736256/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143785.305367:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdce00 with x1830963622736256 ext(1048576->2097151) 00002000:00010000:0.0:1746143785.305372:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdce00 00000100:00100000:0.0:1746143785.305399:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3652 00000100:00100000:0.0:1746143785.305406:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622736256:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143785.312908:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.313009:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622736896 00000100:00100000:3.0:1746143785.313020:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622736896 00002000:00100000:3.0:1746143785.313066:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880091bdca80 x1830963622736896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.313078:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdca80 with x1830963622736896 ext(1048576->2097151) 00002000:00010000:3.0:1746143785.313083:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdca80 00000100:00100000:3.0:1746143785.313104:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3653 00000100:00100000:3.0:1746143785.313111:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622736896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143785.317660:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.318065:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.318322:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622737152 00000100:00100000:2.0:1746143785.318334:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622737152 00002000:00100000:2.0:1746143785.318386:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880135b09c00 x1830963622737152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.318396:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09c00 with x1830963622737152 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.318401:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b09c00 00000100:00100000:2.0:1746143785.318423:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622736640 00000100:00100000:2.0:1746143785.318425:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622736640 00002000:00100000:2.0:1746143785.318437:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880135b08e00 x1830963622736640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.318444:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08e00 with x1830963622736640 ext(0->1048575) 00002000:00010000:2.0:1746143785.318447:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b08e00 00000100:00100000:2.0:1746143785.318459:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3654 00000100:00100000:2.0:1746143785.318467:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963622737152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143785.319439:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3655 00000100:00100000:1.0:1746143785.319449:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622736640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143785.320056:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622735488:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18286us (19689us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143785.320068:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3649 00002000:00100000:3.0:1746143785.320076:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880091bdc700 x1830963622735488/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.320084:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc700 with x1830963622735488 ext(0->1048575) 00002000:00010000:3.0:1746143785.320088:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdc700 00000100:00100000:0.0:1746143785.321794:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.321908:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622737408 00000100:00100000:2.0:1746143785.321931:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622737408 00002000:00100000:2.0:1746143785.321972:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880091bde680 x1830963622737408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.321981:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bde680 with x1830963622737408 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.321986:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bde680 00000100:00100000:2.0:1746143785.322007:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3656 00000100:00100000:2.0:1746143785.322014:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622737408:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.324237:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622735872:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21632us (23737us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143785.324250:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3650 00002000:00100000:2.0:1746143785.324290:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880091bdc000 x1830963622735872/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.324308:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc000 with x1830963622735872 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.324314:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdc000 00000100:00100000:1.0:1746143785.325284:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2009:x1830963622735744:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22510us (24145us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143785.325293:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3651 00002000:00100000:1.0:1746143785.325300:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880091bded80 x1830963622735744/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.325307:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bded80 with x1830963622735744 ext(1048576->2097151) 00002000:00010000:1.0:1746143785.325311:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bded80 00000100:00100000:1.0:1746143785.329061:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622736256:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23640us (23759us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143785.329076:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3652 00002000:00100000:1.0:1746143785.329088:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880091bdce00 x1830963622736256/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.329099:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdce00 with x1830963622736256 ext(1048576->2097151) 00002000:00010000:1.0:1746143785.329105:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdce00 00000100:00100000:3.0:1746143785.336274:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963622736896:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22350us (22565us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143785.336287:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3653 00002000:00100000:3.0:1746143785.336302:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x395:0x0] (1048576->2097151) req@ffff880091bdca80 x1830963622736896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.336311:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdca80 with x1830963622736896 ext(1048576->2097151) 00002000:00010000:3.0:1746143785.336317:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdca80 00000100:00100000:2.0:1746143785.346217:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963622737152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27738us (28557us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143785.346230:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3654 00002000:00100000:2.0:1746143785.346242:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x396:0x0] (1048576->2097151) req@ffff880135b09c00 x1830963622737152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.346251:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09c00 with x1830963622737152 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.346257:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b09c00 00000100:00100000:1.0:1746143785.352822:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963622736640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 33362us (34744us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143785.352835:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3655 00002000:00100000:1.0:1746143785.352859:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b3:0x0] (0->1048575) req@ffff880135b08e00 x1830963622736640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.352870:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08e00 with x1830963622736640 ext(0->1048575) 00002000:00010000:1.0:1746143785.352876:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b08e00 00000100:00100000:0.0:1746143785.353602:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.353631:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.353694:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622737664 00000100:00100000:2.0:1746143785.353704:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622737664 00002000:00100000:2.0:1746143785.353745:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091bdd880 x1830963622737664/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.353752:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd880 with x1830963622737664 ext(2097152->4194303) 00002000:00010000:2.0:1746143785.353756:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdd880 00000100:00100000:2.0:1746143785.353770:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622737920 00000100:00100000:2.0:1746143785.353773:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622737920 00002000:00100000:2.0:1746143785.353786:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bdd500 x1830963622737920/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.353793:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd500 with x1830963622737920 ext(2097152->4194303) 00002000:00010000:2.0:1746143785.353796:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdd500 00000100:00100000:1.0:1746143785.353800:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3657 00000100:00100000:1.0:1746143785.353809:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622737664:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.353967:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3658 00000100:00100000:2.0:1746143785.353980:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622737920:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143785.354002:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622737408:12345-192.168.202.3@tcp:3:cat.0 Request processed in 31987us (32215us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143785.354011:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3656 00002000:00100000:3.0:1746143785.354017:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880091bde680 x1830963622737408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.354024:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bde680 with x1830963622737408 ext(1048576->2097151) 00002000:00010000:3.0:1746143785.354028:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bde680 00000100:00100000:1.0:1746143785.384789:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622737664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 30966us (31173us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143785.384801:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3657 00002000:00100000:1.0:1746143785.384815:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091bdd880 x1830963622737664/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.384825:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd880 with x1830963622737664 ext(2097152->4194303) 00002000:00010000:1.0:1746143785.384830:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdd880 00000100:00100000:3.0:1746143785.393823:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622737920:12345-192.168.202.3@tcp:3:cat.0 Request processed in 39836us (40178us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143785.393836:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3658 00002000:00100000:3.0:1746143785.393861:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bdd500 x1830963622737920/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.393872:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd500 with x1830963622737920 ext(2097152->4194303) 00002000:00010000:3.0:1746143785.393879:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdd500 00000100:00100000:0.0:1746143785.394158:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.394356:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622738048 00000100:00100000:1.0:1746143785.394365:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622738048 00000100:00100000:1.0:1746143785.394408:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12367 00000100:00100000:1.0:1746143785.394415:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:32411:x1830963622738048:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143785.394437:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.394455:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb5a expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.394484:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73aa4ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb22 expref: 13 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.394493:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.394499:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.394501:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.394504:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 41 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.394533:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.394544:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 41 pid: 3134 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.394556:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626829824:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.394642:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73aa4ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb22 expref: 13 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.394650:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73aa4ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb22 expref: 13 pid: 3135 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143785.394664:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626829952:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.394683:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.407584:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.407629:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.407660:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.407690:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622738304 00000100:00100000:1.0:1746143785.407698:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622738688 00000100:00100000:0.0:1746143785.407698:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622738304 00000100:00100000:1.0:1746143785.407703:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622738688 00002000:00100000:1.0:1746143785.407748:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bddc00 x1830963622738688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.407757:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddc00 with x1830963622738688 ext(2097152->4194303) 00000100:00100000:3.0:1746143785.407769:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622738816 00010000:00010000:1.0:1746143785.407771:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 42 pid: 3134 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143785.407773:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622738816 00010000:00010000:1.0:1746143785.407783:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 42 pid: 3134 timeout: 944 lvb_type: 1 00002000:00010000:1.0:1746143785.407789:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bddc00 00002000:00100000:0.0:1746143785.407813:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880091bdc380 x1830963622738304/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143785.407820:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc380 with x1830963622738304 ext(4194304->4968447) 00000100:00100000:1.0:1746143785.407821:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1496 00002000:00010000:0.0:1746143785.407824:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdc380 00000100:00100000:1.0:1746143785.407828:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622738688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143785.407845:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3659 00000100:00100000:0.0:1746143785.407875:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622738304:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143785.409125:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091bdf480 x1830963622738816/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.409134:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf480 with x1830963622738816 ext(2097152->4194303) 00002000:00010000:3.0:1746143785.409138:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdf480 00000100:00100000:3.0:1746143785.409161:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3660 00000100:00100000:3.0:1746143785.409167:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622738816:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.409233:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626829824:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.409242:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626829952:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.409273:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.409289:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5ace00, rc 0) 00000100:00100000:2.0:1746143785.409492:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+43:32411:x1830963622738048:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 15076us (15333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.409499:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12367 00000100:00100000:2.0:1746143785.411393:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.412240:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622738944 00000100:00100000:0.0:1746143785.412250:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622738944 00010000:00010000:0.0:1746143785.412292:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73aa4ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb22 expref: 14 pid: 3135 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746143785.412354:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5867 00000100:00100000:0.0:1746143785.412363:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622738944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143785.412381:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143785.412405:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73aa4ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb22 expref: 14 pid: 3135 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.412417:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73aa4ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb22 expref: 14 pid: 3135 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.412444:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73aa4ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb22 expref: 14 pid: 3135 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.412490:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143785.412557:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622738944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 193us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.412564:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5867 00000100:00100000:1.0:1746143785.423114:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622738304:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15225us (15527us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143785.423128:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3659 00002000:00100000:1.0:1746143785.423142:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880091bdc380 x1830963622738304/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.423151:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc380 with x1830963622738304 ext(4194304->4968447) 00002000:00010000:1.0:1746143785.423159:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdc380 00000100:00100000:0.0:1746143785.436262:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.440520:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622738816:12345-192.168.202.3@tcp:3:cat.0 Request processed in 31337us (32842us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143785.440536:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3660 00000100:00100000:2.0:1746143785.440538:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622739072 00000100:00100000:2.0:1746143785.440547:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622739072 00002000:00100000:3.0:1746143785.440551:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880091bdf480 x1830963622738816/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.440560:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf480 with x1830963622738816 ext(2097152->4194303) 00002000:00010000:3.0:1746143785.440566:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdf480 00000100:00100000:2.0:1746143785.440591:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12368 00000100:00100000:2.0:1746143785.440597:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622739072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143785.440613:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.440637:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73aa550 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb61 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.440662:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.440673:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73aa550 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb61 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.440683:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73aa550 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb61 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.440699:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fa00, rc 0) 00000100:00100000:2.0:1746143785.440745:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622739072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 148us (4495us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143785.440750:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12368 00000100:00100000:0.0:1746143785.441869:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622738688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 34037us (34234us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143785.441878:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1496 00002000:00100000:0.0:1746143785.441885:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880091bddc00 x1830963622738688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143785.441892:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddc00 with x1830963622738688 ext(2097152->4194303) 00010000:00010000:0.0:1746143785.441898:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 41 pid: 3134 timeout: 944 lvb_type: 1 00010000:00010000:0.0:1746143785.441941:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 41 pid: 3134 timeout: 944 lvb_type: 1 00002000:00010000:0.0:1746143785.441953:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bddc00 00000100:00100000:0.0:1746143785.450345:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.450410:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.450426:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622739200 00000100:00100000:2.0:1746143785.450437:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622739200 00000100:00100000:2.0:1746143785.450493:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622739328 00000100:00100000:2.0:1746143785.450495:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622739328 00000100:00100000:2.0:1746143785.450524:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12369 00000100:00100000:2.0:1746143785.450532:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622739200:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143785.450555:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143785.450572:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12370 00010000:00010000:2.0:1746143785.450574:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73aa557 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb68 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143785.450578:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+41:32417:x1830963622739328:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143785.450586:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143785.450591:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb6f expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.450598:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.450608:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73aa557 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb68 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.450613:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.450617:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 42 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.450623:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143785.450627:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.450685:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73aa557 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb68 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.450705:0:3134:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 42 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.450713:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ee00, rc 0) 00010000:00010000:0.0:1746143785.450716:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.450724:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28a00, rc 0) 00000100:00100000:0.0:1746143785.450757:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:32417:x1830963622739328:12345-192.168.202.3@tcp:101:cat.0 Request processed in 179us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.450759:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622739200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 229us (430us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143785.450765:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12369 00000100:00100000:0.0:1746143785.450767:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12370 00000100:00100000:0.0:1746143785.457636:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.458884:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622739456 00000100:00100000:2.0:1746143785.458896:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622739456 00010000:00010000:2.0:1746143785.458953:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 42 pid: 3134 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.458983:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5868 00000100:00100000:2.0:1746143785.458990:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622739456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.459004:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.459024:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 42 pid: 3134 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.459036:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 42 pid: 3134 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.459059:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3d400/0x87925e4cb73aa51f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb4c expref: 42 pid: 3134 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.459086:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.459088:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.459095:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 41 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.459102:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 41 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.459142:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 41 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.459152:0:12362:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 41 pid: 3135 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.459163:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626830208:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143785.459251:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f8796c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.463281:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.463375:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626830208:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143785.463398:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143785.463745:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622739712 00000100:00100000:1.0:1746143785.463752:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622739712 00002000:00100000:1.0:1746143785.463795:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2981888->2985983) req@ffff8800919e5c00 x1830963622739712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.463805:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e5c00 with x1830963622739712 ext(2981888->2985983) 00010000:00010000:1.0:1746143785.463814:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 42 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.463827:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 42 pid: 3135 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143785.463833:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919e5c00 00000100:00100000:1.0:1746143785.463874:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1497 00000100:00100000:1.0:1746143785.463881:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622739712:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.464899:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622739456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5906us (7271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.464908:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5868 00000100:00100000:1.0:1746143785.466134:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963622739712:12345-192.168.202.3@tcp:3:cat.0 Request processed in 2246us (2856us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143785.466145:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1497 00002000:00100000:1.0:1746143785.466156:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2981888->2985983) req@ffff8800919e5c00 x1830963622739712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.466165:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e5c00 with x1830963622739712 ext(2981888->2985983) 00010000:00010000:1.0:1746143785.466174:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 41 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.466186:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 41 pid: 3135 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143785.466197:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919e5c00 00000100:00100000:0.0:1746143785.471701:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.471761:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.471820:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622740096 00000100:00100000:1.0:1746143785.471832:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622740096 00002000:00100000:1.0:1746143785.471891:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2981888->3145727) req@ffff8800919e7800 x1830963622740096/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.471901:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e7800 with x1830963622740096 ext(2981888->3145727) 00010000:00010000:1.0:1746143785.471946:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 41 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.471966:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 41 pid: 3135 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143785.471973:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919e7800 00000100:00100000:1.0:1746143785.472004:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1498 00000100:00100000:1.0:1746143785.472013:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622740096:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143785.472201:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622739968 00000100:00100000:2.0:1746143785.472206:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622739968 00000100:00100000:2.0:1746143785.472233:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12371 00000100:00100000:2.0:1746143785.472238:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:32411:x1830963622739968:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143785.472248:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.472265:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb76 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.472289:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73aa4f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb1b expref: 17 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.472301:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124adf400/0x87925e4cb73aa518 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb45 expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.472309:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.472311:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.472314:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->3629055] (req 3145728->3629055) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.472345:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124adf400/0x87925e4cb73aa518 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb45 expref: 24 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.472355:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124adf400/0x87925e4cb73aa518 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb45 expref: 24 pid: 12327 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.472367:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626830336:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.472439:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73aa4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb1b expref: 17 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.472447:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73aa4f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb1b expref: 17 pid: 1947 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.472454:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626830464:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.472473:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f8796c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143785.477975:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622740096:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5951us (6200us total) trans 17179873105 rc 0/0 00000100:00100000:1.0:1746143785.477989:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1498 00002000:00100000:1.0:1746143785.478003:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (2981888->3145727) req@ffff8800919e7800 x1830963622740096/t17179873105(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/448 e 0 to 0 dl 1746143796 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.478012:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e7800 with x1830963622740096 ext(2981888->3145727) 00010000:00010000:1.0:1746143785.478023:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 43 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143785.478042:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 43 pid: 3135 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143785.478049:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800919e7800 00000100:00100000:3.0:1746143785.478750:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626830336:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.478760:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626830464:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.478786:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->3629055] (req 3145728->3629055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.478806:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f400, rc 0) 00000100:00100000:3.0:1746143785.478839:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:32411:x1830963622739968:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6601us (7150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.478857:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12371 00000100:00100000:0.0:1746143785.480837:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.481320:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622740352 00000100:00100000:2.0:1746143785.481327:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622740352 00010000:00010000:2.0:1746143785.481354:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73aa4f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb1b expref: 18 pid: 1947 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.481384:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5869 00000100:00100000:2.0:1746143785.481391:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2011:x1830963622740352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.481404:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.481421:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73aa4f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb1b expref: 18 pid: 1947 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.481430:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73aa4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb1b expref: 18 pid: 1947 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.481449:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124adfc00/0x87925e4cb73aa4f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb1b expref: 18 pid: 1947 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.481470:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.481495:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622740352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.481501:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5869 00000100:00100000:1.0:1746143785.485289:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.485391:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.485477:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622740480 00000100:00100000:3.0:1746143785.485486:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622740480 00000100:00100000:3.0:1746143785.485539:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12372 00000100:00100000:3.0:1746143785.485547:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:32419:x1830963622740480:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143785.485567:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.485585:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb7d expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.485613:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143785.485616:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143785.485620:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->4030463] (req 3158016->4030463) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.485631:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->4030463] (req 3158016->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.485640:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085000, rc 0) 00000100:00100000:2.0:1746143785.485951:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622740224 00000100:00100000:2.0:1746143785.485960:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622740224 00010000:00010000:2.0:1746143785.485990:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124adf400/0x87925e4cb73aa518 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb45 expref: 24 pid: 12327 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.486017:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5870 00000100:00100000:2.0:1746143785.486024:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622740224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.486035:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.486049:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124adf400/0x87925e4cb73aa518 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb45 expref: 24 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.486063:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124adf400/0x87925e4cb73aa518 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb45 expref: 24 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.486081:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124adf400/0x87925e4cb73aa518 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb45 expref: 24 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143785.486094:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.486095:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.486101:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.486108:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.486134:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.486143:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626830592:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143785.486228:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:32419:x1830963622740480:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 680us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.486234:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12372 00000100:00100000:2.0:1746143785.486686:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.487017:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.487165:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622740608 00000100:00100000:3.0:1746143785.487171:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622740608 00010000:00010000:3.0:1746143785.487203:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 43 pid: 3135 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.487243:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5871 00000100:00100000:3.0:1746143785.487249:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963622740608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.487258:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.487381:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 43 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.487401:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 43 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.487426:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa549 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb5a expref: 43 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.487452:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.487454:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.487465:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.487472:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.487479:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.487480:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.487483:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.487504:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.487550:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.487563:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626830720:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143785.487690:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.487699:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626830848:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143785.487813:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.494418:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.494562:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622740864 00000100:00100000:1.0:1746143785.494579:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622740864 00002000:00100000:1.0:1746143785.494666:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (3158016->3162111) req@ffff8800919e7100 x1830963622740864/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.494677:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e7100 with x1830963622740864 ext(3158016->3162111) 00002000:00010000:1.0:1746143785.494682:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919e7100 00000100:00100000:1.0:1746143785.494705:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3661 00000100:00100000:1.0:1746143785.494714:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622740864:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143785.494876:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2011:x1830963622740864:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 162us (481us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143785.494882:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3661 00002000:00100000:1.0:1746143785.494888:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x397:0x0] (3158016->3162111) req@ffff8800919e7100 x1830963622740864/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.494895:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e7100 with x1830963622740864 ext(3158016->3162111) 00002000:00010000:1.0:1746143785.494897:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919e7100 00000100:00100000:3.0:1746143785.495025:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626830720:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143785.495035:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963626830848:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143785.495054:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.495085:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963622740608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7836us (8069us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.495093:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5871 00000100:00100000:2.0:1746143785.495126:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963626830592:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143785.495138:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.495152:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622740224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9129us (9761us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.495158:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5870 00000100:00100000:0.0:1746143785.496035:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.496087:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622741120 00000100:00100000:3.0:1746143785.496091:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622741120 00002000:00100000:3.0:1746143785.496112:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff8800919e4a80 x1830963622741120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.496119:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e4a80 with x1830963622741120 ext(2097152->3145727) 00002000:00010000:3.0:1746143785.496123:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919e4a80 00000100:00100000:3.0:1746143785.496141:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3662 00000100:00100000:3.0:1746143785.496146:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622741120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143785.501067:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.501141:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622741376 00000100:00100000:2.0:1746143785.501151:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622741376 00002000:00100000:2.0:1746143785.501195:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3624960->3629055) req@ffff8800919e5180 x1830963622741376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.501205:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e5180 with x1830963622741376 ext(3624960->3629055) 00002000:00010000:2.0:1746143785.501210:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919e5180 00000100:00100000:2.0:1746143785.501232:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3663 00000100:00100000:2.0:1746143785.501240:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622741376:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.501381:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622741376:12345-192.168.202.3@tcp:3:cat.0 Request processed in 141us (351us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143785.501387:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3663 00002000:00100000:2.0:1746143785.501392:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (3624960->3629055) req@ffff8800919e5180 x1830963622741376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.501399:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e5180 with x1830963622741376 ext(3624960->3629055) 00002000:00010000:2.0:1746143785.501401:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800919e5180 00000100:00100000:0.0:1746143785.504907:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.505285:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622741632 00000100:00100000:2.0:1746143785.505296:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622741632 00002000:00100000:2.0:1746143785.505346:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (4026368->4030463) req@ffff8800919e6a00 x1830963622741632/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.505356:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e6a00 with x1830963622741632 ext(4026368->4030463) 00002000:00010000:2.0:1746143785.505362:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919e6a00 00000100:00100000:2.0:1746143785.505382:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3664 00000100:00100000:2.0:1746143785.505390:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2010:x1830963622741632:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143785.506108:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622741120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9957us (10071us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143785.506116:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3662 00002000:00100000:3.0:1746143785.506124:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->3145727) req@ffff8800919e4a80 x1830963622741120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.506132:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e4a80 with x1830963622741120 ext(2097152->3145727) 00002000:00010000:3.0:1746143785.506137:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919e4a80 00000100:00100000:2.0:1746143785.506959:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2010:x1830963622741632:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 1560us (3061us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143785.506974:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3664 00002000:00100000:2.0:1746143785.506985:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (4026368->4030463) req@ffff8800919e6a00 x1830963622741632/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.506995:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800919e6a00 with x1830963622741632 ext(4026368->4030463) 00002000:00010000:2.0:1746143785.507000:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800919e6a00 00000100:00100000:0.0:1746143785.511361:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.511426:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.512344:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622741888 00000100:00100000:3.0:1746143785.512355:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622741888 00000100:00100000:1.0:1746143785.513150:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622742144 00000100:00100000:1.0:1746143785.513157:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622742144 00000100:00100000:1.0:1746143785.513184:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4787 00000100:00100000:1.0:1746143785.513192:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+282:32411:x1830963622741888:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143785.513342:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4788 00000100:00100000:3.0:1746143785.513349:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b496050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:32419:x1830963622742144:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143785.513512:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b496050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:32419:x1830963622742144:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 164us (2085us total) trans 8589943764 rc 0/0 00000100:00100000:3.0:1746143785.513518:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4788 00000100:00100000:1.0:1746143785.514154:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+283:32411:x1830963622741888:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 962us (2805us total) trans 8589943765 rc 0/0 00000100:00100000:1.0:1746143785.514161:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4787 00000100:00100000:1.0:1746143785.514644:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.514711:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622742400 00000100:00100000:2.0:1746143785.514717:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622742400 00002000:00100000:2.0:1746143785.514751:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3629056->4194303) req@ffff88012b1db100 x1830963622742400/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.514760:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db100 with x1830963622742400 ext(3629056->4194303) 00002000:00010000:2.0:1746143785.514766:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1db100 00000100:00100000:2.0:1746143785.514781:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3665 00000100:00100000:2.0:1746143785.514787:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622742400:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.521647:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622742400:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6848us (6993us total) trans 0 rc 565248/565248 00000100:00100000:2.0:1746143785.521660:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3665 00002000:00100000:2.0:1746143785.521672:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3629056->4194303) req@ffff88012b1db100 x1830963622742400/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 565248/565248 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.521682:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db100 with x1830963622742400 ext(3629056->4194303) 00002000:00010000:2.0:1746143785.521688:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1db100 00000100:00100000:0.0:1746143785.524948:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.525059:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622742528 00000100:00100000:3.0:1746143785.525069:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622742528 00000100:00100000:3.0:1746143785.525128:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12373 00000100:00100000:3.0:1746143785.525135:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:32417:x1830963622742528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143785.525155:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.525173:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb84 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.525209:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.525216:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143785.525218:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143785.525222:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.525250:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.525262:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 13 pid: 3135 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.525274:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626830976:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.525351:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143785.527890:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626830976:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.527962:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.527978:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085c00, rc 0) 00000100:00100000:3.0:1746143785.528026:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+43:32417:x1830963622742528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2890us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.528034:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12373 00000100:00100000:0.0:1746143785.528429:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.528791:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622742656 00000100:00100000:3.0:1746143785.528798:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622742656 00002000:00100000:3.0:1746143785.528837:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3158016->4030463) req@ffff880090e58380 x1830963622742656/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.528855:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58380 with x1830963622742656 ext(3158016->4030463) 00010000:00010000:3.0:1746143785.528862:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 14 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.528875:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 14 pid: 3135 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143785.529280:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e58380 00000100:00100000:3.0:1746143785.529303:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1499 00000100:00100000:3.0:1746143785.529311:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2008:x1830963622742656:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143785.537649:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622742656:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8327us (9208us total) trans 17179873106 rc 0/0 00000100:00100000:3.0:1746143785.537662:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1499 00002000:00100000:3.0:1746143785.537675:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3158016->4030463) req@ffff880090e58380 x1830963622742656/t17179873106(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/448 e 0 to 0 dl 1746143796 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.537684:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58380 with x1830963622742656 ext(3158016->4030463) 00010000:00010000:3.0:1746143785.537695:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 16 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.537711:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 16 pid: 3135 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143785.537722:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e58380 00000100:00100000:0.0:1746143785.543036:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.543703:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622742784 00000100:00100000:2.0:1746143785.543714:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622742784 00010000:00010000:2.0:1746143785.543755:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 16 pid: 3135 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.543803:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5872 00000100:00100000:2.0:1746143785.543812:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622742784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.543827:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.543859:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 16 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.543871:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 16 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.543895:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082085000/0x87925e4cb73aa56c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3158016->18446744073709551615] (req 3158016->4030463) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb7d expref: 16 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.544240:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.544242:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.544250:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 42 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.544258:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 42 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.544293:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 42 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.544306:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626831104:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143785.544621:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.546878:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963626831104:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143785.546903:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.547047:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622742784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3234us (4019us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.547059:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5872 00000100:00100000:0.0:1746143785.552828:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.552977:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622743040 00000100:00100000:3.0:1746143785.552987:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622743040 00002000:00100000:3.0:1746143785.553136:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880090e5ad80 x1830963622743040/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.553146:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5ad80 with x1830963622743040 ext(3145728->4194303) 00002000:00010000:3.0:1746143785.553151:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5ad80 00000100:00100000:3.0:1746143785.553172:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3666 00000100:00100000:3.0:1746143785.553180:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622743040:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143785.562737:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622743040:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9546us (9909us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143785.562749:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3666 00002000:00100000:3.0:1746143785.562760:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (3145728->4194303) req@ffff880090e5ad80 x1830963622743040/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.562769:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5ad80 with x1830963622743040 ext(3145728->4194303) 00002000:00010000:3.0:1746143785.562774:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5ad80 00000100:00100000:0.0:1746143785.568492:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.568614:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622743296 00000100:00100000:3.0:1746143785.568625:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622743296 00002000:00100000:3.0:1746143785.568673:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880090e59500 x1830963622743296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.568683:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59500 with x1830963622743296 ext(4194304->4968447) 00002000:00010000:3.0:1746143785.568689:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59500 00000100:00100000:3.0:1746143785.568949:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3667 00000100:00100000:3.0:1746143785.568958:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622743296:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143785.577704:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622743296:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8732us (9208us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143785.577719:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3667 00002000:00100000:3.0:1746143785.577734:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880090e59500 x1830963622743296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.577745:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59500 with x1830963622743296 ext(4194304->4968447) 00002000:00010000:3.0:1746143785.577752:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59500 00000100:00100000:3.0:1746143785.607117:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626831232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746143785.607193:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143785.607365:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626831232 00000100:00100000:0.0:1746143785.607374:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626831232 00000100:00100000:0.0:1746143785.607499:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1746143785.607507:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3772:x1830963626831232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746143785.607542:0:12158:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446088704 avail 1316626432 00000100:00100000:0.0:1746143785.607591:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3772:x1830963626831232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.607597:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1746143785.607626:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626831232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746143785.639621:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b99f1f93-ef24-4932-a1b4-452b64359da1:3773:1830963626831360:0@lo:400:kworker.0 00000100:00100000:2.0:1746143785.639681:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143785.639797:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143785.639803:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626831488:0@lo:400:kworker.0 00000100:00100000:2.0:1746143785.639828:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143785.639873:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626831488 00000100:00100000:2.0:1746143785.639881:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626831488 00000100:00100000:2.0:1746143785.639939:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1746143785.639947:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963626831488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143785.639992:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963626831488:12345-0@lo:400:kworker.0 Request processed in 45us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.639998:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1746143785.640038:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626831488:0@lo:400:kworker.0 00000100:00100000:1.0:1746143785.640403:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3771:1830963626831616:0@lo:400:kworker.0 00000100:00100000:1.0:1746143785.640432:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143785.640450:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3771:1830963626832128:0@lo:400:kworker.0 00000100:00100000:0.0:1746143785.640470:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.640478:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626831616 00000100:00100000:1.0:1746143785.640481:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626831616 00000100:00100000:0.0:1746143785.640512:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622743552 00000100:00100000:0.0:1746143785.640516:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622743552 00000100:00100000:2.0:1746143785.640519:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3774:1830963626832000:0@lo:400:kworker.0 00000100:00100000:2.0:1746143785.640540:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143785.640541:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12991 00000100:00100000:0.0:1746143785.640546:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+283:32427:x1830963622743552:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:2.0:1746143785.640553:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626832512:0@lo:400:kworker.0 00010000:00010000:0.0:1746143785.640562:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143785.640569:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746143785.640582:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73aa57a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb8b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.640584:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143785.640587:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626831872:0@lo:400:kworker.0 00000100:00100000:2.0:1746143785.640601:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143785.640613:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3774:1830963626832384:0@lo:400:kworker.0 00000100:00100000:2.0:1746143785.640627:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143785.640651:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626832512 00000100:00100000:2.0:1746143785.640654:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626832512 00000100:00100000:3.0:1746143785.640673:0:8215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626831360 00000100:00080000:2.0:1746143785.640674:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143785.640678:0:8215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626831360 00010000:00010000:0.0:1746143785.640691:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143785.640698:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626831872 00000100:00100000:2.0:1746143785.640700:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626831872 00000100:00100000:3.0:1746143785.640703:0:8215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00010000:00010000:0.0:1746143785.640707:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf1 expref: 26 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.640709:0:8215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d56d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3773:x1830963626831360:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1746143785.640714:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf8 expref: 284 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.640718:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1746143785.640722:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963626832512:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1746143785.640722:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143785.640746:0:8215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d56d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3773:x1830963626831360:12345-0@lo:400:kworker.0 Request processed in 37us (1065us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143785.640746:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf8 expref: 284 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.640751:0:8215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1746143785.640755:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963626832512:12345-0@lo:400:kworker.0 Request processed in 32us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143785.640757:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf8 expref: 284 pid: 6587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.640760:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1746143785.640766:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626832896:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.640769:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1746143785.640774:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3774:x1830963626831872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.640787:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626831744:0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.640813:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143785.640813:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3774:x1830963626831872:12345-0@lo:400:kworker.0 Request processed in 38us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.640818:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1746143785.640825:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626831744 00010000:00010000:0.0:1746143785.640826:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf1 expref: 26 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.640827:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626831744 00000100:00100000:3.0:1746143785.640829:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3772:1830963626832256:0@lo:400:kworker.0 00010000:00010000:0.0:1746143785.640838:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf1 expref: 26 pid: 6587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.640843:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1746143785.640855:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626833024:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.640858:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143785.640858:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626831744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143785.640874:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143785.640884:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3772:1830963626832768:0@lo:400:kworker.0 00000100:00100000:0.0:1746143785.640889:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626832000 00000100:00100000:0.0:1746143785.640892:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626832000 00000100:00100000:3.0:1746143785.640903:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143785.640926:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626832384 00000100:00100000:0.0:1746143785.640928:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626832384 00000100:00100000:0.0:1746143785.640940:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626832256 00000100:00100000:0.0:1746143785.640942:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626832256 00000100:00100000:0.0:1746143785.640951:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626832768 00000100:00100000:3.0:1746143785.640953:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b99f1f93-ef24-4932-a1b4-452b64359da1:3773:1830963626831360:0@lo:400:kworker.0 00000100:00100000:0.0:1746143785.640953:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626832768 00000100:00100000:0.0:1746143785.640963:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1746143785.640967:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830963626832000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.640974:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1746143785.640979:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3774:x1830963626832384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.641002:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3774:x1830963626832384:12345-0@lo:400:kworker.0 Request processed in 23us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.641006:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1746143785.641017:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1746143785.641020:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3772:x1830963626832256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.641038:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3772:x1830963626832256:12345-0@lo:400:kworker.0 Request processed in 17us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.641041:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1746143785.641047:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1746143785.641050:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3772:x1830963626832768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.641066:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3772:x1830963626832768:12345-0@lo:400:kworker.0 Request processed in 16us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.641070:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1746143785.641087:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3772:1830963626832256:0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.641094:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3772:1830963626832768:0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.641137:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:3.0:1746143785.641141:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3771:x1830963626831616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.641163:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3771:x1830963626831616:12345-0@lo:400:kworker.0 Request processed in 23us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.641183:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1746143785.641190:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143785.641195:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626832128 00000100:00100000:3.0:1746143785.641197:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626832128 00000100:00100000:1.0:1746143785.641206:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626832640:0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.641212:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:3.0:1746143785.641216:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3771:x1830963626832128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143785.641225:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143785.641237:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3771:x1830963626832128:12345-0@lo:400:kworker.0 Request processed in 20us (47us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.641241:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1746143785.641247:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3771:1830963626831616:0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.641253:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626832640 00000100:00100000:1.0:1746143785.641254:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3771:1830963626832128:0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.641255:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626832640 00000100:00100000:3.0:1746143785.641271:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1746143785.641274:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963626832640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143785.641305:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963626832640:12345-0@lo:400:kworker.0 Request processed in 30us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.641309:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1746143785.641317:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626832640:0@lo:400:kworker.0 00000100:00100000:2.0:1746143785.641655:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963626831744:12345-0@lo:400:kworker.0 Request processed in 797us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.641656:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963626831872:0@lo:400:kworker.0 00000100:00100000:2.0:1746143785.641661:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1746143785.641665:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3774:1830963626832384:0@lo:400:kworker.0 00000100:00080000:2.0:1746143785.641673:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746143785.641674:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626832512:0@lo:400:kworker.0 00000100:00080000:2.0:1746143785.641675:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746143785.641677:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746143785.641678:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143785.641693:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626831744:0@lo:400:kworker.0 00000100:00100000:2.0:1746143785.643123:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626832896:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.643133:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626833024:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.643153:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143785.643665:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.643688:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.643730:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830963626832000:12345-0@lo:400:kworker.0 Request processed in 2760us (3188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.643740:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1746143785.643790:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3774:1830963626832000:0@lo:400:kworker.0 00000100:00100000:2.0:1746143785.643941:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622743808 00000100:00100000:2.0:1746143785.643947:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622743808 00010000:00010000:2.0:1746143785.643975:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf1 expref: 27 pid: 6587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.644000:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622743680 00000100:00100000:2.0:1746143785.644002:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622743680 00000100:00100000:3.0:1746143785.644011:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5873 00010000:00010000:2.0:1746143785.644012:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf8 expref: 285 pid: 6587 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.644018:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+27:2008:x1830963622743808:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.644028:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143785.644031:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5874 00010000:00010000:3.0:1746143785.644034:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf1 expref: 27 pid: 6587 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.644036:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+285:2009:x1830963622743680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.644044:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf1 expref: 27 pid: 6587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.644044:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.644048:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf8 expref: 285 pid: 6587 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.644064:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73aa4a8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf1 expref: 27 pid: 6587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.644162:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf8 expref: 285 pid: 6587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.644176:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717e00/0x87925e4cb73aa4c4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baf8 expref: 285 pid: 6587 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.644199:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.644203:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.644212:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.644217:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.644233:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143785.644250:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.644257:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143785.644272:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+284:2009:x1830963622743680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 236us (583us total) trans 0 rc 0/0 00000004:00200000:1.0:1746143785.644275:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000100:00100000:2.0:1746143785.644278:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5874 00010000:00010000:1.0:1746143785.644416:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73aa57a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb8b expref: 285 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.644444:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb8b expref: 284 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.644451:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143785.644453:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143785.644456:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b200, rc 0) 00000100:00100000:1.0:1746143785.644488:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+284:32427:x1830963622743552:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3942us (4020us total) trans 8589943766 rc 0/0 00000100:00100000:1.0:1746143785.644495:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12991 00010000:00010000:3.0:1746143785.644575:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.644580:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.644600:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:2008:x1830963622743808:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 583us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.644606:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5873 00000100:00100000:0.0:1746143785.671205:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.671370:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622744064 00000100:00100000:1.0:1746143785.671382:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622744064 00000100:00100000:1.0:1746143785.671454:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12992 00000100:00100000:1.0:1746143785.671462:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+26:32430:x1830963622744064:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.671491:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.671511:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa58f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb92 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.671588:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671601:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671611:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671626:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa59d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671630:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671635:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671729:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671737:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671742:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143785.671751:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143785.671824:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671829:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671835:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671841:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671854:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143785.671858:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671865:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671875:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143785.671878:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143785.671882:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671886:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa596 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671903:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671908:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa59d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671944:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa59d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671948:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143785.671950:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa59d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671955:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa59d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671961:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14600) 00010000:00010000:1.0:1746143785.671963:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143785.671965:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa59d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.671969:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa59d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.672002:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa58f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb92 expref: 29 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.672011:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb92 expref: 28 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.672017:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143785.672019:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143785.672021:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31000, rc 0) 00000100:00100000:1.0:1746143785.672077:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:32430:x1830963622744064:12345-192.168.202.3@tcp:101:cat.0 Request processed in 616us (885us total) trans 8589943767 rc 0/0 00000100:00100000:1.0:1746143785.672083:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12992 00000100:00100000:0.0:1746143785.675620:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.675729:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622744320 00000100:00100000:1.0:1746143785.675737:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622744320 00000100:00100000:1.0:1746143785.676401:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4789 00000100:00100000:1.0:1746143785.676409:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+28:32430:x1830963622744320:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143785.676559:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32430:x1830963622744320:12345-192.168.202.3@tcp:35:cat.0 Request processed in 151us (947us total) trans 8589943768 rc 0/0 00000100:00100000:1.0:1746143785.676565:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4789 00000100:00100000:0.0:1746143785.681185:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.681335:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622744448 00000100:00100000:2.0:1746143785.681346:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622744448 00000100:00100000:2.0:1746143785.681410:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12374 00000100:00100000:2.0:1746143785.681419:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622744448:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143785.681500:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.681533:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622744576 00000100:00100000:3.0:1746143785.681537:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622744576 00000100:00100000:1.0:1746143785.681543:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.681556:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622744704 00000100:00100000:3.0:1746143785.681558:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622744704 00000100:00100000:1.0:1746143785.681570:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12375 00000100:00100000:3.0:1746143785.681579:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12376 00000100:00100000:3.0:1746143785.681607:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:32427:x1830963622744704:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:1.0:1746143785.681608:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622744576:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143785.681618:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.681618:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.681635:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bba7 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.681635:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bba0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.681658:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.681660:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.681667:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba0 expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.681684:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 44 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.681691:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 44 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.681694:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.681702:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba0 expref: 16 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.681706:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84e800/0x87925e4cb73aa5c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bb99 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.681707:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143785.681708:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143785.681711:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 44 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.681746:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626833152:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143785.681855:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba0 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.681863:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba0 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143785.681872:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30600, rc 0) 00010000:00010000:3.0:1746143785.681877:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba0 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.681886:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba0 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143785.681894:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626833280:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.681995:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622744576:12345-192.168.202.3@tcp:101:cat.0 Request processed in 418us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.682001:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12375 00000100:00100000:2.0:1746143785.682068:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a480 going to sleep for 11 seconds 00010000:00010000:3.0:1746143785.682074:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 44 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.682082:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 44 pid: 3135 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.682090:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626833408:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.682113:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 44 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.682123:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 44 pid: 3134 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.682130:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626833536:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.682143:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854480 going to sleep for 11 seconds 00002000:00010000:2.0:1746143785.684977:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime: 1746143785 -> 1746143786 00000100:00100000:2.0:1746143785.685005:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626833152:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143785.685038:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84e800/0x87925e4cb73aa5c0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb99 expref: 18 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.685050:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84e800/0x87925e4cb73aa5c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb99 expref: 18 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.685068:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e800, rc 0) 00000100:00100000:2.0:1746143785.685120:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622744448:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3702us (3947us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143785.685129:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12374 00000100:00100000:3.0:1746143785.686389:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626833280:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.686400:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626833408:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.686407:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626833536:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.686430:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 44 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.686445:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085a00, rc 0) 00000100:00100000:3.0:1746143785.686482:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:32427:x1830963622744704:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4896us (4937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.686489:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12376 00000100:00100000:0.0:1746143785.687407:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.687512:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622744832 00000100:00100000:3.0:1746143785.687523:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622744832 00010000:00010000:3.0:1746143785.687585:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba0 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143785.687652:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5875 00000100:00100000:3.0:1746143785.687658:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622744832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.687671:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.687686:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba0 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.687693:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba0 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.687712:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30600/0x87925e4cb73aa5b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba0 expref: 16 pid: 12327 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.687733:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.687764:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2008:x1830963622744832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.687768:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5875 00000100:00100000:0.0:1746143785.689758:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.689857:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.690038:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622745088 00000100:00100000:2.0:1746143785.690048:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622745088 00010000:00010000:2.0:1746143785.690082:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 44 pid: 3134 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.690107:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622745216 00000100:00100000:2.0:1746143785.690109:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622745216 00010000:00010000:2.0:1746143785.690117:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 45 pid: 3135 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.690148:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5876 00000100:00100000:2.0:1746143785.690155:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963622745088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.690170:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.690192:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 45 pid: 3134 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.690203:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 45 pid: 3134 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.690224:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73aa55e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb6f expref: 45 pid: 3134 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.690244:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.690282:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963622745088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 127us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.690287:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5876 00000100:00100000:2.0:1746143785.690341:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5877 00000100:00100000:2.0:1746143785.690346:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622745216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.690353:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.690359:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 43 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.690368:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 43 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.690378:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73aa573 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb84 expref: 43 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.690388:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.690390:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.690396:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 42 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.690404:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 42 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.690434:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 42 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.690447:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626833664:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143785.690498:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.692139:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626833664:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143785.692158:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.692202:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622745216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1854us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.692212:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5877 00000100:00100000:1.0:1746143785.692584:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.693395:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622745472 00000100:00100000:3.0:1746143785.693404:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622745472 00002000:00100000:3.0:1746143785.693447:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2707456->2711551) req@ffff88012b7e0e00 x1830963622745472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.693457:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e0e00 with x1830963622745472 ext(2707456->2711551) 00002000:00010000:3.0:1746143785.693461:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e0e00 00000100:00100000:3.0:1746143785.693517:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3668 00000100:00100000:3.0:1746143785.693524:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622745472:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143785.693667:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622745472:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 143us (1083us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143785.693673:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3668 00002000:00100000:3.0:1746143785.693678:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2707456->2711551) req@ffff88012b7e0e00 x1830963622745472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.693690:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7e0e00 with x1830963622745472 ext(2707456->2711551) 00002000:00010000:3.0:1746143785.693692:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7e0e00 00000100:00100000:2.0:1746143785.694751:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.695594:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.695748:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622745600 00000100:00100000:3.0:1746143785.695756:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622745600 00000100:00100000:3.0:1746143785.696037:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622745728 00000100:00100000:3.0:1746143785.696040:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622745728 00000100:00100000:3.0:1746143785.696479:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12377 00000100:00100000:3.0:1746143785.696488:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622745600:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143785.696505:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143785.696523:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73aa5c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbae expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.696632:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12378 00000100:00100000:1.0:1746143785.696644:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622745728:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.696653:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.696663:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbb5 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.696723:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626833792:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143785.696880:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626833920:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143785.697275:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143785.697460:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854480 going to sleep for 11 seconds 00002000:00010000:3.0:1746143785.700974:0:1947:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime: 1746143785 -> 1746143786 00002000:00010000:3.0:1746143785.700982:0:1947:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime: 1746143785 -> 1746143786 00000100:00100000:3.0:1746143785.701008:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963626833920:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143785.701040:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73aa5c7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbae expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.701053:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73aa5c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbae expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.701074:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084a00, rc 0) 00000100:00100000:3.0:1746143785.701124:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2011:x1830963622745600:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4637us (6375us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143785.701133:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12377 00002000:00010000:1.0:1746143785.701320:0:3134:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime: 1746143785 -> 1746143786 00002000:00010000:1.0:1746143785.701324:0:3134:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime: 1746143785 -> 1746143786 00002000:00010000:1.0:1746143785.701326:0:3134:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime: 1746143785 -> 1746143786 00000100:00100000:1.0:1746143785.701337:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626833792:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143785.701357:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ce lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbb5 expref: 16 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.701365:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbb5 expref: 16 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.701384:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:1.0:1746143785.701403:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2011:x1830963622745728:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4761us (5810us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143785.701407:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12378 00000100:00100000:0.0:1746143785.705311:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.705488:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622745856 00000100:00100000:1.0:1746143785.705499:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622745856 00000100:00100000:1.0:1746143785.705563:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12379 00000100:00100000:1.0:1746143785.705572:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:32430:x1830963622745856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.705594:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.705615:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbbc expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.705652:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.705661:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143785.705663:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143785.705668:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.705703:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.705885:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 22 pid: 3135 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143785.705899:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626834048:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.706253:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.708507:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.708553:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626834048:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.708591:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.708609:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30c00, rc 0) 00000100:00100000:1.0:1746143785.708665:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32430:x1830963622745856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3092us (3364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.708674:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12379 00000100:00100000:3.0:1746143785.708766:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622745984 00000100:00100000:3.0:1746143785.708773:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622745984 00002000:00100000:3.0:1746143785.708814:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3629055) req@ffff880090e58a80 x1830963622745984/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.708822:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58a80 with x1830963622745984 ext(3145728->3629055) 00010000:00010000:3.0:1746143785.708829:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 23 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.708840:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 23 pid: 3135 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143785.708858:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e58a80 00000100:00100000:3.0:1746143785.708887:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1500 00000100:00100000:3.0:1746143785.708894:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963622745984:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143785.714718:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963622745984:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5816us (6211us total) trans 21474840435 rc 0/0 00000100:00100000:3.0:1746143785.714729:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1500 00002000:00100000:3.0:1746143785.714740:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->3629055) req@ffff880090e58a80 x1830963622745984/t21474840435(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/448 e 0 to 0 dl 1746143796 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.714748:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58a80 with x1830963622745984 ext(3145728->3629055) 00010000:00010000:3.0:1746143785.714756:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 25 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.714775:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 25 pid: 3135 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143785.714781:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e58a80 00000100:00100000:0.0:1746143785.722839:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.722973:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622746112 00000100:00100000:2.0:1746143785.722986:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622746112 00010000:00010000:2.0:1746143785.723035:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 25 pid: 3135 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143785.723074:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5878 00000100:00100000:2.0:1746143785.723084:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963622746112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.723099:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.723122:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 25 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.723134:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 25 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.723157:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa565 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3629055) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb76 expref: 25 pid: 3135 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143785.723195:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.723197:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.723205:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.723217:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.723252:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.723265:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626834176:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143785.723358:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.725343:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626834176:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143785.725366:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.725406:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622746112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2323us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.725417:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5878 00000100:00100000:0.0:1746143785.727527:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.727618:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622746368 00000100:00100000:3.0:1746143785.727628:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622746368 00002000:00100000:3.0:1746143785.727681:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880090e5aa00 x1830963622746368/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.727692:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5aa00 with x1830963622746368 ext(2097152->3145727) 00002000:00010000:3.0:1746143785.727698:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e5aa00 00000100:00100000:3.0:1746143785.727737:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3669 00000100:00100000:3.0:1746143785.727745:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622746368:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143785.736635:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622746368:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8882us (9110us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143785.736644:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3669 00002000:00100000:3.0:1746143785.736653:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->3145727) req@ffff880090e5aa00 x1830963622746368/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.736661:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5aa00 with x1830963622746368 ext(2097152->3145727) 00002000:00010000:3.0:1746143785.736666:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e5aa00 00000100:00100000:0.0:1746143785.741481:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.741692:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622746624 00000100:00100000:1.0:1746143785.741700:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622746624 00000100:00100000:1.0:1746143785.741753:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12993 00000100:00100000:1.0:1746143785.741760:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:32433:x1830963622746624:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143785.741780:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.741796:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa5dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbc3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.741889:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.741900:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.741933:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.741945:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.741950:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.741956:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742094:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7cc00/0x87925e4cb73aa5f1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742103:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7cc00/0x87925e4cb73aa5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742109:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7cc00/0x87925e4cb73aa5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143785.742115:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143785.742175:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742181:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742189:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742195:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742200:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143785.742203:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742208:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742216:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143785.742219:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143785.742222:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742226:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73aa5e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742246:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742250:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742254:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742258:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143785.742260:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742267:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143785.742466:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.742518:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622746752 00000100:00100000:0.0:1746143785.742522:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622746752 00000100:00100000:0.0:1746143785.742544:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12380 00000100:00100000:0.0:1746143785.742549:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:32430:x1830963622746752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143785.742556:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143785.742564:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbca expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.742581:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 41 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.742587:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143785.742589:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143785.742591:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 16 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.742613:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 41 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.742622:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 41 pid: 1947 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143785.742632:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626834304:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143785.742689:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fd80 going to sleep for 11 seconds 00010000:00010000:1.0:1746143785.742726:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14d00) 00010000:00010000:1.0:1746143785.742729:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143785.742731:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742736:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73aa5ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.742767:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73aa5dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbc3 expref: 32 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.743116:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7cc00/0x87925e4cb73aa5f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbc3 expref: 31 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.743122:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143785.743124:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143785.743125:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7cc00, rc 0) 00000100:00100000:1.0:1746143785.743147:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:32433:x1830963622746624:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1388us (1674us total) trans 8589943769 rc 0/0 00000100:00100000:1.0:1746143785.743153:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12993 00000100:00100000:2.0:1746143785.745163:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963626834304:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.745187:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 16 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.745197:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635000, rc 0) 00000100:00100000:2.0:1746143785.745233:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:32430:x1830963622746752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2683us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.745240:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12380 00000100:00100000:0.0:1746143785.745890:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.745931:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622746880 00000100:00100000:3.0:1746143785.745938:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622746880 00002000:00100000:3.0:1746143785.745966:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2707456->3145727) req@ffff880090e5a300 x1830963622746880/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.745980:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5a300 with x1830963622746880 ext(2707456->3145727) 00010000:00010000:3.0:1746143785.745986:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 42 pid: 1947 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.745998:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 42 pid: 1947 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143785.746005:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e5a300 00000100:00100000:3.0:1746143785.746154:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1501 00000100:00100000:3.0:1746143785.746161:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963622746880:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143785.754540:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.754684:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622747008 00000100:00100000:3.0:1746143785.754691:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622747008 00000100:00100000:3.0:1746143785.754732:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 763 00000100:00100000:3.0:1746143785.754739:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2008:x1830963622747008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.754749:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.754986:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7cc00/0x87925e4cb73aa5f1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbc3 expref: 31 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.755016:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.755020:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.755053:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622747008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 314us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.755059:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 763 00000100:00100000:3.0:1746143785.759963:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622746880:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 13793us (14065us total) trans 17179873107 rc 0/0 00000100:00100000:3.0:1746143785.759977:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1501 00002000:00100000:3.0:1746143785.759987:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2707456->3145727) req@ffff880090e5a300 x1830963622746880/t17179873107(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/448 e 0 to 0 dl 1746143796 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.759995:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5a300 with x1830963622746880 ext(2707456->3145727) 00010000:00010000:3.0:1746143785.760003:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 44 pid: 1947 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.760016:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 44 pid: 1947 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143785.760022:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e5a300 00000100:00100000:0.0:1746143785.763317:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.763810:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622747136 00000100:00100000:2.0:1746143785.763817:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622747136 00010000:00010000:2.0:1746143785.763862:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 44 pid: 1947 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143785.764001:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5879 00000100:00100000:3.0:1746143785.764010:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622747136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.764023:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.764041:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 44 pid: 1947 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.764056:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 44 pid: 1947 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.764075:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082085a00/0x87925e4cb73aa5b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bba7 expref: 44 pid: 1947 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143785.764102:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.764107:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.764114:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 15 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.764121:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 15 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.764149:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 15 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.764160:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626834432:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143785.764218:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.764228:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.764354:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622747264 00000100:00100000:2.0:1746143785.764358:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622747264 00000100:00100000:2.0:1746143785.764382:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12381 00000100:00100000:2.0:1746143785.764387:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32433:x1830963622747264:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143785.764399:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.764410:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbd1 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.764427:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73aa4e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb14 expref: 19 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.764433:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73aa511 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb3e expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.764437:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.764438:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.764441:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [1724416->2043903] (req 1724416->2043903) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 19 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.764456:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73aa511 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb3e expref: 23 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.764465:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73aa511 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb3e expref: 23 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.764472:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626834560:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.764502:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73aa4e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb14 expref: 19 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.764509:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73aa4e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb14 expref: 19 pid: 1947 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.764516:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626834688:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.764529:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.767331:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.767361:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.767487:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963626834432:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143785.767501:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.767534:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622747136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3525us (4222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.767543:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5879 00000100:00100000:3.0:1746143785.767572:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622747392 00000100:00100000:3.0:1746143785.767576:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622747392 00010000:00010000:3.0:1746143785.767595:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73aa4e7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb14 expref: 20 pid: 1947 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143785.767611:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622747520 00000100:00100000:3.0:1746143785.767613:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622747520 00010000:00010000:3.0:1746143785.767620:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73aa511 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb3e expref: 24 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143785.767632:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5880 00000100:00100000:3.0:1746143785.767637:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622747392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.767653:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.767668:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73aa4e7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb14 expref: 20 pid: 1947 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.767676:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73aa4e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb14 expref: 20 pid: 1947 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.767694:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.767708:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622747392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 71us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.767712:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5880 00000100:00100000:3.0:1746143785.767722:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5881 00000100:00100000:3.0:1746143785.767727:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622747520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.767732:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.767737:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73aa511 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb3e expref: 24 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.767745:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73aa511 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb3e expref: 24 pid: 9839 timeout: 944 lvb_type: 1 00010000:00010000:3.0:1746143785.767754:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.767756:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.767761:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 19 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.767768:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 19 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.767795:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 19 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.767805:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626834816:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143785.767859:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854480 going to sleep for 11 seconds 00010000:00010000:2.0:1746143785.768284:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73aa511 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb3e expref: 24 pid: 9839 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.768308:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626834560:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.768317:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73aa4e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb14 expref: 19 pid: 1947 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143785.768324:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963626834688:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.768340:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.768352:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f200, rc 0) 00000100:00100000:2.0:1746143785.768732:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:32433:x1830963622747264:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4343us (4512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.768739:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12381 00000100:00100000:0.0:1746143785.771736:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.771818:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626834816:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143785.771832:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.771884:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622747520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4155us (4521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.771893:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5881 00000100:00100000:2.0:1746143785.772222:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622747776 00000100:00100000:2.0:1746143785.772228:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622747776 00002000:00100000:2.0:1746143785.772259:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1724416->1728511) req@ffff880095c31f80 x1830963622747776/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.772268:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c31f80 with x1830963622747776 ext(1724416->1728511) 00002000:00010000:2.0:1746143785.772272:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c31f80 00000100:00100000:2.0:1746143785.772297:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3670 00000100:00100000:2.0:1746143785.772304:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622747776:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143785.772400:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622747776:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 96us (671us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143785.772406:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3670 00002000:00100000:2.0:1746143785.772411:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b5:0x0] (1724416->1728511) req@ffff880095c31f80 x1830963622747776/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.772418:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c31f80 with x1830963622747776 ext(1724416->1728511) 00002000:00010000:2.0:1746143785.772420:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c31f80 00000100:00100000:0.0:1746143785.773261:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.773318:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.773387:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622748032 00000100:00100000:2.0:1746143785.773391:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622748032 00002000:00100000:2.0:1746143785.773407:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095c32a00 x1830963622748032/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.773420:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32a00 with x1830963622748032 ext(2097152->4194303) 00002000:00010000:2.0:1746143785.773423:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c32a00 00000100:00100000:2.0:1746143785.773433:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622748288 00000100:00100000:2.0:1746143785.773435:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622748288 00002000:00100000:2.0:1746143785.773443:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095c33800 x1830963622748288/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.773449:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33800 with x1830963622748288 ext(3145728->4194303) 00002000:00010000:2.0:1746143785.773452:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c33800 00000100:00100000:2.0:1746143785.773473:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3671 00000100:00100000:2.0:1746143785.773478:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622748032:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143785.774101:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3672 00000100:00100000:1.0:1746143785.774109:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622748288:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143785.780281:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.781650:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622748544 00000100:00100000:2.0:1746143785.781659:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622748544 00002000:00100000:2.0:1746143785.781695:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (2039808->2043903) req@ffff880095c33b80 x1830963622748544/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.781703:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33b80 with x1830963622748544 ext(2039808->2043903) 00002000:00010000:2.0:1746143785.781708:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c33b80 00000100:00100000:2.0:1746143785.781740:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3673 00000100:00100000:2.0:1746143785.781747:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622748544:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143785.781868:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622748544:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 122us (1595us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143785.781873:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3673 00002000:00100000:2.0:1746143785.781878:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b5:0x0] (2039808->2043903) req@ffff880095c33b80 x1830963622748544/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/4536 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.781889:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33b80 with x1830963622748544 ext(2039808->2043903) 00002000:00010000:2.0:1746143785.781892:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c33b80 00000100:00100000:0.0:1746143785.783284:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626834944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143785.783328:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143785.783373:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626834944 00000100:00100000:2.0:1746143785.783377:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626834944 00000100:00100000:2.0:1746143785.783401:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1746143785.783407:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626834944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746143785.783420:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1017233472 pending 5140480 free 3914395648 avail 3682873344 00000100:00100000:2.0:1746143785.783449:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963626834944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.783454:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:0.0:1746143785.784094:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626834944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746143785.786942:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2009:x1830963622748032:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 13458us (13676us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143785.786951:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3671 00002000:00100000:2.0:1746143785.786960:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff880095c32a00 x1830963622748032/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.786968:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32a00 with x1830963622748032 ext(2097152->4194303) 00002000:00010000:2.0:1746143785.786972:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c32a00 00000100:00100000:0.0:1746143785.791500:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.791665:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622748288:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 17556us (18345us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143785.791675:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3672 00002000:00100000:1.0:1746143785.791684:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (3145728->4194303) req@ffff880095c33800 x1830963622748288/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.791697:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33800 with x1830963622748288 ext(3145728->4194303) 00002000:00010000:1.0:1746143785.791702:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c33800 00000100:00100000:1.0:1746143785.791727:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622748800 00000100:00100000:1.0:1746143785.791733:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622748800 00002000:00100000:1.0:1746143785.791760:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095c30380 x1830963622748800/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.791766:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30380 with x1830963622748800 ext(4194304->4968447) 00002000:00010000:1.0:1746143785.791769:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c30380 00000100:00100000:1.0:1746143785.791795:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3674 00000100:00100000:1.0:1746143785.791801:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622748800:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143785.793649:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.793705:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622749056 00000100:00100000:3.0:1746143785.793710:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622749056 00000100:00100000:3.0:1746143785.793748:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4790 00000100:00100000:3.0:1746143785.793754:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:32433:x1830963622749056:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143785.793943:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:32433:x1830963622749056:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 189us (298us total) trans 8589943770 rc 0/0 00000100:00100000:3.0:1746143785.793949:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4790 00000100:00100000:1.0:1746143785.798101:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622748800:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 6292us (6599us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746143785.798111:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3674 00002000:00100000:1.0:1746143785.798122:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff880095c30380 x1830963622748800/t0(0) o3->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 774144/774144 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.798130:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30380 with x1830963622748800 ext(4194304->4968447) 00002000:00010000:1.0:1746143785.798135:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c30380 00000100:00100000:2.0:1746143785.799032:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143785.799045:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626835072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746143785.799080:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143785.799157:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626835072 00000100:00100000:3.0:1746143785.799163:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626835072 00000100:00100000:3.0:1746143785.799188:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1746143785.799194:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963626835072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746143785.799210:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1015094464 pending 3002368 free 3912818688 avail 3681296384 00000100:00100000:3.0:1746143785.799236:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963626835072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.799245:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1746143785.799322:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626835072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143785.815549:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.815816:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622749312 00000100:00100000:1.0:1746143785.815825:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622749312 00000100:00100000:1.0:1746143785.815887:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12994 00000100:00100000:1.0:1746143785.815895:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+284:32438:x1830963622749312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.815936:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.815952:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73aa60d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbd8 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.816010:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816021:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816032:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816042:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73aa61b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816047:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73aa61b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816051:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73aa61b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816134:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816148:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816154:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143785.816162:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143785.816218:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816224:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816235:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816241:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816246:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913b7400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143785.816249:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816255:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816264:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143785.816266:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143785.816269:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816274:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7400/0x87925e4cb73aa614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816300:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73aa61b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816305:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73aa61b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816310:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73aa61b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816314:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913b7c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143785.816317:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73aa61b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816325:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73aa61b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816331:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14100) 00010000:00010000:1.0:1746143785.816333:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143785.816335:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73aa61b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816339:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73aa61b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.816370:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6a00/0x87925e4cb73aa60d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd8 expref: 287 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.816379:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd8 expref: 286 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.816385:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143785.816387:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143785.816389:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7000, rc 0) 00000100:00100000:1.0:1746143785.816433:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+286:32438:x1830963622749312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 538us (891us total) trans 8589943771 rc 0/0 00000100:00100000:1.0:1746143785.816439:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12994 00000100:00100000:2.0:1746143785.817382:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746143785.817396:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626835200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746143785.817437:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143785.817680:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626835200 00000100:00100000:3.0:1746143785.817686:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626835200 00000100:00100000:3.0:1746143785.817711:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1746143785.817717:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3772:x1830963626835200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746143785.817738:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445318656 avail 1315856384 00000100:00100000:3.0:1746143785.817992:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3772:x1830963626835200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 275us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.817998:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1746143785.818026:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963626835200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143785.819668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.819753:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622749568 00000100:00100000:1.0:1746143785.819758:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622749568 00000100:00100000:1.0:1746143785.820146:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4791 00000100:00100000:1.0:1746143785.820154:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+286:32438:x1830963622749568:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143785.820306:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+287:32438:x1830963622749568:12345-192.168.202.3@tcp:35:cat.0 Request processed in 152us (642us total) trans 8589943772 rc 0/0 00000100:00100000:1.0:1746143785.820312:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4791 00000100:00100000:0.0:1746143785.827575:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.827598:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.827627:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.827643:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622749696 00000100:00100000:1.0:1746143785.827651:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622749696 00000100:00100000:1.0:1746143785.827682:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622749824 00000100:00100000:1.0:1746143785.827683:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622749824 00000100:00100000:1.0:1746143785.827701:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622749952 00000100:00100000:1.0:1746143785.827703:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622749952 00000100:00100000:0.0:1746143785.827709:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12382 00000100:00100000:0.0:1746143785.827717:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622749696:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143785.827723:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12383 00000100:00100000:1.0:1746143785.827728:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622749824:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143785.827730:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.827735:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.827742:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73aa637 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbe6 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.827742:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73aa630 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbdf expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.827758:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.827760:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.827767:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73aa637 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbe6 expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.827780:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73aa637 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbe6 expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143785.827781:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626835328:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143785.827789:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7e00, rc 0) 00000100:00100000:1.0:1746143785.827823:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622749824:12345-192.168.202.3@tcp:101:cat.0 Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.827829:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12383 00000100:00100000:1.0:1746143785.827842:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12384 00000100:00100000:1.0:1746143785.827858:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963622749952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143785.827870:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.827879:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73aa63e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbed expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.827889:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.827890:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.827895:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73aa63e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbed expref: 44 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.827905:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73aa63e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbed expref: 44 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.827928:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6c00, rc 0) 00000100:00100000:1.0:1746143785.827944:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963622749952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 87us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.827949:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12384 00000100:00100000:0.0:1746143785.828781:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f3c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746143785.829663:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime: 1746143781 -> 1746143786 00002000:00010000:2.0:1746143785.829666:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime: 1746143781 -> 1746143786 00002000:00010000:2.0:1746143785.829668:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime: 1746143781 -> 1746143786 00000100:00100000:2.0:1746143785.829685:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626835328:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143785.829711:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73aa630 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbdf expref: 25 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.829722:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2200/0x87925e4cb73aa630 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbdf expref: 25 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.830116:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2200, rc 0) 00000100:00100000:2.0:1746143785.830151:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963622749696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2435us (2582us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143785.830158:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12382 00000100:00100000:0.0:1746143785.838593:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.838665:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622750080 00000100:00100000:2.0:1746143785.838673:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622750080 00000100:00100000:2.0:1746143785.838724:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12385 00000100:00100000:2.0:1746143785.838732:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:32438:x1830963622750080:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143785.838747:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.838762:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbf4 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.838978:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.838986:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143785.838988:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143785.838991:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.839018:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.839029:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 17 pid: 3134 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143785.839039:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626835456:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.839665:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00010000:00010000:3.0:1746143785.843363:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143785.843525:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.843575:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622750208 00000100:00100000:1.0:1746143785.843582:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622750208 00002000:00100000:1.0:1746143785.843618:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b5:0x0] (1724416->2043903) req@ffff880129dc1f80 x1830963622750208/t0(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143785.843627:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1f80 with x1830963622750208 ext(1724416->2043903) 00010000:00010000:1.0:1746143785.843634:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 18 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143785.843646:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 18 pid: 3134 timeout: 945 lvb_type: 0 00002000:00010000:1.0:1746143785.843657:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129dc1f80 00000100:00100000:1.0:1746143785.843673:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1502 00000100:00100000:1.0:1746143785.843680:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2008:x1830963622750208:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143785.844062:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626835456:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.844090:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.844101:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e000, rc 0) 00000100:00100000:2.0:1746143785.844132:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:32438:x1830963622750080:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5401us (5546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.844138:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12385 00000100:00100000:2.0:1746143785.849454:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2008:x1830963622750208:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5766us (5927us total) trans 21474840436 rc 0/0 00000100:00100000:2.0:1746143785.849464:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1502 00002000:00100000:2.0:1746143785.849473:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b5:0x0] (1724416->2043903) req@ffff880129dc1f80 x1830963622750208/t21474840436(0) o4->4eb7703a-89bc-4175-88ce-3d4319e2cc6f@192.168.202.3@tcp:181/0 lens 488/448 e 0 to 0 dl 1746143796 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.849482:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1f80 with x1830963622750208 ext(1724416->2043903) 00010000:00010000:2.0:1746143785.849491:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 20 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.849505:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 20 pid: 3134 timeout: 945 lvb_type: 0 00002000:00010000:2.0:1746143785.849512:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129dc1f80 00000100:00100000:0.0:1746143785.852391:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.852612:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622750336 00000100:00100000:3.0:1746143785.852620:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622750336 00010000:00010000:3.0:1746143785.852649:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 20 pid: 3134 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143785.852684:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5882 00000100:00100000:3.0:1746143785.852691:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2010:x1830963622750336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.852702:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.852717:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 20 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143785.852727:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 20 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143785.852744:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa606 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->2043903) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd1 expref: 20 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143785.852762:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.852764:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.852769:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.852776:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.852802:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.852813:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626835584:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143785.853423:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143785.856444:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963626835584:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143785.856461:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.856503:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2010:x1830963622750336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3812us (4118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.856512:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5882 00000100:00100000:0.0:1746143785.858489:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.858548:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622750592 00000100:00100000:2.0:1746143785.858555:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622750592 00002000:00100000:2.0:1746143785.858590:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880129dc3800 x1830963622750592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.858598:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc3800 with x1830963622750592 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.858602:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc3800 00000100:00100000:2.0:1746143785.858632:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3675 00000100:00100000:2.0:1746143785.858639:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622750592:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.866730:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622750592:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8079us (8233us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143785.866742:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3675 00002000:00100000:2.0:1746143785.866751:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b5:0x0] (1048576->2097151) req@ffff880129dc3800 x1830963622750592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.866762:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc3800 with x1830963622750592 ext(1048576->2097151) 00002000:00010000:2.0:1746143785.866767:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc3800 00000100:00100000:0.0:1746143785.886014:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.886106:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622750848 00000100:00100000:2.0:1746143785.886114:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622750848 00002000:00100000:2.0:1746143785.886155:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880129dc2d80 x1830963622750848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.886170:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2d80 with x1830963622750848 ext(2097152->4194303) 00002000:00010000:2.0:1746143785.886175:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc2d80 00000100:00100000:0.0:1746143785.886338:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.886667:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622751104 00000100:00100000:2.0:1746143785.886674:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622751104 00000100:00100000:3.0:1746143785.886686:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3676 00000100:00100000:3.0:1746143785.886693:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622750848:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143785.886698:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8801368e8e00 x1830963622751104/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.886704:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8e00 with x1830963622751104 ext(2097152->4194303) 00002000:00010000:2.0:1746143785.886707:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8e00 00000100:00100000:2.0:1746143785.886732:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3677 00000100:00100000:2.0:1746143785.886737:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622751104:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143785.910787:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622751104:12345-192.168.202.3@tcp:3:cat.0 Request processed in 24040us (24440us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143785.910798:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3677 00002000:00100000:2.0:1746143785.910809:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x397:0x0] (2097152->4194303) req@ffff8801368e8e00 x1830963622751104/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143785.910818:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8e00 with x1830963622751104 ext(2097152->4194303) 00002000:00010000:2.0:1746143785.910823:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8e00 00000100:00100000:3.0:1746143785.914109:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622750848:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27408us (28095us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143785.914119:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3676 00002000:00100000:3.0:1746143785.914128:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (2097152->4194303) req@ffff880129dc2d80 x1830963622750848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.914138:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2d80 with x1830963622750848 ext(2097152->4194303) 00002000:00010000:3.0:1746143785.914142:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc2d80 00000100:00100000:0.0:1746143785.922341:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.922449:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622751360 00000100:00100000:3.0:1746143785.922458:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622751360 00002000:00100000:3.0:1746143785.922501:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8801368e9180 x1830963622751360/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/0 e 0 to 0 dl 1746143796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.922510:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9180 with x1830963622751360 ext(4194304->4968447) 00002000:00010000:3.0:1746143785.922514:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9180 00000100:00100000:3.0:1746143785.922549:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3678 00000100:00100000:3.0:1746143785.922556:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963622751360:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143785.930074:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963622751360:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7509us (7731us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143785.930084:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3678 00002000:00100000:3.0:1746143785.930094:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3b6:0x0] (4194304->4968447) req@ffff8801368e9180 x1830963622751360/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:181/0 lens 488/440 e 0 to 0 dl 1746143796 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143785.930103:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9180 with x1830963622751360 ext(4194304->4968447) 00002000:00010000:3.0:1746143785.930107:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9180 00000100:00100000:0.0:1746143785.948202:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.948291:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622751488 00000100:00100000:1.0:1746143785.948298:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622751488 00000100:00100000:1.0:1746143785.948346:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12995 00000100:00100000:1.0:1746143785.948353:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:32442:x1830963622751488:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143785.948407:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.948584:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa64c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bbfb expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.948633:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.948644:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.948653:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.948664:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73aa65a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.948670:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73aa65a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.948674:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73aa65a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.948733:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.948742:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb8b expref: 286 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.948748:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.948775:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb8b expref: 286 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.948785:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb8b expref: 286 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143785.948796:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626835712:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.948895:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143785.953638:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626835712:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.953662:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143785.953757:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.954106:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622751744 00000100:00100000:3.0:1746143785.954114:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622751744 00000100:00100000:3.0:1746143785.954164:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4792 00000100:00100000:3.0:1746143785.954171:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+287:8585:x1830963622751744:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143785.954884:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+288:8585:x1830963622751744:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 711us (1125us total) trans 8589943773 rc 0/0 00000100:00100000:3.0:1746143785.954895:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4792 00000100:00100000:0.0:1746143785.957385:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.957468:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622751872 00000100:00100000:3.0:1746143785.957475:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622751872 00010000:00010000:3.0:1746143785.957506:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb8b expref: 288 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143785.958164:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5883 00000100:00100000:2.0:1746143785.958179:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+288:2008:x1830963622751872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.958191:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.958197:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb8b expref: 288 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.958211:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb8b expref: 288 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.958231:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b200/0x87925e4cb73aa581 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb8b expref: 288 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.958267:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.958272:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.958279:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.958285:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.958302:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143785.958312:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958321:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143785.958342:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+287:2008:x1830963622751872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 165us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.958348:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5883 00000004:00200000:1.0:1746143785.958370:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:1.0:1746143785.958375:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143785.958390:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958400:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958409:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958414:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958419:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958424:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958429:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2db400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143785.958432:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958437:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958445:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143785.958448:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143785.958451:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958455:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73aa653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958484:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73aa65a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958493:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73aa65a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958498:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73aa65a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958502:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7c000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143785.958504:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73aa65a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958509:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73aa65a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958516:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14b00) 00010000:00010000:1.0:1746143785.958517:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143785.958520:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73aa65a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958523:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c000/0x87925e4cb73aa65a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.958552:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa64c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbfb expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.958562:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbfb expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.958568:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143785.958569:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143785.958571:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c400, rc 0) 00000100:00100000:1.0:1746143785.958594:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:32442:x1830963622751488:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 10241us (10400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.958601:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12995 00000100:00100000:0.0:1746143785.962538:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.962574:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.962595:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.962608:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.962619:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622752000 00000100:00100000:0.0:1746143785.962623:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.962624:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622752128 00000100:00100000:2.0:1746143785.962627:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622752000 00000100:00100000:3.0:1746143785.962629:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622752128 00000100:00100000:0.0:1746143785.962657:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.962669:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622752256 00000100:00100000:3.0:1746143785.962671:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622752256 00000100:00100000:1.0:1746143785.962674:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622752384 00000100:00100000:1.0:1746143785.962677:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622752384 00000100:00100000:3.0:1746143785.962682:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622752512 00000100:00100000:3.0:1746143785.962684:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622752512 00000100:00100000:3.0:1746143785.962693:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622752640 00000100:00100000:3.0:1746143785.962695:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622752640 00000100:00100000:3.0:1746143785.962709:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12386 00000100:00100000:3.0:1746143785.962715:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622752128:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:1.0:1746143785.962716:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12387 00000100:00100000:1.0:1746143785.962723:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622752256:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143785.962728:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143785.962729:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12388 00010000:00010000:1.0:1746143785.962730:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143785.962736:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622752512:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143785.962741:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73aa66f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc10 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.962742:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73aa668 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc09 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.962745:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143785.962753:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73aa676 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc1e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.962759:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.962759:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.962760:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.962760:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.962764:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.962765:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.962767:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73aa668 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc09 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.962767:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73aa66f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc10 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.962769:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73aa676 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc1e expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.962778:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73aa66f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc10 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.962778:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73aa676 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc1e expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.962779:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73aa668 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc09 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.962786:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb5a00, rc 0) 00010000:00010000:3.0:1746143785.962787:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0ac00, rc 0) 00010000:00010000:1.0:1746143785.962787:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7cc00, rc 0) 00000100:00100000:0.0:1746143785.962815:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622752512:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 81us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.962820:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12388 00000100:00100000:3.0:1746143785.962821:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2008:x1830963622752128:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 106us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.962827:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12386 00000100:00100000:0.0:1746143785.962832:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12389 00000100:00100000:0.0:1746143785.962835:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622752384:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:3.0:1746143785.962838:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12390 00010000:00010000:0.0:1746143785.962839:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143785.962856:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622752640:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143785.962857:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73aa67d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc17 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.962860:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622752256:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 137us (262us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143785.962862:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143785.962866:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12387 00010000:00010000:0.0:1746143785.962866:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.962868:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73aa684 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc25 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.962868:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.962872:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73aa67d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc17 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.962877:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.962879:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.962879:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73aa67d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc17 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.962883:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73aa684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc25 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.962885:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4400, rc 0) 00010000:00010000:3.0:1746143785.962891:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73aa684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc25 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.962897:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0a000, rc 0) 00000100:00100000:0.0:1746143785.962900:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622752384:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 64us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143785.962904:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12389 00000100:00100000:3.0:1746143785.962929:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622752640:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 68us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.962934:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12390 00000100:00100000:2.0:1746143785.963153:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12391 00000100:00100000:2.0:1746143785.963158:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2008:x1830963622752000:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143785.963164:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.963170:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73aa68b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc02 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.963180:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.963182:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.963186:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73aa68b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc02 expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.963193:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73aa68b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc02 expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.963200:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ea00, rc 0) 00000100:00100000:2.0:1746143785.963214:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622752000:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 56us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.963791:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12391 00000100:00100000:0.0:1746143785.965645:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.966417:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622752896 00000100:00100000:1.0:1746143785.966425:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622752896 00000100:00100000:1.0:1746143785.966478:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12996 00000100:00100000:1.0:1746143785.966484:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:32442:x1830963622752896:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143785.966501:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143785.966514:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73aa692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc2c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.966589:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.966601:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbfb expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.966608:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143785.966631:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbfb expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.966640:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbfb expref: 16 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143785.966650:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626835840:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.967294:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.969362:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626835840:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.969382:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143785.969476:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.969517:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622753024 00000100:00100000:2.0:1746143785.969522:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622753024 00010000:00010000:2.0:1746143785.969543:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbfb expref: 17 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143785.969573:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5884 00000100:00100000:2.0:1746143785.969580:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2008:x1830963622753024:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.969590:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.969595:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbfb expref: 17 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.969604:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbfb expref: 17 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.969692:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c400/0x87925e4cb73aa661 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbfb expref: 17 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.969713:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.969716:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.969724:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.969728:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.969743:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.969771:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2008:x1830963622753024:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 191us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.969776:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5884 00010000:00010000:2.0:1746143785.969800:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.969805:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143785.969872:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143785.969983:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73aa692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc2c expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.969994:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc2c expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.970003:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.970005:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143785.970007:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ca00, rc 0) 00000100:00100000:2.0:1746143785.970041:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32442:x1830963622752896:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3556us (4402us total) trans 8589943774 rc 0/0 00000100:00100000:2.0:1746143785.970046:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12996 00000100:00100000:0.0:1746143785.971569:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.971615:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622753152 00000100:00100000:2.0:1746143785.971621:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622753152 00000100:00100000:2.0:1746143785.971655:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12997 00000100:00100000:2.0:1746143785.971660:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32442:x1830963622753152:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143785.971671:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.971680:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73aa6a7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc33 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.971727:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.971735:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc2c expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.971741:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.971761:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc2c expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.971770:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc2c expref: 17 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143785.971785:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626835968:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.971861:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.973146:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626835968:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.973163:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143785.973972:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.974019:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622753280 00000100:00100000:3.0:1746143785.974025:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622753280 00010000:00010000:3.0:1746143785.974046:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc2c expref: 18 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143785.974076:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5885 00000100:00100000:3.0:1746143785.974082:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:2009:x1830963622753280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.974094:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.974098:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc2c expref: 18 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143785.974108:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc2c expref: 18 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143785.974126:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73aa699 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc2c expref: 18 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143785.974151:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143785.974155:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143785.974163:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143785.974169:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143785.974183:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.974224:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2009:x1830963622753280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 141us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.974230:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5885 00010000:00010000:2.0:1746143785.974251:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.974257:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143785.974292:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:2.0:1746143785.974296:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143785.974309:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.974331:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73aa6a7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc33 expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.974342:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc33 expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.974347:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.974349:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143785.974351:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f200, rc 0) 00000100:00100000:2.0:1746143785.974373:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32442:x1830963622753152:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2713us (2806us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.974382:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12997 00000100:00100000:0.0:1746143785.977012:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143785.977093:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622753536 00000100:00100000:2.0:1746143785.977100:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622753536 00000100:00100000:2.0:1746143785.977199:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12998 00000100:00100000:2.0:1746143785.977206:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:32442:x1830963622753536:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143785.977222:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143785.977237:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73aa6b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc3a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.977314:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa6bc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.977325:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa6bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143785.977333:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa6bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143785.977342:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:2.0:1746143785.977420:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ee00/0x87925e4cb73aa6b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc3a expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.977434:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa6bc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc3a expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.977440:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143785.977443:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143785.977445:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f400, rc 0) 00000100:00100000:2.0:1746143785.977689:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:32442:x1830963622753536:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 482us (681us total) trans 8589943775 rc 0/0 00000100:00100000:2.0:1746143785.977695:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12998 00000100:00100000:0.0:1746143785.979366:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.979399:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.979424:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.979449:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622753664 00000100:00100000:0.0:1746143785.979450:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.979454:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622753664 00000100:00100000:3.0:1746143785.979484:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622753920 00000100:00100000:3.0:1746143785.979486:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622753920 00000100:00100000:0.0:1746143785.979492:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622754176 00000100:00100000:0.0:1746143785.979494:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622754176 00000100:00100000:3.0:1746143785.979496:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622753792 00000100:00100000:3.0:1746143785.979498:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622753792 00000100:00100000:0.0:1746143785.979520:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12392 00000100:00100000:0.0:1746143785.979526:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622753664:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143785.979555:0:12328:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.979569:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa4d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baff expref: 18 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.979576:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73aa68b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc02 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.979582:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73aa4fc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb29 expref: 24 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.979592:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.979594:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.979596:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.979615:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12393 00000100:00100000:3.0:1746143785.979622:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622753920:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:1.0:1746143785.979627:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12394 00000100:00100000:1.0:1746143785.979633:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622754176:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143785.979638:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.979646:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.979647:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73aa4e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb0d expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.979653:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73aa66f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc10 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.979654:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.979660:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73aa50a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb37 expref: 43 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.979665:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.979665:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73aa676 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc1e expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.979666:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.979668:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.979671:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73aa637 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbe6 expref: 24 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.979675:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.979675:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.979677:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.979689:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73aa50a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb37 expref: 43 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.979689:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73aa637 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbe6 expref: 24 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.979698:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73aa50a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb37 expref: 43 pid: 13436 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143785.979698:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73aa637 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbe6 expref: 24 pid: 1947 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143785.979709:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626836096:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.979709:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626836224:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143785.979755:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73aa4fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb29 expref: 24 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.979756:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73aa66f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc10 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.979767:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73aa4fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb29 expref: 24 pid: 9839 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.979768:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73aa66f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc10 expref: 11 pid: 12327 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143785.979774:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626836480:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143785.979774:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626836352:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.979817:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73aa676 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc1e expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.979825:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73aa676 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc1e expref: 10 pid: 9585 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143785.979832:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626836608:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.979868:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.979879:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 18 pid: 3134 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143785.979887:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626836736:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.979903:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143785.979970:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12395 00000100:00100000:2.0:1746143785.979978:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622753792:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143785.979992:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.980001:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa4d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb06 expref: 15 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.980007:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73aa668 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc09 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.980013:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73aa503 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb30 expref: 43 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.980023:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.980024:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.980026:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.980041:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73aa503 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb30 expref: 43 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143785.980048:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73aa503 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb30 expref: 43 pid: 13436 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.980060:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626836864:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143785.980119:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143785.980132:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622754048 00000100:00100000:0.0:1746143785.980135:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622754048 00000100:00100000:0.0:1746143785.980151:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12396 00000100:00100000:0.0:1746143785.980155:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2011:x1830963622754048:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143785.980169:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.980178:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.980183:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73aa67d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc17 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.980187:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.980188:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143785.980190:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.980202:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73aa67d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc17 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143785.980211:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73aa67d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc17 expref: 11 pid: 9585 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746143785.980219:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626836992:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143785.980240:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143785.980247:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 24 pid: 3135 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143785.980252:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626837120:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143785.980264:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.980300:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.980381:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622754304 00000100:00100000:1.0:1746143785.980385:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622754304 00000100:00100000:1.0:1746143785.980403:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12397 00000100:00100000:1.0:1746143785.980407:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622754304:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143785.980421:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.980430:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 15 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.980437:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73aa684 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc25 expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.980442:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73aa63e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbed expref: 43 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.980447:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.980448:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.980450:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.980466:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73aa63e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbed expref: 43 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.980473:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73aa63e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbed expref: 43 pid: 1947 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143785.980480:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626837248:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.980512:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73aa4e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb0d expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143785.980521:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73aa4e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb0d expref: 15 pid: 3135 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143785.980529:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626837376:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.980545:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746143785.980872:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73aa668 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc09 expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.980872:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73aa684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc25 expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.980881:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73aa684 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc25 expref: 12 pid: 9839 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.980884:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73aa668 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc09 expref: 12 pid: 9839 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143785.980889:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e24700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626837632:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.980891:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626837504:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.980931:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 15 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.980938:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 15 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.980945:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa4d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb06 expref: 15 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143785.980945:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626837760:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143785.980951:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa4d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb06 expref: 15 pid: 3134 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.980958:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626837888:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143785.981228:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143785.981229:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746143785.981253:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73aa68b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc02 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.981264:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73aa68b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc02 expref: 11 pid: 3135 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143785.981271:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626838016:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.981287:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baff expref: 18 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143785.981293:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa4d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baff expref: 18 pid: 3134 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143785.981300:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626838144:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.981310:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143785.994368:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626837120:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143785.994435:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963626836992:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143785.994458:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143785.994469:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626836864:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.994530:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626836224:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.994538:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626836608:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.994544:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963626836736:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.994563:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.994632:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626836096:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.994640:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626836480:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143785.994646:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963626837376:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143785.994857:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.995338:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.995360:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.995370:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.995383:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.995412:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143785.995429:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622754432 00000100:00100000:3.0:1746143785.995435:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622754432 00010000:00010000:3.0:1746143785.995459:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73aa66f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc10 expref: 13 pid: 12327 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143785.995476:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622754816 00000100:00100000:3.0:1746143785.995478:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622754816 00010000:00010000:3.0:1746143785.995486:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 25 pid: 3135 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143785.995493:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622755072 00000100:00100000:3.0:1746143785.995495:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622755072 00010000:00010000:3.0:1746143785.995501:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73aa684 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc25 expref: 14 pid: 9839 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143785.995508:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622754688 00000100:00100000:3.0:1746143785.995509:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622754688 00010000:00010000:3.0:1746143785.995516:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73aa4e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb0d expref: 16 pid: 3135 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143785.995522:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622754944 00000100:00100000:3.0:1746143785.995524:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622754944 00010000:00010000:3.0:1746143785.995531:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73aa67d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc17 expref: 12 pid: 9585 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143785.995539:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5886 00000100:00100000:3.0:1746143785.995544:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622754432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.995555:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.995571:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73aa66f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc10 expref: 14 pid: 12327 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.995578:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73aa66f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc10 expref: 14 pid: 12327 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.995601:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7cc00/0x87925e4cb73aa66f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc10 expref: 14 pid: 12327 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.995616:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.995645:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622754432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 100us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.995650:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5886 00000100:00100000:2.0:1746143785.995662:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5887 00000100:00100000:2.0:1746143785.995671:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622754816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.995679:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.995692:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 25 pid: 3135 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.995706:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 25 pid: 3135 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.995718:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73aa645 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbf4 expref: 25 pid: 3135 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143785.995730:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.995749:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622754816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 80us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.995926:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626837248:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.995936:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e24700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626837632:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.995961:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.995994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996064:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996085:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963626837760:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.996100:0:1947:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.996139:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626836352:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.996161:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626838016:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143785.996179:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963626838144:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.996289:0:12328:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.996313:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996321:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996330:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996339:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996347:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996362:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996370:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996398:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143785.996451:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622755200 00000100:00100000:1.0:1746143785.996455:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622755200 00010000:00010000:1.0:1746143785.996469:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73aa50a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb37 expref: 44 pid: 13436 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143785.996513:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5888 00000100:00100000:2.0:1746143785.996542:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5887 00000100:00100000:2.0:1746143785.996555:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622755328 00000100:00100000:2.0:1746143785.996558:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622755328 00010000:00010000:2.0:1746143785.996568:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73aa503 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb30 expref: 45 pid: 13436 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.996577:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622754560 00000100:00100000:2.0:1746143785.996578:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622754560 00010000:00010000:2.0:1746143785.996587:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73aa676 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc1e expref: 13 pid: 9585 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.996594:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622755584 00000100:00100000:2.0:1746143785.996595:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622755584 00010000:00010000:2.0:1746143785.996601:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73aa637 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbe6 expref: 24 pid: 1947 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.996608:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622755712 00000100:00100000:2.0:1746143785.996609:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622755712 00010000:00010000:2.0:1746143785.996616:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73aa4fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb29 expref: 25 pid: 9839 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.996622:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622755840 00000100:00100000:2.0:1746143785.996623:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622755840 00010000:00010000:2.0:1746143785.996629:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73aa68b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc02 expref: 14 pid: 3135 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.996635:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622755456 00000100:00100000:2.0:1746143785.996637:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622755456 00010000:00010000:2.0:1746143785.996643:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73aa668 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc09 expref: 13 pid: 9839 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.996649:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622755968 00000100:00100000:2.0:1746143785.996650:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622755968 00010000:00010000:2.0:1746143785.996656:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 17 pid: 3134 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143785.996663:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622756096 00000100:00100000:2.0:1746143785.996664:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622756096 00010000:00010000:2.0:1746143785.996670:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa4d9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb06 expref: 18 pid: 3134 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.996677:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622756224 00000100:00100000:2.0:1746143785.996678:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622756224 00010000:00010000:2.0:1746143785.996684:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 19 pid: 3134 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143785.996691:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622756352 00000100:00100000:2.0:1746143785.996692:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622756352 00010000:00010000:2.0:1746143785.996700:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73aa63e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbed expref: 46 pid: 1947 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.996707:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622756480 00000100:00100000:2.0:1746143785.996709:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622756480 00010000:00010000:2.0:1746143785.996716:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa4d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baff expref: 20 pid: 3134 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143785.996724:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5889 00000100:00100000:2.0:1746143785.996729:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2009:x1830963622754688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.996736:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.996745:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73aa4e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb0d expref: 18 pid: 3135 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.996752:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73aa4e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb0d expref: 18 pid: 3135 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.996763:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73aa4e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb0d expref: 18 pid: 3135 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.996772:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.996792:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2009:x1830963622754688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 63us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.996798:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5889 00000100:00100000:2.0:1746143785.996808:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5890 00000100:00100000:2.0:1746143785.996812:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622754944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.996818:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.996827:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73aa67d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc17 expref: 14 pid: 9585 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.996835:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73aa67d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc17 expref: 14 pid: 9585 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.996854:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4400/0x87925e4cb73aa67d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc17 expref: 14 pid: 9585 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.996863:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.996864:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143785.996868:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.996874:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143785.996888:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.996900:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622754944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 88us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.996904:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5890 00000100:00100000:2.0:1746143785.996926:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5891 00000100:00100000:2.0:1746143785.996930:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963622755328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.996936:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.996943:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73aa503 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb30 expref: 46 pid: 13436 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.996950:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73aa503 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb30 expref: 46 pid: 13436 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.996959:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73aa503 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb30 expref: 46 pid: 13436 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.996966:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.996977:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963622755328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.996981:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5891 00000100:00100000:2.0:1746143785.996989:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5892 00000100:00100000:2.0:1746143785.996993:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622754560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.996997:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.997003:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73aa676 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc1e expref: 12 pid: 9585 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997009:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73aa676 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc1e expref: 12 pid: 9585 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997016:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5a00/0x87925e4cb73aa676 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc1e expref: 12 pid: 9585 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997022:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.997030:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622754560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 38us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.997034:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5892 00000100:00100000:2.0:1746143785.997041:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5893 00000100:00100000:2.0:1746143785.997045:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963622755584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.997049:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.997053:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73aa637 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbe6 expref: 25 pid: 1947 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997059:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73aa637 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbe6 expref: 25 pid: 1947 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997066:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73aa637 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbe6 expref: 25 pid: 1947 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997071:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.997080:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622755584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 35us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.997084:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5893 00000100:00100000:2.0:1746143785.997090:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5894 00000100:00100000:2.0:1746143785.997094:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622755712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.997098:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.997103:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73aa4fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb29 expref: 23 pid: 9839 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997109:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73aa4fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb29 expref: 23 pid: 9839 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997116:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2200/0x87925e4cb73aa4fc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb29 expref: 23 pid: 9839 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997126:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.997135:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963622755712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 41us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.997140:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5894 00000100:00100000:2.0:1746143785.997148:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5895 00000100:00100000:2.0:1746143785.997152:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622755840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.997157:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.997161:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73aa68b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc02 expref: 10 pid: 3135 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997167:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73aa68b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc02 expref: 10 pid: 3135 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997174:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73aa68b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc02 expref: 10 pid: 3135 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997181:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.997192:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622755840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 40us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.997195:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5895 00000100:00100000:2.0:1746143785.997203:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5896 00000100:00100000:2.0:1746143785.997207:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622755456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.997212:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143785.997217:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73aa668 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc09 expref: 13 pid: 9839 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997225:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73aa668 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc09 expref: 13 pid: 9839 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143785.997233:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143785.997245:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2008:x1830963622755456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 37us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143785.997250:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5896 00000100:00100000:2.0:1746143785.997258:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5897 00000100:00100000:2.0:1746143785.997262:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2008:x1830963622755968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143785.997267:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143785.997389:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622755072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.997396:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.997403:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73aa684 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc25 expref: 12 pid: 9839 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997410:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73aa684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc25 expref: 12 pid: 9839 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997420:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a000/0x87925e4cb73aa684 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc25 expref: 12 pid: 9839 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997427:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.997438:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622755072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 53us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.997445:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5888 00000100:00100000:3.0:1746143785.997475:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5898 00000100:00100000:3.0:1746143785.997479:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622756096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.997483:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.997489:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa4d9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb06 expref: 16 pid: 3134 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997496:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa4d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb06 expref: 16 pid: 3134 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997504:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.997505:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.997507:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997513:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997522:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.997531:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+16:2011:x1830963622756096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.997535:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5898 00000100:00100000:3.0:1746143785.997545:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5899 00000100:00100000:3.0:1746143785.997549:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+20:2011:x1830963622756224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.997555:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.997561:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 20 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143785.997568:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 20 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143785.997579:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73aa5d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbbc expref: 20 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143785.997588:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.997589:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.997592:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997598:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997611:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.997622:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+19:2011:x1830963622756224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.997627:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5899 00000100:00100000:3.0:1746143785.997636:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5900 00000100:00100000:3.0:1746143785.997641:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963622756352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.997646:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.997652:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73aa63e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbed expref: 44 pid: 1947 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997659:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73aa63e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbed expref: 44 pid: 1947 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997668:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73aa63e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbed expref: 44 pid: 1947 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997675:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.997684:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963622756352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 43us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.997689:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5900 00000100:00100000:3.0:1746143785.997699:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5901 00000100:00100000:3.0:1746143785.997703:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622756480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143785.997709:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143785.997715:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa4d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baff expref: 18 pid: 3134 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997722:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baff expref: 18 pid: 3134 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997731:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2c00/0x87925e4cb73aa4d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840baff expref: 18 pid: 3134 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143785.997737:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.997738:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143785.997741:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997745:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997762:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143785.997772:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+17:2010:x1830963622756480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 69us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.997776:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5901 00010000:00010000:3.0:1746143785.997795:0:12328:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997801:0:12328:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997813:0:12328:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997818:0:12328:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997824:0:12328:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997829:0:12328:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb4a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143785.997832:0:12328:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997838:0:12328:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997861:0:12328:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.997866:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa6ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.997898:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622753664:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 18372us (18535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.997905:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12392 00010000:00010000:3.0:1746143785.998070:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998076:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998087:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998093:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998097:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998102:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2dba00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143785.998104:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998110:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998117:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998122:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73aa6d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143785.998155:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2011:x1830963622754176:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 18521us (18729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143785.998160:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12394 00010000:00010000:3.0:1746143785.998206:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998213:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998224:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998229:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998235:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998243:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb5600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143785.998245:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998250:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143785.998258:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.998791:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5902 00000100:00100000:1.0:1746143785.998798:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963622755200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143785.998807:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143785.998817:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73aa50a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb37 expref: 42 pid: 13436 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143785.998826:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73aa50a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb37 expref: 42 pid: 13436 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143785.998839:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73aa50a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb37 expref: 42 pid: 13436 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143785.998864:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.998865:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143785.998868:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.998874:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.998888:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143785.998927:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963622755200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.998932:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5902 00010000:00010000:1.0:1746143785.998986:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0ac00/0x87925e4cb73aa668 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc09 expref: 10 pid: 9839 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143785.998994:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626837504:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.999006:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73aa4d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb06 expref: 15 pid: 3134 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143785.999012:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626837888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143785.999031:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999039:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999044:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999055:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999060:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999065:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999070:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5acc00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143785.999072:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999076:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999084:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999089:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73aa6df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.999119:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622753792:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 19142us (19667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.999124:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12395 00010000:00010000:1.0:1746143785.999152:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999159:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999168:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999173:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999177:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999182:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0a600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143785.999184:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999191:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999199:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143785.999204:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a600/0x87925e4cb73aa6d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143785.999228:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622753920:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 19607us (19828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143785.999232:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12393 00010000:00010000:2.0:1746143786.000164:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 14 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.000179:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 14 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.000192:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73aa5ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbca expref: 14 pid: 3134 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.000203:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143786.000204:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143786.000207:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.000214:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.000229:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143786.000251:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2008:x1830963622755968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2988us (3902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.000257:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5897 00010000:00010000:3.0:1746143786.000389:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb5600/0x87925e4cb73aa6e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143786.000427:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2011:x1830963622754048:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 20270us (20308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.000432:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12396 00010000:00010000:1.0:1746143786.000569:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.000577:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.000592:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.000597:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.000603:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.000612:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55a200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143786.000614:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.000619:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.000627:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.000632:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73aa6ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143786.000677:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2011:x1830963622754304:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 20268us (20375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143786.000683:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12397 00000100:00100000:0.0:1746143786.003662:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.004819:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622756736 00000100:00100000:2.0:1746143786.004831:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622756736 00000100:00100000:2.0:1746143786.004955:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12999 00000100:00100000:2.0:1746143786.004962:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+18:32442:x1830963622756736:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:2.0:1746143786.005001:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143786.005021:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73aa6ae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc33 expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005037:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143786.005040:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143786.005061:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143786.005071:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb92 expref: 30 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005077:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd8 expref: 286 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005082:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b804 expref: 286 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005088:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005093:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 286 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005099:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b889 expref: 30 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005103:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8d6 expref: 286 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005109:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 10/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143786.005137:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8d6 expref: 286 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005147:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8d6 expref: 286 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.005157:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838272:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143786.005237:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b889 expref: 30 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005244:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b889 expref: 30 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.005252:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838400:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143786.005275:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 286 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005282:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 286 pid: 7244 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.005289:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838528:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143786.005304:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.005309:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 30 pid: 7245 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.005315:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838656:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143786.005328:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b804 expref: 286 pid: 6587 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746143786.005563:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746143786.006134:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b804 expref: 286 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.006144:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838784:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143786.006189:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd8 expref: 286 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.006197:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd8 expref: 286 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.006203:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838912:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143786.006227:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb92 expref: 30 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.006234:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb92 expref: 30 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.006240:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626839040:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143786.006253:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143786.009369:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.009412:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.009449:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838272:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143786.009460:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838400:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143786.009468:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838528:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143786.009474:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838656:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143786.009481:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838784:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143786.009487:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626838912:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143786.009494:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626839040:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143786.009528:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143786.010781:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622756992 00000100:00100000:3.0:1746143786.010790:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622756992 00000100:00100000:0.0:1746143786.010812:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.010828:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622757248 00000100:00100000:3.0:1746143786.010830:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622757248 00000100:00100000:3.0:1746143786.010853:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4793 00000100:00100000:3.0:1746143786.010860:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+287:8586:x1830963622756992:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143786.010986:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4794 00000100:00100000:1.0:1746143786.010994:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b495c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:26343:x1830963622757248:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143786.011027:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+288:8586:x1830963622756992:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 166us (1664us total) trans 8589943776 rc 0/0 00000100:00100000:3.0:1746143786.011033:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4793 00000100:00100000:1.0:1746143786.011064:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b495c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:26343:x1830963622757248:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 72us (1652us total) trans 8589943777 rc 0/0 00000100:00100000:1.0:1746143786.011072:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4794 00000100:00100000:2.0:1746143786.011378:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622757376 00000100:00100000:2.0:1746143786.011383:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622757376 00000100:00100000:0.0:1746143786.011389:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143786.011402:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd8 expref: 288 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143786.011416:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.011421:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622757760 00000100:00100000:2.0:1746143786.011423:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622757760 00010000:00010000:2.0:1746143786.011429:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b804 expref: 289 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.011439:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622757504 00000100:00100000:2.0:1746143786.011440:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622757504 00000100:00100000:0.0:1746143786.011444:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143786.011446:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 290 pid: 7244 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.011452:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622757632 00000100:00100000:2.0:1746143786.011454:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622757632 00010000:00010000:2.0:1746143786.011460:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 32 pid: 7245 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.011468:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5903 00000100:00100000:2.0:1746143786.011473:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+290:2010:x1830963622757376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143786.011481:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143786.011485:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd8 expref: 290 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.011492:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd8 expref: 290 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.011508:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7000/0x87925e4cb73aa622 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bbd8 expref: 290 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143786.011509:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5904 00000100:00100000:3.0:1746143786.011516:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+289:2010:x1830963622757760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143786.011518:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143786.011522:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143786.011523:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143786.011527:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b804 expref: 289 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.011530:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143786.011534:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b804 expref: 289 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143786.011545:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73a9fb5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b804 expref: 289 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.011549:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+289:2010:x1830963622757376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (739us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143786.011553:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00000100:00100000:2.0:1746143786.011554:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5903 00010000:00010000:3.0:1746143786.011556:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143786.011560:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143786.011576:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+287:2010:x1830963622757760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 61us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.011581:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5904 00000100:00100000:2.0:1746143786.011584:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5905 00000100:00100000:2.0:1746143786.011588:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:2009:x1830963622757504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143786.011593:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5906 00010000:00010000:2.0:1746143786.011593:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143786.011597:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 286 pid: 7244 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143786.011598:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+32:2009:x1830963622757632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143786.011603:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143786.011605:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 286 pid: 7244 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143786.011607:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 32 pid: 7245 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.011614:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73a9fed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b83c expref: 286 pid: 7244 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143786.011615:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 32 pid: 7245 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.011625:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143786.011626:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512800/0x87925e4cb73a9fbc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b80b expref: 32 pid: 7245 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.011628:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143786.011632:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143786.011633:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143786.011636:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143786.011641:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143786.011645:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+285:2009:x1830963622757504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.011650:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5905 00000100:00100000:3.0:1746143786.011654:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2009:x1830963622757632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.011660:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5906 00000100:00100000:0.0:1746143786.012371:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143786.012775:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622757888 00000100:00100000:1.0:1746143786.012782:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622757888 00010000:00010000:1.0:1746143786.012802:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb92 expref: 31 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143786.012856:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5907 00000100:00100000:1.0:1746143786.012862:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+31:2008:x1830963622757888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143786.012870:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143786.012873:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb92 expref: 31 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143786.012880:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb92 expref: 31 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143786.012891:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73aa5a4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bb92 expref: 31 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143786.012902:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143786.012905:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143786.012930:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143786.012959:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2008:x1830963622757888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 96us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143786.012965:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5907 00000100:00100000:0.0:1746143786.013159:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.013238:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622758016 00000100:00100000:2.0:1746143786.013242:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622758016 00010000:00010000:2.0:1746143786.013255:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b889 expref: 30 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.013270:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5908 00000100:00100000:2.0:1746143786.013276:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+30:2011:x1830963622758016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143786.013282:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143786.013285:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b889 expref: 30 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.013291:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b889 expref: 30 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.013300:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73aa05d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b889 expref: 30 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143786.013308:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143786.013311:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143786.013317:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143786.013343:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+29:2011:x1830963622758016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.013348:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5908 00000100:00100000:0.0:1746143786.013738:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.013818:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622758144 00000100:00100000:3.0:1746143786.013822:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622758144 00010000:00010000:3.0:1746143786.013834:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8d6 expref: 285 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143786.014274:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5909 00000100:00100000:3.0:1746143786.014280:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+285:2008:x1830963622758144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143786.014287:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143786.014291:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8d6 expref: 285 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143786.014299:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8d6 expref: 285 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143786.014309:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73aa0d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840b8d6 expref: 285 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143786.014321:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143786.014324:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143786.014330:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143786.014335:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143786.014360:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143786.014385:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:2008:x1830963622758144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.014390:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5909 00010000:00010000:2.0:1746143786.014506:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143786.014511:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000040:00080000:2.0:1746143786.014695:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2735, 88 off228400 00000004:00080000:2.0:1746143786.014701:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845238788849ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.014728:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2690, 88 off224792 00000004:00080000:2.0:1746143786.014732:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845238819582ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.015379:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2691, 88 off224880 00000004:00080000:2.0:1746143786.015383:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845239471109ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.015393:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2736, 88 off228488 00000004:00080000:2.0:1746143786.015396:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845239483480ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.015410:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2737, 88 off228576 00000004:00080000:2.0:1746143786.015413:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845239501350ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.015421:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2692, 88 off224968 00000004:00080000:2.0:1746143786.015423:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845239510832ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.015429:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2693, 88 off225056 00000004:00080000:2.0:1746143786.015432:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845239519739ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.015438:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2694, 88 off225144 00000004:00080000:2.0:1746143786.015440:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845239528195ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.015447:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2738, 88 off228664 00000004:00080000:2.0:1746143786.015449:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845239537097ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.015456:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2695, 88 off225232 00000004:00080000:2.0:1746143786.015458:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845239546342ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.015465:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2739, 88 off228752 00000004:00080000:2.0:1746143786.015467:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845239554670ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.015556:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2696, 88 off225320 00000004:00080000:2.0:1746143786.015561:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845239648647ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.015572:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2740, 88 off228840 00000004:00080000:2.0:1746143786.015574:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845239661639ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.015580:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2741, 88 off228928 00000004:00080000:2.0:1746143786.015581:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845239669457ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.015588:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2742, 88 off229016 00000004:00080000:2.0:1746143786.015864:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845239950834ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.015936:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2743, 88 off229104 00000004:00080000:2.0:1746143786.015940:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845240028378ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.015950:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2697, 88 off225408 00000004:00080000:2.0:1746143786.015952:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845240039797ns, next at 770855090093ns, rc = 0 00000001:00080000:3.0:1746143786.017865:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943778 is committed 00000004:00080000:3.0:1746143786.017872:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1926 committed 00000004:00080000:3.0:1746143786.017888:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1970 committed 00000004:00080000:3.0:1746143786.017892:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1969 committed 00000004:00080000:3.0:1746143786.017893:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1968 committed 00000004:00080000:3.0:1746143786.017894:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1967 committed 00000004:00080000:3.0:1746143786.017895:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1925 committed 00000004:00080000:3.0:1746143786.017897:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1966 committed 00000004:00080000:3.0:1746143786.017898:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1924 committed 00000004:00080000:3.0:1746143786.017899:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1965 committed 00000004:00080000:3.0:1746143786.017901:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1923 committed 00000004:00080000:3.0:1746143786.017902:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1922 committed 00000004:00080000:3.0:1746143786.017903:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1921 committed 00000004:00080000:3.0:1746143786.017905:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1964 committed 00000004:00080000:3.0:1746143786.017906:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1963 committed 00000004:00080000:3.0:1746143786.017907:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1920 committed 00000004:00080000:3.0:1746143786.017909:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1919 committed 00000004:00080000:3.0:1746143786.017928:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1962 committed 00000001:00080000:3.0:1746143786.017932:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943777 is committed 00000001:00080000:3.0:1746143786.017936:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943776 is committed 00000100:00100000:1.0:1746143786.018157:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626839296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.018203:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.018228:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626839808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.018243:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.018257:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143786.018261:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626839424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.018275:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.018286:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626839936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.018296:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.018307:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626840320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.018320:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143786.018361:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626839552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143786.018385:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626839168:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746143786.018407:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800911f9f80 reply state ffff880082e96800 transno 8589943778 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143786.018430:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143786.018437:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143786.018439:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746143786.018442:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746143786.018503:0:6587:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143786.018514:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32442:x1830963622756736:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 13551us (14862us total) trans 8589943778 rc 0/0 00000100:00100000:2.0:1746143786.018520:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12999 00000100:00100000:3.0:1746143786.018622:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626839296 00000100:00100000:3.0:1746143786.018629:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626839296 00000100:00100000:1.0:1746143786.018630:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626840832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.018645:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143786.018662:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626839808 00000100:00100000:3.0:1746143786.018664:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626839808 00000100:00100000:1.0:1746143786.018670:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143786.018674:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626839424 00000100:00100000:1.0:1746143786.018675:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626840448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143786.018676:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626839424 00000100:00100000:3.0:1746143786.018683:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626839936 00000100:00100000:3.0:1746143786.018684:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626839936 00000100:00100000:3.0:1746143786.018691:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626840320 00000100:00100000:3.0:1746143786.018693:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626840320 00000100:00100000:1.0:1746143786.018698:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143786.018702:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626840832 00000100:00100000:3.0:1746143786.018704:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626840832 00000100:00100000:3.0:1746143786.018709:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626840448 00000100:00100000:3.0:1746143786.018710:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626840448 00000100:00100000:1.0:1746143786.018711:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626840960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143786.018718:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12398 00000100:00100000:3.0:1746143786.018723:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3773:x1830963626839296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.018723:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.018739:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626840960 00000100:00100000:1.0:1746143786.018741:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626840960 00000100:00100000:1.0:1746143786.018753:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12399 00000100:00100000:1.0:1746143786.018757:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3773:x1830963626839808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.018796:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12400 00000100:00100000:1.0:1746143786.018800:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3773:x1830963626839424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143786.018823:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3773:x1830963626839296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (619us total) trans 17179873108 rc 0/0 00000100:00100000:3.0:1746143786.018828:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12398 00000100:00100000:1.0:1746143786.018857:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3773:x1830963626839424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (581us total) trans 17179873110 rc 0/0 00000100:00100000:1.0:1746143786.018862:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12400 00000100:00100000:1.0:1746143786.018870:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12401 00000100:00100000:1.0:1746143786.018874:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626839936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.018931:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3773:x1830963626839936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (633us total) trans 17179873111 rc 0/0 00000100:00100000:1.0:1746143786.018935:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12401 00000100:00100000:1.0:1746143786.018943:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12402 00000100:00100000:1.0:1746143786.018947:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626840320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143786.018961:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12403 00000100:00100000:3.0:1746143786.018964:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626840832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143786.019003:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3773:x1830963626840832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (357us total) trans 21474840438 rc 0/0 00000100:00100000:1.0:1746143786.019003:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3773:x1830963626840320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (682us total) trans 21474840437 rc 0/0 00000100:00100000:1.0:1746143786.019008:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12402 00000100:00100000:3.0:1746143786.019010:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12403 00000100:00100000:1.0:1746143786.019016:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12404 00000100:00100000:3.0:1746143786.019018:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12405 00000100:00100000:1.0:1746143786.019020:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626840448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143786.019021:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626840960:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143786.019050:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143786.019058:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143786.019063:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143786.019063:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3773:x1830963626840448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (364us total) trans 21474840439 rc 0/0 00000100:00100000:1.0:1746143786.019067:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12404 00010000:00010000:3.0:1746143786.019068:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e505400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143786.019071:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143786.019077:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143786.019085:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143786.019087:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143786.019089:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000004:00080000:1.0:1746143786.019089:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30a80/2, rc 0, transno 21474840439 00010000:00010000:3.0:1746143786.019093:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73aa6f4 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143786.019095:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626840448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143786.019101:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e31c00/2, rc 0, transno 21474840437 00000100:00100000:1.0:1746143786.019103:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626840320:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143786.019108:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33800/2, rc 0, transno 21474840438 00000100:00100000:1.0:1746143786.019110:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626840832:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143786.019116:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800919e6300/2, rc 0, transno 17179873110 00000100:00100000:1.0:1746143786.019118:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800919e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626839424:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143786.019123:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9880/2, rc 0, transno 17179873111 00000100:00100000:1.0:1746143786.019125:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626839936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143786.019130:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e3800/2, rc 0, transno 17179873108 00000100:00100000:1.0:1746143786.019132:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626839296:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143786.019155:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143786.019158:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143786.019160:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143786.019161:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143786.019163:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143786.019181:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3773:x1830963626840960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (457us total) trans 21474840440 rc 0/0 00000100:00100000:1.0:1746143786.019186:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12405 00000004:00080000:1.0:1746143786.019200:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e32300/2, rc 0, transno 21474840440 00000100:00100000:1.0:1746143786.019203:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626840960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.019245:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.019249:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963626839808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 492us (1005us total) trans 17179873109 rc 0/0 00000100:00100000:1.0:1746143786.019254:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12399 00000100:00100000:2.0:1746143786.019258:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626840064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.019261:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626839552 00000100:00100000:1.0:1746143786.019263:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626839552 00000100:00100000:2.0:1746143786.019273:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.019274:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12406 00000100:00100000:1.0:1746143786.019277:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3771:x1830963626839552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143786.019281:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626840576:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.019292:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746143786.019314:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143786.019316:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143786.019318:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00000100:00100000:2.0:1746143786.019320:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626841088:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143786.019320:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143786.019321:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:2.0:1746143786.019334:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.019336:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3771:x1830963626839552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (92us total) trans 17179873112 rc 0/0 00000100:00100000:1.0:1746143786.019341:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12406 00000100:00100000:1.0:1746143786.019347:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626840064 00000100:00100000:1.0:1746143786.019350:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626840064 00000004:00080000:2.0:1746143786.019351:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719e300/2, rc 0, transno 17179873112 00000100:00100000:2.0:1746143786.019353:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626839552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143786.019357:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143786.019360:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626840576 00000100:00100000:2.0:1746143786.019361:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626841216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.019361:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626840576 00000100:00100000:1.0:1746143786.019368:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626841088 00000100:00100000:1.0:1746143786.019369:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626841088 00000100:00100000:2.0:1746143786.019377:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.019378:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12407 00000100:00100000:1.0:1746143786.019381:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3771:x1830963626840064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143786.019393:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626841216 00000100:00100000:2.0:1746143786.019395:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626841216 00000100:00100000:2.0:1746143786.019408:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12408 00000100:00100000:2.0:1746143786.019412:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626840576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.019428:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3771:x1830963626840064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (154us total) trans 17179873113 rc 0/0 00000100:00100000:1.0:1746143786.019432:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12407 00000100:00100000:1.0:1746143786.019439:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12409 00000100:00100000:1.0:1746143786.019443:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626841088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.019453:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12410 00000100:00100000:1.0:1746143786.019457:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626841216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.019470:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626840576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (176us total) trans 21474840441 rc 0/0 00000100:00100000:2.0:1746143786.019474:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12408 00000100:00100000:2.0:1746143786.019486:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143786.019498:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626839680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.019499:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626841216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (122us total) trans 21474840442 rc 0/0 00000100:00100000:1.0:1746143786.019504:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12410 00000100:00100000:2.0:1746143786.019511:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.019511:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626839168 00000100:00100000:1.0:1746143786.019513:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626839168 00000100:00100000:2.0:1746143786.019517:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626840192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.019520:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626839680 00000100:00100000:1.0:1746143786.019521:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626839680 00000100:00100000:1.0:1746143786.019528:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12411 00000100:00100000:2.0:1746143786.019529:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.019531:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3772:x1830963626839168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143786.019534:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626840704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.019545:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143786.019559:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626840192 00000100:00100000:2.0:1746143786.019561:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626840192 00000100:00100000:2.0:1746143786.019570:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626840704 00000100:00100000:2.0:1746143786.019572:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626840704 00000100:00100000:1.0:1746143786.019575:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963626839168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (88us total) trans 17179873114 rc 0/0 00000100:00100000:2.0:1746143786.019579:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12412 00000100:00100000:2.0:1746143786.019582:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963626839680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143786.020029:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143786.020032:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143786.020034:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143786.020035:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143786.020037:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746143786.020082:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3772:x1830963626839680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 499us (570us total) trans 17179873115 rc 0/0 00000100:00100000:1.0:1746143786.020817:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12411 00000100:00100000:0.0:1746143786.020838:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12413 00000100:00100000:0.0:1746143786.020863:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3772:x1830963626840192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143786.020946:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626840192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (1415us total) trans 21474840443 rc 0/0 00000100:00100000:0.0:1746143786.020951:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12413 00000100:00100000:2.0:1746143786.020966:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12412 00000100:00100000:3.0:1746143786.020982:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12414 00000100:00100000:3.0:1746143786.020989:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3772:x1830963626840704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143786.021047:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3772:x1830963626840704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (1500us total) trans 21474840445 rc 0/0 00000100:00100000:1.0:1746143786.021047:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3771:x1830963626841088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1603us (1711us total) trans 21474840444 rc 0/0 00000100:00100000:3.0:1746143786.021052:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12414 00000100:00100000:1.0:1746143786.021062:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12409 00000004:00080000:0.0:1746143786.021122:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c68e00/2, rc 0, transno 17179873109 00000100:00100000:0.0:1746143786.021126:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626839808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143786.021173:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143786.021216:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622758272 00000100:00100000:1.0:1746143786.021221:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622758272 00000004:00080000:2.0:1746143786.021233:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7e1880/2, rc 0, transno 17179873114 00000100:00100000:2.0:1746143786.021237:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626839168:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143786.021245:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c6a300/2, rc 0, transno 17179873115 00000100:00100000:2.0:1746143786.021247:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626839680:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143786.021259:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093727480/2, rc 0, transno 21474840443 00000100:00100000:2.0:1746143786.021262:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626840192:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143786.021267:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e31880/2, rc 0, transno 21474840445 00000100:00100000:2.0:1746143786.021270:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626840704:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143786.021282:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30700/2, rc 0, transno 21474840442 00000100:00100000:2.0:1746143786.021284:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626841216:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143786.021290:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e25500/2, rc 0, transno 17179873113 00000100:00100000:2.0:1746143786.021292:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626840064:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143786.021298:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30e00/2, rc 0, transno 21474840441 00000100:00100000:2.0:1746143786.021300:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626840576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.021304:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13000 00000004:00080000:2.0:1746143786.021305:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33b80/2, rc 0, transno 21474840444 00000100:00100000:2.0:1746143786.021307:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626841088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.021309:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32442:x1830963622758272:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143786.021322:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143786.021333:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73aa6fb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc41 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.021369:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73aa6fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc41 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.021384:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73aa6fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc41 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.021397:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143786.021399:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143786.021402:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f6d600, rc 0) 00000100:00100000:1.0:1746143786.021425:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32442:x1830963622758272:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 116us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143786.021430:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13000 00000100:00100000:0.0:1746143786.024134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.024288:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622758400 00000100:00100000:3.0:1746143786.024299:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622758400 00000100:00100000:3.0:1746143786.024343:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13001 00000100:00100000:3.0:1746143786.024350:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32442:x1830963622758400:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143786.024365:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143786.024380:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73aa702 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc48 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.024449:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73aa709 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143786.024460:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73aa709 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143786.024469:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73aa709 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143786.024491:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:3.0:1746143786.024495:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143786.024508:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73aa709 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143786.024527:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73aa702 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc48 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.024539:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73aa709 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc48 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.024546:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143786.024549:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143786.024552:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d400, rc 0) 00000100:00100000:3.0:1746143786.025090:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32442:x1830963622758400:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 738us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.025096:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13001 00000100:00100000:0.0:1746143786.029404:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.029440:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.029464:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622758528 00000100:00100000:0.0:1746143786.029465:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.029472:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622758528 00000100:00100000:0.0:1746143786.029492:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.029506:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622758656 00000100:00100000:0.0:1746143786.029508:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622758656 00000100:00100000:2.0:1746143786.029516:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622758784 00000100:00100000:2.0:1746143786.029518:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622758784 00000100:00100000:0.0:1746143786.029522:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622758912 00000100:00100000:0.0:1746143786.029523:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622758912 00000100:00100000:2.0:1746143786.029530:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12415 00000100:00100000:2.0:1746143786.029564:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2011:x1830963622758528:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143786.029580:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143786.029596:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e3ba00/0x87925e4cb73aa710 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc4f expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143786.029614:0:1947:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a25, atime: 0x68140a25, ctime: 0x68140a25, blocks: 0x7d8 00010000:00010000:2.0:1746143786.029630:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143786.029632:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143786.029640:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3ba00/0x87925e4cb73aa710 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc4f expref: 8 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143786.029653:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e3ba00/0x87925e4cb73aa710 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc4f expref: 8 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143786.029662:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3ba00, rc 0) 00000100:00100000:2.0:1746143786.029704:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622758528:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 168us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143786.029877:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12416 00000100:00100000:0.0:1746143786.029884:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622758656:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143786.029891:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143786.029900:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73aa717 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc56 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143786.029935:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a29, atime: 0x68140a28, ctime: 0x68140a29, blocks: 0x808 00010000:00010000:0.0:1746143786.029944:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143786.029945:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143786.029949:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73aa717 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc56 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143786.029958:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73aa717 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc56 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143786.029964:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097369e00, rc 0) 00000100:00100000:0.0:1746143786.029981:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622758656:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 98us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143786.029986:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12416 00000100:00100000:0.0:1746143786.029999:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12417 00000100:00100000:3.0:1746143786.030040:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12418 00000100:00100000:3.0:1746143786.030047:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622758912:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143786.030053:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143786.030061:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7c800/0x87925e4cb73aa71e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc64 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143786.030070:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a2a, atime: 0x68140a25, ctime: 0x68140a2a, blocks: 0x808 00010000:00010000:3.0:1746143786.030078:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143786.030080:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143786.030083:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c800/0x87925e4cb73aa71e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc64 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143786.030091:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7c800/0x87925e4cb73aa71e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc64 expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143786.030097:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c800, rc 0) 00000100:00100000:3.0:1746143786.030113:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622758912:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 67us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.030117:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12418 00000100:00100000:0.0:1746143786.030424:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622758784:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143786.030431:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143786.030439:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73aa725 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc5d expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143786.030447:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a29, atime: 0x68140a28, ctime: 0x68140a29, blocks: 0x800 00010000:00010000:0.0:1746143786.030454:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143786.030455:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143786.030459:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73aa725 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc5d expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143786.030660:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12415 00000100:00100000:2.0:1746143786.030697:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.030837:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.030955:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622759040 00000100:00100000:3.0:1746143786.030960:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622759040 00000100:00100000:3.0:1746143786.030983:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622759168 00000100:00100000:3.0:1746143786.030985:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622759168 00000100:00100000:3.0:1746143786.030997:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12419 00000100:00100000:3.0:1746143786.031001:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2011:x1830963622759040:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143786.031008:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143786.031015:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73aa72c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc6b expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143786.031025:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4964768, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x15f0 00010000:00010000:3.0:1746143786.031032:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143786.031033:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143786.031037:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73aa72c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc6b expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143786.031045:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73aa72c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc6b expref: 9 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143786.031050:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4200, rc 0) 00000100:00100000:3.0:1746143786.031072:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2011:x1830963622759040:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 70us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.031076:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12419 00000100:00100000:3.0:1746143786.031087:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12420 00000100:00100000:3.0:1746143786.031091:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622759168:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143786.031096:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143786.031104:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73aa733 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc72 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143786.031113:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a2a, atime: 0x68140a29, ctime: 0x68140a2a, blocks: 0x1008 00010000:00010000:3.0:1746143786.031121:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143786.031122:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143786.031126:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73aa733 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc72 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143786.031134:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73aa733 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc72 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143786.031140:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7da00, rc 0) 00000100:00100000:3.0:1746143786.031154:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622759168:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 62us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.031159:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12420 00010000:00010000:0.0:1746143786.031173:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73aa725 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc5d expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143786.031182:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097368200, rc 0) 00000100:00100000:0.0:1746143786.031197:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2011:x1830963622758784:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1193us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143786.031201:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12417 00000100:00100000:0.0:1746143786.034835:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.034883:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.034943:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.034961:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.034983:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622759424 00000100:00100000:0.0:1746143786.034992:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622759424 00000100:00100000:0.0:1746143786.035042:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622759680 00000100:00100000:0.0:1746143786.035044:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622759680 00000100:00100000:0.0:1746143786.035058:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622759936 00000100:00100000:0.0:1746143786.035060:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622759936 00000100:00100000:0.0:1746143786.035067:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622759296 00000100:00100000:0.0:1746143786.035069:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622759296 00000100:00100000:0.0:1746143786.035080:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12421 00000100:00100000:0.0:1746143786.035088:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622759424:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143786.035197:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622759424:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 110us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143786.035204:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12421 00000100:00100000:0.0:1746143786.035218:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12422 00000100:00100000:0.0:1746143786.035222:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622759680:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143786.035258:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622759680:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 36us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143786.035267:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12422 00000100:00100000:3.0:1746143786.035276:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12423 00000100:00100000:3.0:1746143786.035283:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622759936:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143786.035284:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12424 00000100:00100000:0.0:1746143786.035289:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622759296:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143786.035316:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622759936:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 34us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.035320:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12423 00000100:00100000:0.0:1746143786.035320:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622759296:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143786.035325:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12424 00000100:00100000:0.0:1746143786.035616:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.035685:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.035814:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622759552 00000100:00100000:3.0:1746143786.035818:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622759552 00000100:00100000:3.0:1746143786.035834:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622759808 00000100:00100000:3.0:1746143786.035836:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622759808 00000100:00100000:3.0:1746143786.035864:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12425 00000100:00100000:3.0:1746143786.035870:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622759552:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143786.035884:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12426 00000100:00100000:2.0:1746143786.035902:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622759808:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143786.035944:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622759552:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 74us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.035950:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12425 00000100:00100000:2.0:1746143786.036024:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622759808:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 128us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.036031:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12426 00000100:00100000:0.0:1746143786.038679:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.038722:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.038748:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.038761:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.038772:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.038814:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.038879:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622760192 00000100:00100000:3.0:1746143786.038890:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622760192 00000100:00100000:2.0:1746143786.038908:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622760448 00000100:00100000:2.0:1746143786.038942:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622760448 00000100:00100000:3.0:1746143786.038958:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622760704 00000100:00100000:3.0:1746143786.038961:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622760704 00000100:00100000:2.0:1746143786.038978:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622760064 00000100:00100000:3.0:1746143786.038979:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622760320 00000100:00100000:3.0:1746143786.038981:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622760320 00000100:00100000:2.0:1746143786.038981:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622760064 00000100:00100000:2.0:1746143786.038994:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622760576 00000100:00100000:2.0:1746143786.038996:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622760576 00000100:00100000:3.0:1746143786.039004:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12427 00000100:00100000:3.0:1746143786.039011:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622760192:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143786.039117:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622760192:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 106us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.039618:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12428 00000100:00100000:2.0:1746143786.039628:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622760448:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143786.039721:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622760448:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 95us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.039728:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12428 00000100:00100000:2.0:1746143786.039743:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12429 00000100:00100000:2.0:1746143786.039748:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622760704:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143786.039794:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2010:x1830963622760704:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 45us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.039799:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12429 00000100:00100000:2.0:1746143786.039809:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12430 00000100:00100000:2.0:1746143786.039814:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622760064:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143786.039832:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12431 00000100:00100000:1.0:1746143786.039839:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622760320:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143786.039840:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12427 00000100:00100000:0.0:1746143786.039858:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12432 00000100:00100000:0.0:1746143786.039866:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622760576:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143786.039880:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622760320:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 43us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143786.039885:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12431 00000100:00100000:0.0:1746143786.039906:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622760576:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 42us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143786.039933:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12432 00000100:00100000:2.0:1746143786.040015:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2010:x1830963622760064:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 201us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.040021:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12430 00000100:00100000:1.0:1746143786.043372:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.043431:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622760832 00000100:00100000:2.0:1746143786.043438:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622760832 00000100:00100000:2.0:1746143786.043475:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12433 00000100:00100000:2.0:1746143786.043481:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622760832:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:2.0:1746143786.043618:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143786.043620:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143786.043623:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:2.0:1746143786.043624:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143786.043626:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:2.0:1746143786.043663:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622760832:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 182us (296us total) trans 17179873116 rc 0/0 00000100:00100000:2.0:1746143786.043668:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12433 00000100:00100000:0.0:1746143786.047514:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.050413:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622760960 00000100:00100000:2.0:1746143786.050426:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622760960 00000100:00100000:2.0:1746143786.050716:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12434 00000100:00100000:2.0:1746143786.050725:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2008:x1830963622760960:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:2.0:1746143786.050938:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143786.050941:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143786.050943:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143786.050945:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143786.050947:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:2.0:1746143786.051229:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2008:x1830963622760960:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 504us (3725us total) trans 21474840446 rc 0/0 00000100:00100000:2.0:1746143786.051236:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12434 00000100:00100000:0.0:1746143786.058766:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.058829:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.058965:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622761216 00000100:00100000:3.0:1746143786.058976:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622761216 00000100:00100000:3.0:1746143786.059049:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622761472 00000100:00100000:3.0:1746143786.059052:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622761472 00000100:00100000:3.0:1746143786.059075:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3679 00000100:00100000:3.0:1746143786.059083:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622761216:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143786.059124:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73aa73a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.059139:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143786.059141:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143786.059146:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73aa73a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.059161:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73aa73a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143786.059704:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3680 00000100:00100000:2.0:1746143786.059728:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622761472:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143786.059771:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73aa741 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.059784:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143786.059785:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143786.059790:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73aa741 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.059804:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73aa741 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143786.060291:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.060312:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622761856 00000100:00100000:0.0:1746143786.060316:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622761856 00000100:00100000:0.0:1746143786.060344:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3681 00000100:00100000:0.0:1746143786.060350:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622761856:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143786.060367:0:20386:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73aa748 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143786.060375:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143786.060376:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143786.060380:0:20386:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73aa748 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143786.060389:0:20386:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73aa748 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143786.060963:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143786.060977:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622761984 00000100:00100000:1.0:1746143786.060981:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622761984 00000100:00100000:1.0:1746143786.061015:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3682 00000100:00100000:1.0:1746143786.061021:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2011:x1830963622761984:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143786.061040:0:29557:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011e2dba00/0x87925e4cb73aa74f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.061049:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143786.061051:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143786.061054:0:29557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e2dba00/0x87925e4cb73aa74f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.061063:0:29557:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e2dba00/0x87925e4cb73aa74f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143786.063539:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.064331:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622762240 00000100:00100000:3.0:1746143786.064342:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622762240 00000100:00100000:0.0:1746143786.064355:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.064381:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.064415:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622762880 00000100:00100000:1.0:1746143786.064415:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622762496 00000100:00100000:3.0:1746143786.064417:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622762880 00000100:00100000:1.0:1746143786.064420:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622762496 00000100:00100000:0.0:1746143786.064423:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.064437:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622763008 00000100:00100000:3.0:1746143786.064439:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622763008 00000100:00100000:1.0:1746143786.064448:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3683 00000100:00100000:1.0:1746143786.064455:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2010:x1830963622762240:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143786.064493:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73aa756 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143786.064507:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3684 00000100:00100000:3.0:1746143786.064512:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2011:x1830963622762880:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143786.064531:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73aa75d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143786.064533:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3685 00000100:00100000:0.0:1746143786.064541:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2010:x1830963622762496:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143786.064544:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143786.064545:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143786.064550:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73aa75d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143786.064557:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73aa764 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.064563:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73aa75d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143786.064564:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143786.064566:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143786.064569:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73aa764 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143786.064578:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73aa764 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143786.064692:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3686 00000100:00100000:2.0:1746143786.064702:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+15:2011:x1830963622763008:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143786.064719:0:29555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73aa76b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.064726:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143786.064728:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143786.064731:0:29555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73aa76b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.064739:0:29555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73aa76b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.065212:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143786.065214:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143786.065217:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73aa756 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.065233:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73aa756 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.066983:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73aa73a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.066998:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73aa73a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.067006:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73aa73a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.067012:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1e5f800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143786.067016:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73aa73a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.067021:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73aa73a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.067037:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73aa73a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.067042:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e5f800/0x87925e4cb73aa73a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143786.067111:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+16:2010:x1830963622761216:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 8023us (8351us total) trans 0 rc 1024000/1024000 00000100:00100000:3.0:1746143786.067120:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3679 00010000:00010000:2.0:1746143786.072786:0:20386:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73aa748 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.072805:0:20386:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73aa748 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.072814:0:20386:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73aa748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.072820:0:20386:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368da400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143786.072825:0:20386:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73aa748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.072833:0:20386:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73aa748 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.072863:0:20386:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73aa748 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.072870:0:20386:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368da400/0x87925e4cb73aa748 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143786.072993:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622761856:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 12636us (12697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143786.073005:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3681 00010000:00010000:3.0:1746143786.074691:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73aa741 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.074707:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73aa741 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.074715:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73aa741 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.074720:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e3b200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143786.074724:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73aa741 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.074731:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73aa741 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.074747:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73aa741 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.074758:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73aa741 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143786.074836:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+17:2010:x1830963622761472:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 15115us (16002us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143786.074855:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3680 00010000:00010000:1.0:1746143786.080950:0:29557:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011e2dba00/0x87925e4cb73aa74f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.080965:0:29557:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011e2dba00/0x87925e4cb73aa74f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.080967:0:13453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73aa75d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.080972:0:29557:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011e2dba00/0x87925e4cb73aa74f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.080978:0:29557:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2dba00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143786.080981:0:29557:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e2dba00/0x87925e4cb73aa74f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.080982:0:13453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73aa75d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.080988:0:29557:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e2dba00/0x87925e4cb73aa74f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.080990:0:13453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73aa75d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.080995:0:13453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec91400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143786.080999:0:13453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73aa75d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.081006:0:13453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73aa75d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.081008:0:29557:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011e2dba00/0x87925e4cb73aa74f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.081013:0:29557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e2dba00/0x87925e4cb73aa74f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.081021:0:13453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73aa75d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.081027:0:13453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec91400/0x87925e4cb73aa75d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143786.081079:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622761984:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 20054us (20113us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143786.081090:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3682 00000100:00100000:3.0:1746143786.081095:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2011:x1830963622762880:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 16579us (16710us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143786.081105:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3684 00010000:00010000:2.0:1746143786.084746:0:29555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73aa76b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.084764:0:29555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73aa76b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.084772:0:29555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73aa76b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.084778:0:29555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e3b400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143786.084782:0:29555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73aa76b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.084790:0:29555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73aa76b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.084809:0:29555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73aa76b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.084815:0:29555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73aa76b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143786.084948:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2011:x1830963622763008:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 20213us (20488us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143786.084957:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3686 00010000:00010000:2.0:1746143786.087569:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73aa764 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.087581:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73aa764 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.087589:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73aa764 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.087595:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143786.087598:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73aa764 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.087605:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73aa764 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.087622:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73aa764 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.087633:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73aa764 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143786.087705:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2010:x1830963622762496:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 23159us (23346us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143786.087715:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3685 00010000:00010000:1.0:1746143786.090445:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73aa756 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.090462:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73aa756 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.090471:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73aa756 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.090477:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ae56000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143786.090481:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73aa756 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.090488:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73aa756 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.090506:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73aa756 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.090513:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae56000/0x87925e4cb73aa756 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143786.090855:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2010:x1830963622762240:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 26385us (27317us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143786.090867:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3683 00000100:00100000:0.0:1746143786.098900:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.099054:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622763264 00000100:00100000:3.0:1746143786.099065:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622763264 00000100:00100000:3.0:1746143786.099117:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13002 00000100:00100000:3.0:1746143786.099126:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:32442:x1830963622763264:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1746143786.099180:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143786.099208:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73aa709 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc48 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.099229:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143786.099233:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143786.099280:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143786.099293:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143786.099302:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00010000:3.0:1746143786.099413:0:14991:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093910a80 reply state ffff880096de3000 transno 8589943779 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143786.099422:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143786.099427:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143786.099430:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746143786.099433:0:14991:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143786.099515:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32442:x1830963622763264:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 389us (632us total) trans 8589943779 rc 0/0 00000100:00100000:3.0:1746143786.099522:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13002 00000100:00100000:0.0:1746143786.102194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.102232:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.102280:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.102290:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622763392 00000100:00100000:2.0:1746143786.102299:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622763392 00000100:00100000:2.0:1746143786.102339:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622763520 00000100:00100000:2.0:1746143786.102341:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622763520 00000100:00100000:2.0:1746143786.102350:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622763648 00000100:00100000:2.0:1746143786.102352:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622763648 00000100:00100000:1.0:1746143786.102359:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12435 00000100:00100000:1.0:1746143786.102371:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622763392:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:2.0:1746143786.102477:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12436 00000100:00100000:2.0:1746143786.102483:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622763520:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:1.0:1746143786.102525:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143786.102528:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143781 -> 1746143786 00002000:00010000:1.0:1746143786.102531:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143781 -> 1746143786 00002000:00010000:1.0:1746143786.102533:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143781 -> 1746143786 00002000:00010000:1.0:1746143786.102535:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00002000:00010000:2.0:1746143786.102552:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143786.102554:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143785 -> 1746143786 00002000:00010000:2.0:1746143786.102556:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143784 -> 1746143786 00002000:00010000:2.0:1746143786.102558:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143785 -> 1746143786 00002000:00010000:2.0:1746143786.102559:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143786.102577:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622763520:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 94us (344us total) trans 17179873117 rc 0/0 00000100:00100000:1.0:1746143786.102578:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622763392:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 210us (395us total) trans 21474840447 rc 0/0 00000100:00100000:2.0:1746143786.102583:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12436 00000100:00100000:1.0:1746143786.102586:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12435 00000100:00100000:2.0:1746143786.102597:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12437 00000100:00100000:2.0:1746143786.102601:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622763648:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143786.102631:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143786.102634:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143785 -> 1746143786 00002000:00010000:2.0:1746143786.102636:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143784 -> 1746143786 00002000:00010000:2.0:1746143786.102638:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143785 -> 1746143786 00002000:00010000:2.0:1746143786.102639:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746143786.102652:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622763648:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 50us (372us total) trans 17179873118 rc 0/0 00000100:00100000:2.0:1746143786.102655:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12437 00000100:00100000:0.0:1746143786.103387:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.103399:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.103417:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.103479:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622763776 00000100:00100000:3.0:1746143786.103486:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622763776 00000100:00100000:3.0:1746143786.103521:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622763904 00000100:00100000:1.0:1746143786.103522:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622764032 00000100:00100000:3.0:1746143786.103524:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622763904 00000100:00100000:1.0:1746143786.103524:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622764032 00000100:00100000:3.0:1746143786.103537:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12438 00000100:00100000:3.0:1746143786.103543:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622763776:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:1.0:1746143786.103573:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12439 00000100:00100000:1.0:1746143786.103579:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+12:2009:x1830963622763904:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:3.0:1746143786.103606:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143786.103609:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.103611:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143781 -> 1746143786 00002000:00010000:1.0:1746143786.103612:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:3.0:1746143786.103613:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143786.103614:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.103615:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746143786.103616:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143786.103617:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143786.103619:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00000100:00100000:0.0:1746143786.103662:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12440 00000100:00100000:0.0:1746143786.103668:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+13:2009:x1830963622764032:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:3.0:1746143786.103736:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622763776:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 192us (350us total) trans 21474840448 rc 0/0 00000100:00100000:1.0:1746143786.103736:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622763904:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 156us (335us total) trans 21474840449 rc 0/0 00000100:00100000:1.0:1746143786.103742:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12439 00000100:00100000:3.0:1746143786.103744:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12438 00002000:00010000:0.0:1746143786.103787:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143786.103790:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:0.0:1746143786.103792:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143785 -> 1746143786 00002000:00010000:0.0:1746143786.103793:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143786 -> 1746143786 00002000:00010000:0.0:1746143786.103795:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143786.103811:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+14:2009:x1830963622764032:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 144us (393us total) trans 17179873119 rc 0/0 00000100:00100000:0.0:1746143786.103816:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12440 00000100:00100000:0.0:1746143786.107230:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.107420:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622764288 00000100:00100000:2.0:1746143786.107431:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622764288 00000100:00100000:2.0:1746143786.107633:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4795 00000100:00100000:2.0:1746143786.107644:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:32442:x1830963622764288:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:2.0:1746143786.107714:0:7247:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x34a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa6bc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc3a expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.107764:0:7247:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143786.107775:0:7247:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73aa6fb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc41 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.107782:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143786.107816:0:7247:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73aa6fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc41 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.107833:0:7247:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73aa6fb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc41 expref: 10 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143786.107860:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830963626841344:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143786.107994:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143786.110820:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.110874:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830963626841344:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143786.110901:0:7247:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746143786.110995:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622764416 00000100:00100000:1.0:1746143786.111002:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622764416 00010000:00010000:1.0:1746143786.111035:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73aa6fb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc41 expref: 11 pid: 6587 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143786.111078:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5910 00000100:00100000:1.0:1746143786.111086:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+11:2009:x1830963622764416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143786.111099:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143786.111105:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73aa6fb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc41 expref: 11 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143786.111116:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73aa6fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc41 expref: 11 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143786.111137:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73aa6fb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc41 expref: 11 pid: 6587 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143786.111168:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143786.111174:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143786.111182:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143786.111189:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143786.111216:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143786.111257:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2009:x1830963622764416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 172us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143786.111264:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5910 00010000:00010000:2.0:1746143786.111289:0:7247:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143786.111302:0:7247:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000040:00080000:2.0:1746143786.111539:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2744, 88 off229192 00000004:00080000:2.0:1746143786.111545:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845335632868ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.111569:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2698, 88 off225496 00000004:00080000:2.0:1746143786.111572:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845335659775ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.111583:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2699, 88 off225584 00000004:00080000:2.0:1746143786.111586:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845335673977ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.111594:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2745, 88 off229280 00000004:00080000:2.0:1746143786.111597:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845335684604ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.111685:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2747, 88 off229464 00000004:00080000:2.0:1746143786.111689:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845335777164ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.111700:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2700, 88 off225672 00000004:00080000:2.0:1746143786.111702:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845335790195ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.111708:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2701, 88 off225760 00000004:00080000:2.0:1746143786.111710:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845335798229ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.111716:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2702, 88 off225848 00000004:00080000:2.0:1746143786.111718:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845335806407ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.111726:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2748, 88 off229552 00000004:00080000:2.0:1746143786.111728:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845335815482ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.111733:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2703, 88 off225936 00000004:00080000:2.0:1746143786.111735:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845335823347ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.111741:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2749, 88 off229640 00000004:00080000:2.0:1746143786.111743:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845335830767ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.111749:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2704, 88 off226024 00000004:00080000:2.0:1746143786.111752:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845335839657ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143786.111773:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2750, 88 off229728 00000004:00080000:2.0:1746143786.111776:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845335864315ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.111998:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2751, 88 off229816 00000004:00080000:2.0:1746143786.112002:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845336090250ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.112026:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2752, 88 off229904 00000004:00080000:2.0:1746143786.112029:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845336116800ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.112035:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2753, 88 off229992 00000004:00080000:2.0:1746143786.112037:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 845336125267ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143786.112046:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2705, 88 off226112 00000004:00080000:2.0:1746143786.112048:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 845336136348ns, next at 770855090093ns, rc = 0 00000001:00080000:3.0:1746143786.114398:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943780 is committed 00000004:00080000:3.0:1746143786.114410:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1934 committed 00010000:00010000:0.0:1746143786.114960:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143786.114973:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143786.114979:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143786.114986:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec90800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143786.114990:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143786.114997:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143786.115013:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143786.115016:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143786.115020:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143786.115024:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec90800/0x87925e4cb73aa772 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00000004:00080000:3.0:1746143786.115126:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1979 committed 00000004:00080000:3.0:1746143786.115134:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1978 committed 00000004:00080000:3.0:1746143786.115136:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1977 committed 00000004:00080000:3.0:1746143786.115138:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1976 committed 00000004:00080000:3.0:1746143786.115140:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1933 committed 00000004:00080000:3.0:1746143786.115141:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1975 committed 00000004:00080000:3.0:1746143786.115143:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1932 committed 00000004:00080000:3.0:1746143786.115145:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1974 committed 00000004:00080000:3.0:1746143786.115146:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1931 committed 00000004:00080000:3.0:1746143786.115148:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1930 committed 00000004:00080000:3.0:1746143786.115150:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1929 committed 00000004:00080000:3.0:1746143786.115151:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1973 committed 00000004:00080000:3.0:1746143786.115153:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1972 committed 00000004:00080000:3.0:1746143786.115154:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1928 committed 00000004:00080000:3.0:1746143786.115156:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1927 committed 00000004:00080000:3.0:1746143786.115157:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1971 committed 00000004:00010000:2.0:1746143786.115249:0:7247:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095c3ad80 reply state ffff88009718ac00 transno 8589943780 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143786.115263:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143786.115269:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143786.115272:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746143786.115275:0:7247:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746143786.115281:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143786.115283:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143786.115291:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f400/0x87925e4cb73aa6bc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc3a expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143786.115344:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626841472:0@lo:2:osp-syn-0-0.0 00010000:00080000:2.0:1746143786.115389:0:7247:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143786.115399:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32442:x1830963622764288:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 7758us (8182us total) trans 8589943780 rc 0/0 00000100:00100000:0.0:1746143786.115399:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143786.115409:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4795 00000100:00100000:0.0:1746143786.115425:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626841984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.115437:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626841856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143786.115440:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143786.115457:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143786.115460:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143786.115462:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626841600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.115476:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626842368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143786.115479:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143786.115491:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626842112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.115493:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143786.115504:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143786.115506:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746143786.115511:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626841728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.115525:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143786.115536:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626842240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.115548:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143786.115569:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626841472 00000100:00100000:2.0:1746143786.115576:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626841472 00000100:00100000:2.0:1746143786.115600:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626841984 00000100:00100000:2.0:1746143786.115603:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626841984 00000100:00100000:2.0:1746143786.115611:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626841856 00000100:00100000:2.0:1746143786.115613:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626841856 00000100:00100000:2.0:1746143786.115620:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626841600 00000100:00100000:2.0:1746143786.115622:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626841600 00000100:00100000:0.0:1746143786.115623:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626842368 00000100:00100000:0.0:1746143786.115627:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626842368 00000100:00100000:2.0:1746143786.115630:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626842112 00000100:00100000:2.0:1746143786.115632:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626842112 00000100:00100000:0.0:1746143786.115646:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626841728 00000100:00100000:2.0:1746143786.115795:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626842240 00000100:00100000:2.0:1746143786.115799:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626842240 00000100:00100000:2.0:1746143786.115811:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12441 00000100:00100000:2.0:1746143786.115817:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3773:x1830963626841472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.115931:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12442 00000100:00100000:1.0:1746143786.115939:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3773:x1830963626841984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.116083:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3773:x1830963626841984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (641us total) trans 21474840450 rc 0/0 00000100:00100000:1.0:1746143786.116089:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12442 00000100:00100000:1.0:1746143786.116102:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12443 00000100:00100000:1.0:1746143786.116106:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963626841856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.116159:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963626841856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (698us total) trans 21474840451 rc 0/0 00000100:00100000:1.0:1746143786.116164:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12443 00000100:00100000:1.0:1746143786.116173:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12444 00000100:00100000:1.0:1746143786.116176:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3773:x1830963626841600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143786.116185:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143786.116188:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:2.0:1746143786.116190:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:2.0:1746143786.116192:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143786 -> 1746143786 00002000:00010000:2.0:1746143786.116194:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:2.0:1746143786.116213:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3773:x1830963626841472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 395us (815us total) trans 21474840452 rc 0/0 00002000:00010000:1.0:1746143786.116215:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143786.116217:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00000100:00100000:2.0:1746143786.116218:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12441 00002000:00010000:1.0:1746143786.116219:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143786.116221:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143786.116223:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143786.116229:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12445 00000100:00100000:2.0:1746143786.116233:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963626842368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.116241:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3773:x1830963626841600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (761us total) trans 21474840453 rc 0/0 00000100:00100000:1.0:1746143786.116246:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12444 00000100:00100000:1.0:1746143786.116256:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12446 00000100:00100000:1.0:1746143786.116260:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3773:x1830963626842112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.116281:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963626842368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (787us total) trans 21474840454 rc 0/0 00000100:00100000:2.0:1746143786.116287:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12445 00000100:00100000:2.0:1746143786.116297:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12447 00000100:00100000:2.0:1746143786.116301:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963626842240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143786.116310:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3773:x1830963626842112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (804us total) trans 21474840455 rc 0/0 00000100:00100000:1.0:1746143786.116314:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12446 00002000:00010000:2.0:1746143786.116334:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143786.116337:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143786.116338:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143786.116341:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143786.116343:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000004:00080000:1.0:1746143786.116347:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c38000/2, rc 0, transno 21474840451 00000100:00100000:1.0:1746143786.116355:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626841856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143786.116357:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963626842240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (808us total) trans 21474840456 rc 0/0 00000100:00100000:2.0:1746143786.116362:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12447 00000004:00080000:1.0:1746143786.116363:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c38a80/2, rc 0, transno 21474840454 00000100:00100000:1.0:1746143786.116366:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626842368:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143786.116373:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c3b800/2, rc 0, transno 21474840456 00000100:00100000:1.0:1746143786.116376:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626842240:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143786.116482:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143786.116490:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143786.116496:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143786.116501:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368da400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143786.116504:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143786.116509:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143786.116519:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143786.116521:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143786.116524:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143786.116529:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73aa779 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00000100:00100000:0.0:1746143786.116692:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626841728 00000100:00100000:0.0:1746143786.116836:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12448 00000100:00100000:0.0:1746143786.116853:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963626841728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143786.116903:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:0.0:1746143786.116905:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:0.0:1746143786.116907:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:0.0:1746143786.116909:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143786 -> 1746143786 00002000:00010000:0.0:1746143786.116924:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00000100:00100000:0.0:1746143786.116950:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963626841728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (1424us total) trans 21474840457 rc 0/0 00000100:00100000:0.0:1746143786.116955:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12448 00000100:00100000:0.0:1746143786.117170:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626842496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143786.117198:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143786.117754:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c39c00/2, rc 0, transno 21474840453 00000100:00100000:0.0:1746143786.117760:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626841600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143786.117769:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c3b100/2, rc 0, transno 21474840455 00000100:00100000:0.0:1746143786.117771:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626842112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143786.117779:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c38e00/2, rc 0, transno 21474840452 00000100:00100000:0.0:1746143786.117781:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626841472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143786.117787:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c39180/2, rc 0, transno 21474840450 00000100:00100000:0.0:1746143786.117789:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626841984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143786.117943:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626842496 00000100:00100000:3.0:1746143786.117947:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626842496 00000100:00100000:3.0:1746143786.117973:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12449 00000100:00100000:3.0:1746143786.117978:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963626842496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143786.118060:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143786.118062:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.118064:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.118066:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.118068:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143786.118093:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963626842496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (894us total) trans 17179873120 rc 0/0 00000100:00100000:3.0:1746143786.118098:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12449 00000100:00100000:3.0:1746143786.118114:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626842752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143786.118116:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626843008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143786.118134:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.118225:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626842880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143786.118271:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143786.118275:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b70a80/2, rc 0, transno 17179873120 00000100:00100000:0.0:1746143786.118278:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626842496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143786.118284:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626843520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.118407:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626843008 00000100:00100000:1.0:1746143786.118410:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626843008 00000100:00100000:3.0:1746143786.118415:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626843264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.118426:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626842752 00000100:00100000:1.0:1746143786.118428:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626842752 00000100:00100000:3.0:1746143786.118431:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143786.118439:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626843264 00000100:00100000:1.0:1746143786.118441:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626843264 00000100:00100000:1.0:1746143786.118450:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12450 00000100:00100000:3.0:1746143786.118453:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12451 00000100:00100000:1.0:1746143786.118454:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3773:x1830963626843008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143786.118457:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3771:x1830963626842752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.118495:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746143786.118501:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143786.118503:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.118505:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.118507:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.118508:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746143786.118508:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626843392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143786.118523:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143786.118527:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3771:x1830963626842752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (256us total) trans 17179873121 rc 0/0 00000100:00100000:3.0:1746143786.118532:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12451 00000100:00100000:3.0:1746143786.118541:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626842880 00000004:00080000:1.0:1746143786.118541:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c3a300/2, rc 0, transno 21474840457 00000100:00100000:3.0:1746143786.118543:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626842880 00000100:00100000:1.0:1746143786.118544:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626841728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143786.118553:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626843392 00000100:00100000:3.0:1746143786.118555:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626843392 00000100:00100000:1.0:1746143786.118560:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12452 00000100:00100000:1.0:1746143786.118564:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3771:x1830963626843264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143786.118567:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12453 00000100:00100000:3.0:1746143786.118570:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963626842880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143786.118606:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143786.118608:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.118610:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.118611:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143786 -> 1746143786 00002000:00010000:3.0:1746143786.118613:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746143786.118633:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963626842880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (138us total) trans 17179873123 rc 0/0 00000100:00100000:3.0:1746143786.118638:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12453 00000100:00100000:3.0:1746143786.118647:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12454 00000100:00100000:3.0:1746143786.118651:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963626843392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143786.118705:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963626843392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (181us total) trans 17179873124 rc 0/0 00000100:00100000:3.0:1746143786.118710:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12454 00000004:00080000:3.0:1746143786.118730:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b70700/2, rc 0, transno 17179873121 00000100:00100000:3.0:1746143786.118733:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626842752:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143786.118752:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143786.118753:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143786.118755:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:3.0:1746143786.118756:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143786.118758:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:3.0:1746143786.118775:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3773:x1830963626843008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 320us (640us total) trans 17179873122 rc 0/0 00000100:00100000:3.0:1746143786.118779:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12450 00000100:00100000:0.0:1746143786.118948:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143786.118981:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b73480/2, rc 0, transno 17179873122 00000100:00100000:0.0:1746143786.118984:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626843008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143786.118989:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143786.118994:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626842624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143786.119010:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143786.119093:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626843520 00000100:00100000:2.0:1746143786.119098:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626843520 00000100:00100000:2.0:1746143786.119115:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626842624 00000100:00100000:2.0:1746143786.119117:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626842624 00000100:00100000:3.0:1746143786.119124:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12455 00000100:00100000:3.0:1746143786.119129:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3773:x1830963626843520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143786.119132:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12456 00000100:00100000:2.0:1746143786.119135:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3773:x1830963626842624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143786.119181:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3773:x1830963626843520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (232us total) trans 17179873125 rc 0/0 00000100:00100000:3.0:1746143786.119186:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12455 00000100:00100000:2.0:1746143786.119197:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3773:x1830963626842624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (186us total) trans 21474840458 rc 0/0 00000100:00100000:2.0:1746143786.119201:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12456 00000100:00100000:1.0:1746143786.119379:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963626843264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 813us (945us total) trans 17179873126 rc 0/0 00000100:00100000:1.0:1746143786.119384:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12452 00000004:00080000:1.0:1746143786.119407:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b73b80/2, rc 0, transno 17179873123 00000100:00100000:1.0:1746143786.119410:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626842880:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143786.119417:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093725180/2, rc 0, transno 17179873124 00000100:00100000:1.0:1746143786.119419:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626843392:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143786.119465:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b73800/2, rc 0, transno 17179873126 00000100:00100000:3.0:1746143786.119469:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626843264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143786.120452:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626843136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143786.120490:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143786.120523:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e24700/2, rc 0, transno 17179873125 00000100:00100000:0.0:1746143786.120526:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626843520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143786.120536:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ef1500/2, rc 0, transno 21474840458 00000100:00100000:0.0:1746143786.120539:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626842624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143786.120556:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626843136 00000100:00100000:0.0:1746143786.120560:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626843136 00000100:00100000:0.0:1746143786.120599:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12457 00000100:00100000:0.0:1746143786.120604:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3773:x1830963626843136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143786.120679:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143786.120681:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143786.120683:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143786.120684:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143786.120686:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x398:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746143786.120706:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3773:x1830963626843136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (216us total) trans 17179873127 rc 0/0 00000100:00100000:0.0:1746143786.120711:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12457 00000004:00080000:0.0:1746143786.120730:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b73100/2, rc 0, transno 17179873127 00000100:00100000:0.0:1746143786.120733:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626843136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143786.120882:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143786.120977:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622764544 00000100:00100000:3.0:1746143786.120981:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622764544 00000100:00100000:3.0:1746143786.121016:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13003 00000100:00100000:3.0:1746143786.121021:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:32442:x1830963622764544:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143786.121037:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143786.121055:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73aa780 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc79 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.121108:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73aa780 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc79 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.121121:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73aa780 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc79 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143786.121136:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143786.121139:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143786.121142:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0a600, rc 0) 00000100:00100000:3.0:1746143786.121174:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32442:x1830963622764544:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 152us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.121179:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13003 00000100:00100000:0.0:1746143786.124577:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.125169:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622764800 00000100:00100000:2.0:1746143786.125180:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622764800 00000100:00100000:2.0:1746143786.125240:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4796 00000100:00100000:2.0:1746143786.125249:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:32442:x1830963622764800:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1746143786.125476:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:32442:x1830963622764800:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 227us (909us total) trans 8589943781 rc 0/0 00000100:00100000:2.0:1746143786.125483:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4796 00010000:00010000:2.0:1746143786.845317:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143786.945636:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.945681:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.945710:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143786.945738:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622765184 00000100:00100000:0.0:1746143786.945738:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622764928 00000100:00100000:1.0:1746143786.945746:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622765184 00000100:00100000:0.0:1746143786.945746:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622764928 00000100:00100000:1.0:1746143786.946068:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622765440 00000100:00100000:1.0:1746143786.946072:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622765440 00000100:00100000:3.0:1746143786.946077:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12458 00000100:00100000:3.0:1746143786.946087:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+13:2010:x1830963622765184:12345-192.168.202.3@tcp:16:kworker.0 00000100:00100000:2.0:1746143786.946365:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12459 00000100:00100000:2.0:1746143786.946376:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622764928:12345-192.168.202.3@tcp:16:kworker.0 00000100:00100000:3.0:1746143786.946424:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12460 00000100:00100000:3.0:1746143786.946430:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622765440:12345-192.168.202.3@tcp:16:kworker.0 00000100:00100000:2.0:1746143786.946459:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622764928:12345-192.168.202.3@tcp:16:kworker.0 Request processed in 86us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.946466:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12459 00000100:00100000:2.0:1746143786.946505:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143786.946583:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622765056 00000100:00100000:1.0:1746143786.946586:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622765056 00000100:00100000:1.0:1746143786.946606:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12461 00000100:00100000:1.0:1746143786.946611:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+14:2010:x1830963622765056:12345-192.168.202.3@tcp:16:kworker.0 00000100:00100000:0.0:1746143786.947190:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.947240:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143786.947255:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622765312 00000100:00100000:1.0:1746143786.947259:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622765312 00000100:00100000:1.0:1746143786.947278:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622765568 00000100:00100000:1.0:1746143786.947280:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622765568 00000100:00100000:1.0:1746143786.947304:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12462 00000100:00100000:1.0:1746143786.947310:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+18:2010:x1830963622765312:12345-192.168.202.3@tcp:16:kworker.0 00000100:00100000:0.0:1746143786.947322:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12463 00000100:00100000:0.0:1746143786.947329:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+15:2010:x1830963622765568:12345-192.168.202.3@tcp:16:kworker.0 00000001:00080000:0.0:1746143786.948548:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840458 is committed 00000001:00080000:0.0:1746143786.948570:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840449 is committed 00000001:00080000:0.0:1746143786.948592:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840436 is committed 00000001:00080000:0.0:1746143786.948600:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840435 is committed 00000100:00100000:2.0:1746143786.949001:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2010:x1830963622765440:12345-192.168.202.3@tcp:16:kworker.0 Request processed in 2567us (3286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.949010:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12460 00000100:00100000:1.0:1746143786.949186:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2010:x1830963622765312:12345-192.168.202.3@tcp:16:kworker.0 Request processed in 1875us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143786.949192:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12462 00000001:00080000:3.0:1746143786.949243:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873127 is committed 00000001:00080000:3.0:1746143786.949259:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873119 is committed 00000001:00080000:3.0:1746143786.949274:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873107 is committed 00000001:00080000:3.0:1746143786.949279:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873106 is committed 00000100:00100000:3.0:1746143786.949372:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2010:x1830963622765184:12345-192.168.202.3@tcp:16:kworker.0 Request processed in 3287us (3689us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143786.949379:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12458 00000100:00100000:1.0:1746143786.949472:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2010:x1830963622765056:12345-192.168.202.3@tcp:16:kworker.0 Request processed in 2861us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143786.949479:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12461 00000100:00100000:0.0:1746143786.950480:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2010:x1830963622765568:12345-192.168.202.3@tcp:16:kworker.0 Request processed in 3149us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143786.950488:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12463 00000100:00100000:0.0:1746143786.963190:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143786.963233:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143786.963274:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622765824 00000100:00100000:0.0:1746143786.963279:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143786.963284:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622765824 00000100:00100000:1.0:1746143786.963331:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622765696 00000100:00100000:1.0:1746143786.963334:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622765696 00000100:00100000:1.0:1746143786.963345:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622765952 00000100:00100000:1.0:1746143786.963348:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622765952 00000100:00100000:1.0:1746143786.963364:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 764 00000100:00100000:2.0:1746143786.963371:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 765 00000100:00100000:1.0:1746143786.963371:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93450669-9bf3-4ab5-957d-82afaeb40d5e+17:2008:x1830963622765824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143786.963381:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93450669-9bf3-4ab5-957d-82afaeb40d5e+17:2008:x1830963622765696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143786.963388:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143786.963389:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143786.963407:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880092a45800/0x87925e4cb739faf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484057a8 expref: 17 pid: 8215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143786.963407:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880092a44800/0x87925e4cb739fafd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484057d9 expref: 17 pid: 8215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.963426:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143786.963426:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143786.963478:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2008:x1830963622765696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 100us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.963484:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 765 00000100:00100000:2.0:1746143786.963499:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 766 00000100:00100000:2.0:1746143786.963503:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93450669-9bf3-4ab5-957d-82afaeb40d5e+14:2008:x1830963622765952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143786.963512:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143786.963519:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880092d0a400/0x87925e4cb739fb04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484057e0 expref: 14 pid: 8213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.963532:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143786.964147:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93450669-9bf3-4ab5-957d-82afaeb40d5e+13:2008:x1830963622765824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 775us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143786.964154:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 764 00000100:00100000:2.0:1746143786.964681:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93450669-9bf3-4ab5-957d-82afaeb40d5e+12:2008:x1830963622765952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1175us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143786.968291:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143786.968394:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622766080 00000100:00100000:1.0:1746143786.968404:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622766080 00000100:00100000:1.0:1746143786.968449:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12464 00000100:00100000:1.0:1746143786.968456:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2007:x1830963622766080:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:1.0:1746143786.968489:0:3135:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb739fb2e 00000100:00080000:1.0:1746143786.968498:0:3135:0:(import.c:66:import_set_state_nolock()) ffff880095d47000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746143786.968549:0:3135:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873127 00000100:00100000:1.0:1746143786.968674:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+2:2007:x1830963622766080:12345-192.168.202.3@tcp:9:umount.0 Request processed in 217us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143786.968681:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12464 00010000:00010000:1.0:1746143786.968705:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143786.968764:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 766 00000100:00100000:0.0:1746143786.990351:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143786.991983:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622766208 00000100:00100000:2.0:1746143786.991995:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622766208 00000100:00100000:2.0:1746143786.992053:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12465 00000100:00100000:2.0:1746143786.992061:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2007:x1830963622766208:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:2.0:1746143786.992097:0:3134:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb739fb27 00000100:00080000:2.0:1746143786.992105:0:3134:0:(import.c:66:import_set_state_nolock()) ffff880124576800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746143786.992156:0:3134:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840458 00010000:00010000:3.0:1746143786.992159:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143786.992505:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+2:2007:x1830963622766208:12345-192.168.202.3@tcp:9:umount.0 Request processed in 443us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143786.992512:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12465 00000100:00100000:0.0:1746143786.996450:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143786.996579:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622766592 00000100:00100000:1.0:1746143786.996588:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622766592 00000100:00100000:1.0:1746143786.996630:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13004 00000100:00100000:1.0:1746143786.996636:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+7:2007:x1830963622766592:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:1.0:1746143786.996669:0:6587:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb739fb0b 00000020:00010000:1.0:1746143786.996684:0:6587:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009ae70000: total 0 00000100:00080000:1.0:1746143786.996687:0:6587:0:(import.c:66:import_set_state_nolock()) ffff88009ae72000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746143786.996717:0:6587:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589943781 00000100:00100000:1.0:1746143786.996845:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+6:2007:x1830963622766592:12345-192.168.202.3@tcp:39:umount.0 Request processed in 197us (392us total) trans 8589943782 rc 0/0 00000100:00100000:1.0:1746143786.996852:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13004 00000020:00010000:2.0:1746143786.996977:0:10929:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009ae70000: total 0 00010000:00010000:2.0:1746143786.997021:0:10929:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009ae70000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1746143786.997050:0:10929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143786.997053:0:10929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746143786.997060:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2a00/0x87925e4cb739fbeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840589d expref: 5 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.997078:0:10929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143786.997080:0:10929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746143786.997082:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049e00/0x87925e4cb73a0e9f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248406301 expref: 4 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143786.997093:0:10929:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009ae70000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1746143786.997100:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143786.997101:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143786.997102:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143787.004348:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.004446:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622766720 00000100:00100000:3.0:1746143787.004456:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622766720 00000100:00100000:3.0:1746143787.004526:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13005 00000100:00100000:3.0:1746143787.004535:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+5:2007:x1830963622766720:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:3.0:1746143787.004576:0:14991:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb739fb12 00000100:00080000:3.0:1746143787.004585:0:14991:0:(import.c:66:import_set_state_nolock()) ffff88009ae71800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746143787.004605:0:14991:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967755 00010000:00010000:1.0:1746143787.004799:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746143787.004859:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746143787.004973:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4eb7703a-89bc-4175-88ce-3d4319e2cc6f+3:2007:x1830963622766720:12345-192.168.202.3@tcp:39:umount.0 Request processed in 430us (627us total) trans 4294967756 rc 0/0 00000100:00100000:3.0:1746143787.004984:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13005 00000100:00100000:2.0:1746143787.143163:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143787.143187:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626843648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746143787.143258:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143787.143303:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626843648 00000100:00100000:0.0:1746143787.143312:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626843648 00000100:00080000:1.0:1746143787.143361:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143787.143880:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:0.0:1746143787.143889:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963626843648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746143787.143942:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 522211392 pending 0 free 3914395648 avail 3682873344 00000100:00100000:0.0:1746143787.144183:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963626843648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 295us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.144190:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1746143787.144263:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626843648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746143787.462405:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.462448:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.462474:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.462522:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622766848 00000100:00100000:1.0:1746143787.462529:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622766848 00000100:00100000:0.0:1746143787.462537:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.462573:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622767360 00000100:00100000:1.0:1746143787.462576:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622767360 00000100:00100000:1.0:1746143787.462588:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622767104 00000100:00100000:1.0:1746143787.462590:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622767104 00000100:00100000:1.0:1746143787.462602:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 767 00000100:00100000:1.0:1746143787.462608:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93450669-9bf3-4ab5-957d-82afaeb40d5e+14:2010:x1830963622766848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143787.462620:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143787.462637:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 768 00010000:00010000:1.0:1746143787.462637:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091381200/0x87925e4cb739fb35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248405811 expref: 14 pid: 8215 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143787.462645:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93450669-9bf3-4ab5-957d-82afaeb40d5e+14:2010:x1830963622767360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143787.462651:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143787.462658:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091381c00/0x87925e4cb739fb43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248405849 expref: 13 pid: 8215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.462660:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143787.462667:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143787.462728:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 769 00000100:00100000:3.0:1746143787.462735:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:93450669-9bf3-4ab5-957d-82afaeb40d5e+12:2010:x1830963622767104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143787.462743:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143787.462751:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091381800/0x87925e4cb739fb3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248405842 expref: 12 pid: 8215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.462762:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143787.462863:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622767872 00000100:00100000:0.0:1746143787.462867:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622767872 00000100:00100000:0.0:1746143787.462895:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12466 00000100:00100000:0.0:1746143787.462899:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+10:2007:x1830963622767872:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:0.0:1746143787.463124:0:3134:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb739fb5f 00000020:00010000:0.0:1746143787.463130:0:3134:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d7db000: total 0 00000100:00080000:0.0:1746143787.463133:0:3134:0:(import.c:66:import_set_state_nolock()) ffff88012d7db800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1746143787.463166:0:3134:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873127 00000100:00100000:1.0:1746143787.463252:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93450669-9bf3-4ab5-957d-82afaeb40d5e+11:2010:x1830963622766848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 643us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.463259:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 767 00000100:00080000:1.0:1746143787.463276:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143787.463386:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:93450669-9bf3-4ab5-957d-82afaeb40d5e+10:2010:x1830963622767104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 650us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.463391:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 769 00000020:00010000:3.0:1746143787.463406:0:7233:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d7db000: total 0 00010000:00010000:3.0:1746143787.463409:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143787.463437:0:7233:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d7db000, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1746143787.463466:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73aa733 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc72 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143787.463490:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73a0d41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248406252 expref: 9 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.463504:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097368200/0x87925e4cb73aa725 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc5d expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143787.463518:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73a0d3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840624b expref: 7 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.463531:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73aa717 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc56 expref: 6 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143787.463546:0:7233:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d7db000, canceled 5 locks, left on hash table 0. 00010000:00010000:3.0:1746143787.463555:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143787.463556:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143787.463558:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143787.465928:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+2:2007:x1830963622767872:12345-192.168.202.3@tcp:9:umount.0 Request processed in 3006us (3368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.465938:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12466 00000100:00100000:2.0:1746143787.467472:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93450669-9bf3-4ab5-957d-82afaeb40d5e+9:2010:x1830963622767360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4822us (5016us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143787.467483:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 768 00000100:00100000:0.0:1746143787.476387:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.476487:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622768512 00000100:00100000:2.0:1746143787.476495:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622768512 00000100:00100000:2.0:1746143787.477224:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12467 00000100:00100000:2.0:1746143787.477235:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+9:2007:x1830963622768512:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:2.0:1746143787.477259:0:3134:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb739fb58 00000020:00010000:2.0:1746143787.477264:0:3134:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88007b1d0000: total 0 00000100:00080000:2.0:1746143787.477268:0:3134:0:(import.c:66:import_set_state_nolock()) ffff88009e5b3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746143787.477312:0:3134:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840458 00000020:00010000:3.0:1746143787.477316:0:10929:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88007b1d0000: total 0 00010000:00010000:3.0:1746143787.477350:0:10929:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88007b1d0000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1746143787.477388:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4200/0x87925e4cb73aa72c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc6b expref: 7 pid: 9839 timeout: 0 lvb_type: 1 00000100:00080000:1.0:1746143787.477548:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143787.478017:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+6:2007:x1830963622768512:12345-192.168.202.3@tcp:9:umount.0 Request processed in 783us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143787.478023:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12467 00010000:00010000:3.0:1746143787.478177:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e3ba00/0x87925e4cb73aa710 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc4f expref: 5 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143787.478195:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x87925e4cb73a0d48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2084864->2187263) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248406259 expref: 4 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.478210:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c800/0x87925e4cb73aa71e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc64 expref: 3 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143787.478220:0:10929:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88007b1d0000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1746143787.478232:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143787.478233:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143787.478235:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143787.490638:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.490736:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622768896 00000100:00100000:3.0:1746143787.490746:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622768896 00000100:00100000:3.0:1746143787.490891:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13006 00000100:00100000:3.0:1746143787.490898:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+8:2007:x1830963622768896:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:3.0:1746143787.490952:0:14991:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb739fb4a 00000020:00010000:3.0:1746143787.490959:0:14991:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d7dd800: total 0 00000100:00080000:3.0:1746143787.490962:0:14991:0:(import.c:66:import_set_state_nolock()) ffff88012d7d9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746143787.490992:0:14991:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589943782 00000100:00100000:3.0:1746143787.491111:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+7:2007:x1830963622768896:12345-192.168.202.3@tcp:39:umount.0 Request processed in 213us (485us total) trans 8589943783 rc 0/0 00000100:00100000:3.0:1746143787.491116:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13006 00000020:00010000:0.0:1746143787.492024:0:7232:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d7dd800: total 0 00010000:00010000:0.0:1746143787.492067:0:7232:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d7dd800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1746143787.492091:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143787.492095:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746143787.492101:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3c00/0x87925e4cb739fb6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840587a expref: 6 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.492123:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143787.492125:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143787.492128:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a600/0x87925e4cb73aa780 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc79 expref: 5 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.492136:0:7232:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d7dd800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746143787.492145:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143787.492147:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143787.492148:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143787.502700:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.503625:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622769024 00000100:00100000:1.0:1746143787.503633:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622769024 00000100:00080000:2.0:1746143787.503746:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746143787.504012:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13007 00000100:00100000:1.0:1746143787.504020:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+5:2007:x1830963622769024:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:1.0:1746143787.504045:0:6587:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb739fb51 00000100:00080000:1.0:1746143787.504052:0:6587:0:(import.c:66:import_set_state_nolock()) ffff88012d7d8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746143787.504810:0:6587:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967756 00000100:00100000:1.0:1746143787.504949:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6a6461a8-8b92-4bd8-906d-bcc86c5d26bf+3:2007:x1830963622769024:12345-192.168.202.3@tcp:39:umount.0 Request processed in 929us (2254us total) trans 4294967757 rc 0/0 00000100:00100000:1.0:1746143787.504955:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13007 00010000:00010000:2.0:1746143787.505512:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143787.555233:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.555649:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622769152 00000100:00100000:1.0:1746143787.555657:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622769152 00000100:00100000:1.0:1746143787.556863:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13008 00000100:00100000:1.0:1746143787.556871:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+260:32485:x1830963622769152:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143787.556889:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143787.556903:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73aa787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc80 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.556965:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.556976:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.556985:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.556996:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa795 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557000:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557004:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557063:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557069:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557074:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143787.557103:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:1.0:1746143787.557107:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143787.557119:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557127:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557134:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557138:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557143:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557148:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557152:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143787.557155:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557160:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557168:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143787.557170:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143787.557173:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557177:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa78e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000100:00080000:2.0:1746143787.557669:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746143787.557740:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557746:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa795 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557750:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa795 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557754:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143787.557756:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa795 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557760:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa795 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557766:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ea14900) 00010000:00010000:1.0:1746143787.557768:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143787.557770:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa795 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557774:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa795 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.557798:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73aa787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc80 expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.557809:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc80 expref: 261 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.557814:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.557816:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143787.557818:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1200, rc 0) 00000100:00100000:1.0:1746143787.557882:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+261:32485:x1830963622769152:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1012us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.557888:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13008 00000100:00100000:0.0:1746143787.563310:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.564453:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622769408 00000100:00100000:1.0:1746143787.564462:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622769408 00000100:00100000:1.0:1746143787.565316:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13009 00000100:00100000:1.0:1746143787.565326:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+261:32485:x1830963622769408:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143787.565342:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143787.565359:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa7a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc87 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.565443:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.565454:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc80 expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.565460:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.565484:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc80 expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.565497:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc80 expref: 262 pid: 6587 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143787.565507:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626843776:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143787.566354:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143787.569223:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.569324:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626843776:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143787.569344:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143787.569416:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622769536 00000100:00100000:2.0:1746143787.569421:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622769536 00010000:00010000:2.0:1746143787.569446:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc80 expref: 263 pid: 6587 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143787.569488:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5911 00000100:00100000:2.0:1746143787.569496:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2008:x1830963622769536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143787.569506:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143787.569512:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc80 expref: 263 pid: 6587 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143787.569521:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc80 expref: 263 pid: 6587 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143787.569539:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa79c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc80 expref: 263 pid: 6587 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143787.569564:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143787.569568:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143787.569575:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143787.569581:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143787.569597:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143787.569628:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+262:2008:x1830963622769536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 133us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143787.569635:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5911 00010000:00010000:1.0:1746143787.570322:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.570329:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143787.570344:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143787.570443:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73aa7a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc87 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.570457:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc87 expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.570463:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.570465:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143787.570468:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1a00, rc 0) 00000100:00100000:1.0:1746143787.570501:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32485:x1830963622769408:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5178us (7198us total) trans 8589943784 rc 0/0 00000100:00100000:1.0:1746143787.570507:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13009 00000100:00100000:0.0:1746143787.575683:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.575876:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622769664 00000100:00100000:1.0:1746143787.575886:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622769664 00000100:00100000:1.0:1746143787.575962:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13010 00000100:00100000:1.0:1746143787.575970:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32485:x1830963622769664:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143787.575996:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143787.576015:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7b8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc8e expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.576103:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.576115:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc87 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.576121:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.576151:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc87 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.576161:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc87 expref: 263 pid: 6587 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143787.576172:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626843904:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143787.576259:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143787.578533:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963626843904:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143787.578560:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143787.580470:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.580566:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622769792 00000100:00100000:3.0:1746143787.580574:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622769792 00010000:00010000:3.0:1746143787.580611:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc87 expref: 264 pid: 6587 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143787.580659:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5912 00000100:00100000:3.0:1746143787.580668:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:2008:x1830963622769792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143787.580682:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143787.580688:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc87 expref: 264 pid: 6587 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143787.580699:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc87 expref: 264 pid: 6587 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143787.580728:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7aa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc87 expref: 264 pid: 6587 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143787.580757:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143787.580761:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143787.580773:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143787.580779:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143787.580804:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143787.580851:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:2008:x1830963622769792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 185us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.580858:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5912 00010000:00010000:1.0:1746143787.581024:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.581032:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143787.581084:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:1.0:1746143787.581087:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143787.581103:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.581131:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc8e expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.581156:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc8e expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.581162:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.581165:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143787.581167:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0200, rc 0) 00000100:00100000:1.0:1746143787.581192:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32485:x1830963622769664:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5223us (5519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.581623:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13010 00000100:00100000:0.0:1746143787.587200:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.587441:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622770048 00000100:00100000:1.0:1746143787.587452:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622770048 00000100:00100000:1.0:1746143787.587712:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13011 00000100:00100000:1.0:1746143787.587722:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32485:x1830963622770048:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143787.587746:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143787.587768:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc95 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.587898:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73aa7cd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.587995:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73aa7cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.588006:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73aa7cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143787.588019:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00010000:00010000:1.0:1746143787.588116:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa7c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc95 expref: 265 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.588129:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73aa7cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc95 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.588137:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.588140:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143787.588142:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0c00, rc 0) 00000100:00100000:1.0:1746143787.588199:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:32485:x1830963622770048:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 479us (1296us total) trans 8589943785 rc 0/0 00000100:00100000:1.0:1746143787.588205:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13011 00000100:00100000:0.0:1746143787.590551:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.590587:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.590615:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.590813:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622770176 00000100:00100000:1.0:1746143787.590821:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622770176 00000100:00100000:2.0:1746143787.590869:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622770432 00000100:00100000:2.0:1746143787.590874:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622770432 00000100:00100000:3.0:1746143787.590934:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622770688 00000100:00100000:1.0:1746143787.590938:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12468 00000100:00100000:3.0:1746143787.590939:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622770688 00000100:00100000:1.0:1746143787.590945:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+21:2008:x1830963622770176:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:3.0:1746143787.590958:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12469 00000100:00100000:3.0:1746143787.590962:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+21:2008:x1830963622770688:12345-192.168.202.3@tcp:1:lfs.0 00002000:00010000:3.0:1746143787.590999:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4964768, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x15f0 00002000:00010000:1.0:1746143787.590999:0:3135:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x7d8 00010000:00010000:3.0:1746143787.591006:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa7e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591006:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.591018:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143787.591018:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.591020:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143787.591020:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.591024:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa7e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591024:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.591036:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa7e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591036:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.591048:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa7e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591048:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591055:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.591059:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa7e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591061:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.591064:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa7e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591067:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143787.591068:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0ba00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143787.591070:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa7e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591070:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.591077:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa7e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591077:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.591088:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa7e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591088:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.591094:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa7e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591098:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73aa7db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143787.591164:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.591185:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+21:2008:x1830963622770176:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 241us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.591191:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12468 00000100:00080000:2.0:1746143787.591217:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746143787.591234:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143787.591262:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622770304 00000100:00100000:1.0:1746143787.591265:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622770304 00000100:00100000:0.0:1746143787.591342:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.591469:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622770560 00000100:00100000:1.0:1746143787.591472:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622770560 00000100:00100000:1.0:1746143787.591488:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12470 00000100:00100000:1.0:1746143787.591492:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963622770432:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:0.0:1746143787.591496:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.591519:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622770816 00002000:00010000:1.0:1746143787.591520:0:3135:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x800 00000100:00100000:0.0:1746143787.591522:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622770816 00010000:00010000:1.0:1746143787.591524:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73aa7e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591530:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143787.591532:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143787.591534:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73aa7e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143787.591537:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12471 00010000:00010000:1.0:1746143787.591542:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73aa7e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143787.591542:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622770304:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143787.591550:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73aa7e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591560:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73aa7e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143787.591560:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x808 00010000:00010000:0.0:1746143787.591564:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73aa7f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591566:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73aa7e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591570:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143787.591571:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b8400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143787.591571:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143787.591573:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73aa7e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591573:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73aa7f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591578:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73aa7e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591581:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73aa7f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591585:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73aa7e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591588:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73aa7f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591591:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73aa7e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591594:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73aa7f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591599:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73aa7f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591603:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143787.591605:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73aa7f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591610:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73aa7f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143787.591622:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963622770432:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 129us (1034us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143787.591622:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73aa7f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143787.591627:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12470 00010000:00010000:0.0:1746143787.591628:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73aa7f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143787.591639:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12472 00000100:00100000:1.0:1746143787.591643:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+21:2008:x1830963622770560:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:0.0:1746143787.591654:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963622770304:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 113us (491us total) trans 0 rc 0/0 00002000:00010000:1.0:1746143787.591659:0:3135:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x808 00000100:00100000:0.0:1746143787.591659:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12471 00010000:00010000:1.0:1746143787.591664:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73aa7f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143787.591668:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12473 00010000:00010000:1.0:1746143787.591670:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143787.591672:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143787.591672:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+21:2008:x1830963622770816:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143787.591674:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73aa7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591681:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73aa7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143787.591687:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x1008 00010000:00010000:1.0:1746143787.591688:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73aa7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591690:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73aa7fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591694:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73aa7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591696:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.591697:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.591699:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73aa7fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591700:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73aa7f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591705:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b8a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143787.591705:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73aa7fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591707:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73aa7f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591711:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73aa7fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591712:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73aa7f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591719:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73aa7f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591721:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73aa7fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591726:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73aa7fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.591729:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73aa7f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591730:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143787.591733:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73aa7fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591737:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73aa7fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591743:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73aa7fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.591748:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73aa7fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143787.591750:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+21:2008:x1830963622770560:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 106us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.591754:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12472 00000100:00100000:0.0:1746143787.591767:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+21:2008:x1830963622770816:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.591772:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12473 00000100:00100000:3.0:1746143787.591928:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+20:2008:x1830963622770688:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 948us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.591934:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12469 00000100:00100000:0.0:1746143787.596107:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.596211:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622771072 00000100:00100000:1.0:1746143787.596221:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622771072 00000100:00100000:1.0:1746143787.596323:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13012 00000100:00100000:1.0:1746143787.596331:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:32485:x1830963622771072:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:1.0:1746143787.596386:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143787.596410:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73aa7bf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc8e expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.596428:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.596432:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143787.596459:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.596469:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.596477:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000040:00080000:1.0:1746143787.596717:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2754, 88 off230080 00000004:00080000:1.0:1746143787.596724:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846820811114ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143787.597334:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2706, 88 off226200 00000004:00080000:1.0:1746143787.597340:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846821428158ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143787.597364:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2707, 88 off226288 00000004:00080000:1.0:1746143787.597366:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846821454299ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143787.597375:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2755, 88 off230168 00000004:00080000:1.0:1746143787.597378:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846821465628ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143787.597385:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2756, 88 off230256 00000004:00080000:1.0:1746143787.597388:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846821476341ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143787.597415:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2708, 88 off226376 00000004:00080000:1.0:1746143787.597418:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846821506043ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143787.597438:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2709, 88 off226464 00000004:00080000:1.0:1746143787.597441:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846821529204ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143787.597451:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2710, 88 off226552 00000004:00080000:1.0:1746143787.597454:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846821541396ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143787.597463:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2757, 88 off230344 00000004:00080000:1.0:1746143787.597465:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846821553076ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143787.597472:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2711, 88 off226640 00000004:00080000:1.0:1746143787.597474:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846821562159ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143787.597482:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2758, 88 off230432 00000004:00080000:1.0:1746143787.597484:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846821572264ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143787.597491:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2712, 88 off226728 00000004:00080000:1.0:1746143787.597493:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846821581383ns, next at 770855090093ns, rc = 0 00000040:00080000:1.0:1746143787.597501:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2759, 88 off230520 00000004:00080000:1.0:1746143787.597504:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846821591454ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143787.597510:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2760, 88 off230608 00000004:00080000:1.0:1746143787.597512:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846821600134ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143787.597518:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2761, 88 off230696 00000004:00080000:1.0:1746143787.597521:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846821608471ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143787.597527:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2762, 88 off230784 00000004:00080000:1.0:1746143787.597529:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846821616548ns, next at 775898816462ns, rc = 0 00000040:00080000:1.0:1746143787.597534:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2713, 88 off226816 00000004:00080000:1.0:1746143787.597536:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846821624111ns, next at 770855090093ns, rc = 0 00000001:00080000:3.0:1746143787.602475:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943786 is committed 00000004:00080000:3.0:1746143787.602490:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1942 committed 00000004:00080000:3.0:1746143787.602974:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1988 committed 00000004:00080000:3.0:1746143787.602996:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1987 committed 00000004:00080000:3.0:1746143787.602999:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1986 committed 00000004:00080000:3.0:1746143787.603001:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1985 committed 00000004:00080000:3.0:1746143787.603003:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1941 committed 00000004:00080000:3.0:1746143787.603004:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1984 committed 00000004:00080000:3.0:1746143787.603006:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1940 committed 00000004:00080000:3.0:1746143787.603008:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1983 committed 00000004:00080000:3.0:1746143787.603009:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1939 committed 00000004:00080000:3.0:1746143787.603011:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1938 committed 00000004:00080000:3.0:1746143787.603012:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1937 committed 00000004:00080000:3.0:1746143787.603014:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1982 committed 00000004:00080000:3.0:1746143787.603015:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1981 committed 00000004:00080000:3.0:1746143787.603017:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1936 committed 00000004:00080000:3.0:1746143787.603018:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1935 committed 00000004:00080000:3.0:1746143787.603020:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1980 committed 00000001:00100000:3.0:1746143787.603028:0:8209:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a6461a8-8b92-4bd8-906d-bcc86c5d26bf 00000001:00080000:3.0:1746143787.603034:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943783 is committed 00000001:00100000:3.0:1746143787.603038:0:8209:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4eb7703a-89bc-4175-88ce-3d4319e2cc6f 00000001:00080000:3.0:1746143787.603041:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943782 is committed 00000020:00000080:3.0:1746143787.603045:0:8209:0:(genops.c:904:class_export_put()) final put ffff88009ae70000/4eb7703a-89bc-4175-88ce-3d4319e2cc6f 00000020:00000080:3.0:1746143787.603067:0:8209:0:(genops.c:904:class_export_put()) final put ffff88012d7dd800/6a6461a8-8b92-4bd8-906d-bcc86c5d26bf 00000100:00100000:1.0:1746143787.603241:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626844160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.603311:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.603341:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626844672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.603358:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.603377:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143787.603382:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626844032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.603397:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.603410:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626844544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.603422:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.603439:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626844416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.603455:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.603467:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626844928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.603480:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.603492:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143787.603496:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626844288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.603513:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.603524:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626844800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.603538:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1746143787.603579:0:1012:0:(genops.c:863:class_export_destroy()) destroying export ffff88009ae70000/4eb7703a-89bc-4175-88ce-3d4319e2cc6f for lustre-MDT0000 00000100:00100000:0.0:1746143787.603898:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626845184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143787.603939:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626845056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.604728:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626845440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.604747:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1746143787.604876:0:1012:0:(genops.c:863:class_export_destroy()) destroying export ffff88012d7dd800/6a6461a8-8b92-4bd8-906d-bcc86c5d26bf for lustre-MDT0000 00000020:00000080:2.0:1746143787.604930:0:1012:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009ae72000 for lustre-MDT0000 00000020:00000080:2.0:1746143787.604935:0:1012:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88012d7d9000 for lustre-MDT0000 00000100:00100000:1.0:1746143787.605067:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626845952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.605085:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143787.605153:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626844160 00000100:00100000:3.0:1746143787.605162:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626844160 00000100:00100000:3.0:1746143787.605206:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626844672 00000100:00100000:3.0:1746143787.605209:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626844672 00000100:00100000:3.0:1746143787.605220:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626844032 00000100:00100000:3.0:1746143787.605222:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626844032 00000100:00100000:3.0:1746143787.605232:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626844544 00000100:00100000:3.0:1746143787.605234:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626844544 00000100:00100000:3.0:1746143787.605243:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12474 00000100:00100000:3.0:1746143787.605251:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963626844160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143787.605419:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963626844160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (2107us total) trans 21474840459 rc 0/0 00000100:00100000:3.0:1746143787.605426:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12474 00000100:00100000:3.0:1746143787.605441:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626844416 00000100:00100000:3.0:1746143787.605444:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626844416 00000100:00100000:3.0:1746143787.605452:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626844928 00000100:00100000:3.0:1746143787.605454:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626844928 00000100:00100000:3.0:1746143787.605460:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626844288 00000100:00100000:3.0:1746143787.605462:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626844288 00000100:00100000:3.0:1746143787.605468:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626844800 00000100:00100000:3.0:1746143787.605469:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626844800 00000100:00100000:3.0:1746143787.605476:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626845440 00000100:00100000:3.0:1746143787.605477:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626845440 00000100:00100000:3.0:1746143787.605490:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12475 00000100:00100000:3.0:1746143787.605494:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626844672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143787.605800:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626845952 00000100:00100000:2.0:1746143787.605803:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626845952 00000100:00100000:2.0:1746143787.605815:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12476 00000100:00100000:2.0:1746143787.605819:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963626844032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.605966:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12477 00000100:00100000:0.0:1746143787.605972:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963626844544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143787.606305:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3772:x1830963626844672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 809us (2945us total) trans 21474840460 rc 0/0 00000100:00100000:1.0:1746143787.606306:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143787.606310:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12475 00000100:00100000:1.0:1746143787.606313:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626845312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143787.606319:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12478 00000100:00100000:3.0:1746143787.606324:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963626844416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.606332:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.606339:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626845824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.606352:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.606371:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626845312 00000100:00100000:1.0:1746143787.606373:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626845312 00000100:00100000:3.0:1746143787.606380:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3774:x1830963626844416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (2923us total) trans 21474840463 rc 0/0 00000100:00100000:3.0:1746143787.606384:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12478 00000100:00100000:1.0:1746143787.606390:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626845824 00000100:00100000:1.0:1746143787.606391:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626845824 00000100:00100000:3.0:1746143787.606393:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12479 00000100:00100000:3.0:1746143787.606396:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963626844928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.606400:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12480 00000100:00100000:1.0:1746143787.606404:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963626844288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143787.606445:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3774:x1830963626844928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (2963us total) trans 21474840464 rc 0/0 00000100:00100000:3.0:1746143787.606450:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12479 00000100:00100000:1.0:1746143787.606457:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3774:x1830963626844288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (2943us total) trans 21474840465 rc 0/0 00000100:00100000:3.0:1746143787.606458:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12481 00000100:00100000:1.0:1746143787.606461:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12480 00000100:00100000:3.0:1746143787.606463:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3774:x1830963626844800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.606469:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12482 00000100:00100000:1.0:1746143787.606472:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3774:x1830963626845440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143787.606519:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3774:x1830963626844800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (2979us total) trans 21474840466 rc 0/0 00000100:00100000:3.0:1746143787.606523:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12481 00000100:00100000:3.0:1746143787.606532:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12483 00000100:00100000:1.0:1746143787.606534:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3774:x1830963626845440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (1786us total) trans 17179873128 rc 0/0 00000100:00100000:3.0:1746143787.606536:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3774:x1830963626845952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.606539:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12482 00000100:00100000:1.0:1746143787.606546:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12484 00000100:00100000:1.0:1746143787.606549:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3774:x1830963626845312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143787.606586:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3774:x1830963626845952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (1500us total) trans 17179873129 rc 0/0 00000100:00100000:1.0:1746143787.606586:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3774:x1830963626845312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 36us (253us total) trans 17179873130 rc 0/0 00000100:00100000:1.0:1746143787.606591:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12484 00000100:00100000:2.0:1746143787.607071:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963626844032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1250us (3672us total) trans 21474840461 rc 0/0 00000100:00100000:3.0:1746143787.607169:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12483 00000100:00100000:3.0:1746143787.607194:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12485 00000100:00100000:3.0:1746143787.607199:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3774:x1830963626845824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143787.607225:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12476 00000100:00100000:3.0:1746143787.607264:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3774:x1830963626845824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (911us total) trans 17179873131 rc 0/0 00000100:00100000:3.0:1746143787.607269:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12485 00000100:00080000:3.0:1746143787.607291:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746143787.607294:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143787.607344:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963626844544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1373us (3921us total) trans 21474840462 rc 0/0 00000100:00100000:0.0:1746143787.607350:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12477 00000100:00100000:1.0:1746143787.607353:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873127 gen 2 00000004:00080000:1.0:1746143787.607358:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093417480, transno 17179873086 00000100:00100000:0.0:1746143787.607387:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143787.607688:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093415500, transno 17179873087 00000004:00080000:1.0:1746143787.607691:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e2d80, transno 17179873088 00000004:00080000:1.0:1746143787.607693:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e1c00, transno 17179873089 00000004:00080000:1.0:1746143787.607695:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e3480, transno 17179873090 00000004:00080000:1.0:1746143787.607697:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093414380, transno 17179873091 00000004:00080000:1.0:1746143787.607699:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093414000, transno 17179873092 00000004:00080000:1.0:1746143787.607701:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e2300, transno 17179873093 00000004:00080000:1.0:1746143787.607703:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e3800, transno 17179873108 00000004:00080000:1.0:1746143787.607705:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c68e00, transno 17179873109 00000004:00080000:1.0:1746143787.607707:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800919e6300, transno 17179873110 00000004:00080000:1.0:1746143787.607709:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b9880, transno 17179873111 00000004:00080000:1.0:1746143787.607711:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009719e300, transno 17179873112 00000004:00080000:1.0:1746143787.607713:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e25500, transno 17179873113 00000004:00080000:1.0:1746143787.607715:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7e1880, transno 17179873114 00000004:00080000:1.0:1746143787.607717:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c6a300, transno 17179873115 00000004:00080000:1.0:1746143787.607719:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b70a80, transno 17179873120 00000004:00080000:1.0:1746143787.607721:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b70700, transno 17179873121 00000004:00080000:1.0:1746143787.607723:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b73480, transno 17179873122 00000004:00080000:1.0:1746143787.607724:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b73b80, transno 17179873123 00000004:00080000:1.0:1746143787.607726:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093725180, transno 17179873124 00000004:00080000:1.0:1746143787.607728:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e24700, transno 17179873125 00000004:00080000:1.0:1746143787.607730:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b73800, transno 17179873126 00000004:00080000:1.0:1746143787.607732:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b73100, transno 17179873127 00000100:00100000:1.0:1746143787.607737:0:3774:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800911f9880 x1830963626845312/t17179873130(17179873130) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143803 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746143787.607746:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f9880/2, rc 0, transno 17179873130 00000100:00100000:0.0:1746143787.607748:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626845696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.607751:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626845312:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143787.607762:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9500/2, rc 0, transno 17179873131 00000100:00100000:1.0:1746143787.607765:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626845824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143787.607770:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143787.607772:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911fa680/2, rc 0, transno 17179873128 00000100:00100000:1.0:1746143787.607775:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626845440:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143787.607781:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b8700/2, rc 0, transno 17179873129 00000100:00100000:1.0:1746143787.607783:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626845952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143787.607786:0:3772:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840458 gen 2 00000004:00080000:0.0:1746143787.607789:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b70e00, transno 21474840421 00000004:00080000:0.0:1746143787.607794:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b71c00, transno 21474840422 00000004:00080000:0.0:1746143787.607797:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b70380, transno 21474840423 00000004:00080000:0.0:1746143787.607799:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b71180, transno 21474840424 00000004:00080000:0.0:1746143787.607801:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b72d80, transno 21474840425 00000004:00080000:0.0:1746143787.607803:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f648700, transno 21474840426 00000004:00080000:0.0:1746143787.607806:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b71500, transno 21474840427 00000004:00080000:0.0:1746143787.607808:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b72680, transno 21474840428 00000004:00080000:0.0:1746143787.607810:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b72300, transno 21474840429 00000004:00080000:0.0:1746143787.607813:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e31c00, transno 21474840437 00000004:00080000:0.0:1746143787.607815:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33800, transno 21474840438 00000004:00080000:0.0:1746143787.607817:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30a80, transno 21474840439 00000004:00080000:0.0:1746143787.607819:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32300, transno 21474840440 00000004:00080000:0.0:1746143787.607821:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30e00, transno 21474840441 00000004:00080000:0.0:1746143787.607823:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30700, transno 21474840442 00000004:00080000:0.0:1746143787.607825:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093727480, transno 21474840443 00000004:00080000:0.0:1746143787.607836:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33b80, transno 21474840444 00000004:00080000:0.0:1746143787.607839:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e31880, transno 21474840445 00000004:00080000:0.0:1746143787.607842:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c39180, transno 21474840450 00000004:00080000:0.0:1746143787.607844:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c38000, transno 21474840451 00000004:00080000:0.0:1746143787.607847:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c38e00, transno 21474840452 00000004:00080000:0.0:1746143787.607849:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c39c00, transno 21474840453 00000004:00080000:0.0:1746143787.607850:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c38a80, transno 21474840454 00000004:00080000:0.0:1746143787.607852:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c3b100, transno 21474840455 00000004:00080000:0.0:1746143787.607854:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c3b800, transno 21474840456 00000004:00080000:0.0:1746143787.607856:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c3a300, transno 21474840457 00000004:00080000:0.0:1746143787.607858:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef1500, transno 21474840458 00000100:00100000:0.0:1746143787.607863:0:3772:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880090e24e00 x1830963626844032/t21474840461(21474840461) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143803 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143787.607869:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e24e00/2, rc 0, transno 21474840461 00000100:00100000:0.0:1746143787.607872:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626844032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143787.607972:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626845184 00000004:00080000:2.0:1746143787.607975:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 24 done 00000100:00100000:3.0:1746143787.607976:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626845184 00000004:00080000:1.0:1746143787.608016:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e25880/2, rc 0, transno 21474840465 00000100:00100000:1.0:1746143787.608020:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626844288:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143787.608025:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e26a00/2, rc 0, transno 21474840462 00000004:00080000:1.0:1746143787.608028:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35ad80/2, rc 0, transno 21474840466 00000100:00100000:0.0:1746143787.608028:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626844544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.608031:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626844800:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143787.608036:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e27100/2, rc 0, transno 21474840459 00000004:00080000:1.0:1746143787.608037:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e26680/2, rc 0, transno 21474840463 00000100:00100000:1.0:1746143787.608039:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626844416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.608039:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626844160:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143787.608045:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35b480/2, rc 0, transno 21474840464 00000004:00080000:0.0:1746143787.608046:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35a300/2, rc 0, transno 21474840460 00000100:00100000:1.0:1746143787.608047:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626844928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.608048:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626844672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.608061:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626845696 00000100:00100000:1.0:1746143787.608063:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626845696 00000100:00100000:1.0:1746143787.608078:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12486 00000100:00100000:1.0:1746143787.608083:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963626845184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143787.608085:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12487 00000100:00100000:0.0:1746143787.608089:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963626845696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.608153:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626845184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (765us total) trans 17179873132 rc 0/0 00000100:00100000:0.0:1746143787.608157:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963626845696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (387us total) trans 17179873133 rc 0/0 00000100:00100000:1.0:1746143787.608159:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12486 00000100:00100000:0.0:1746143787.608162:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12487 00000004:00080000:0.0:1746143787.608177:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f9c00/2, rc 0, transno 17179873132 00000100:00100000:0.0:1746143787.608180:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626845184:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143787.608186:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9c00/2, rc 0, transno 17179873133 00000100:00100000:0.0:1746143787.608188:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626845696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143787.608243:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143787.608260:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626845568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143787.608278:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143787.608294:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626845056 00000100:00100000:3.0:1746143787.608297:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626845056 00000004:00080000:1.0:1746143787.608298:0:8224:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 27 done 00000100:00100000:3.0:1746143787.608309:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626845568 00000100:00100000:3.0:1746143787.608311:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626845568 00000100:00100000:3.0:1746143787.608320:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12488 00000100:00100000:3.0:1746143787.608324:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963626845056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.608333:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12489 00000100:00100000:1.0:1746143787.608338:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963626845568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143787.608378:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963626845056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (136us total) trans 17179873134 rc 0/0 00000100:00100000:1.0:1746143787.608378:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963626845568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (98us total) trans 17179873135 rc 0/0 00000100:00100000:1.0:1746143787.608383:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12489 00000100:00100000:0.0:1746143787.608411:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143787.608418:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626846080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.608435:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143787.608449:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626846080 00000100:00100000:2.0:1746143787.608453:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626846080 00000100:00100000:3.0:1746143787.608468:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12488 00000100:00100000:2.0:1746143787.608476:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12490 00000100:00100000:2.0:1746143787.608485:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963626846080:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143787.608497:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f8380/2, rc 0, transno 17179873134 00000100:00100000:3.0:1746143787.608500:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626845056:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143787.608506:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373bad80/2, rc 0, transno 17179873135 00000100:00100000:3.0:1746143787.608509:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626845568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143787.608549:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963626846080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (113us total) trans 21474840467 rc 0/0 00000100:00100000:2.0:1746143787.608554:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12490 00000004:00080000:0.0:1746143787.608565:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093417480/2, rc 0, transno 21474840467 00000100:00100000:0.0:1746143787.608568:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626846080:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746143787.608662:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800911f8e00 reply state ffff880096ebe000 transno 8589943786 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.608680:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.608688:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.608691:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746143787.608696:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746143787.608781:0:6587:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746143787.608799:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32485:x1830963622771072:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 12467us (12700us total) trans 8589943786 rc 0/0 00000100:00100000:1.0:1746143787.608805:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13012 00010000:00010000:0.0:1746143787.608875:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.608883:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.608889:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.608894:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b9200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143787.608898:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.608904:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.608927:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143787.608929:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143787.608932:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.608936:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73aa805 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143787.612064:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.612201:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622771200 00000100:00100000:1.0:1746143787.612209:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622771200 00000100:00100000:1.0:1746143787.612266:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13013 00000100:00100000:1.0:1746143787.612274:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+261:32485:x1830963622771200:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143787.612303:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143787.612322:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73aa80c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bc9c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.612382:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73aa80c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc9c expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.612395:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73aa80c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc9c expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.612412:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.612415:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143787.612418:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049c00, rc 0) 00000100:00100000:1.0:1746143787.612475:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:32485:x1830963622771200:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 201us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.612481:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13013 00000100:00100000:0.0:1746143787.615879:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.616082:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622771328 00000100:00100000:3.0:1746143787.616093:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622771328 00000100:00100000:3.0:1746143787.616157:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13014 00000100:00100000:3.0:1746143787.616165:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+262:32485:x1830963622771328:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143787.616189:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143787.616211:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa813 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bca3 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.616311:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6bb200/0x87925e4cb73aa81a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143787.616323:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6bb200/0x87925e4cb73aa81a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143787.616334:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6bb200/0x87925e4cb73aa81a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143787.616366:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34a:0x0]: returning size 9159072 00000004:00200000:3.0:1746143787.616371:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143787.616386:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6bb200/0x87925e4cb73aa81a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143787.616413:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0ba00/0x87925e4cb73aa813 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bca3 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.616443:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6bb200/0x87925e4cb73aa81a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bca3 expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.616451:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143787.616454:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143787.616457:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6bb200, rc 0) 00000100:00100000:3.0:1746143787.616502:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+263:32485:x1830963622771328:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 338us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.616508:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13014 00000100:00100000:0.0:1746143787.620397:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.620428:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.620449:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.620468:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622771456 00000100:00100000:0.0:1746143787.620475:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622771456 00000100:00100000:0.0:1746143787.620524:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622771584 00000100:00100000:0.0:1746143787.620526:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622771584 00000100:00100000:0.0:1746143787.620539:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622771712 00000100:00100000:0.0:1746143787.620541:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622771712 00000100:00100000:0.0:1746143787.620554:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12491 00000100:00100000:0.0:1746143787.620562:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+20:2009:x1830963622771456:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143787.620582:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143787.620602:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa821 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bcaa expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143787.620626:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 1048576, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x7d8 00010000:00010000:0.0:1746143787.620649:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.620650:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.620660:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcaa expref: 21 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.620676:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcaa expref: 21 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.620687:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1a00, rc 0) 00000100:00100000:0.0:1746143787.620731:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+21:2009:x1830963622771456:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 169us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.620737:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12491 00000100:00100000:0.0:1746143787.620752:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12492 00000100:00100000:0.0:1746143787.620756:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622771584:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143787.620763:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143787.620783:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1400/0x87925e4cb73aa828 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bcb1 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143787.620796:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 2097152, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x808 00010000:00010000:0.0:1746143787.620805:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.620806:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.620810:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1400/0x87925e4cb73aa828 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb1 expref: 23 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.620819:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1400/0x87925e4cb73aa828 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb1 expref: 23 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.620825:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1400, rc 0) 00000100:00100000:0.0:1746143787.620848:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622771584:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 92us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.620853:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12492 00000100:00100000:0.0:1746143787.620861:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12493 00000100:00100000:0.0:1746143787.620864:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622771712:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143787.620869:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143787.620875:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73aa82f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bcb8 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143787.620884:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 2097152, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x800 00010000:00010000:0.0:1746143787.620890:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.620891:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.620894:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73aa82f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb8 expref: 23 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.620902:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73aa82f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb8 expref: 23 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.620908:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1800, rc 0) 00000100:00100000:0.0:1746143787.620945:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622771712:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 80us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.620951:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12493 00000100:00100000:0.0:1746143787.620995:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.621006:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622771840 00000100:00100000:0.0:1746143787.621009:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622771840 00000100:00100000:0.0:1746143787.621022:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12494 00000100:00100000:0.0:1746143787.621026:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+21:2009:x1830963622771840:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143787.621031:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143787.621039:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa836 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bcbf expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143787.621049:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 2097152, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x808 00010000:00010000:0.0:1746143787.621055:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.621057:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.621061:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa836 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcbf expref: 22 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.621070:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa836 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcbf expref: 22 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.621076:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1200, rc 0) 00000100:00100000:0.0:1746143787.621089:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622771840:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 63us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.621094:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12494 00000100:00100000:0.0:1746143787.621143:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.621151:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622771968 00000100:00100000:0.0:1746143787.621154:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622771968 00000100:00100000:0.0:1746143787.621167:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12495 00000100:00100000:0.0:1746143787.621171:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963622771968:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143787.621176:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143787.621185:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73aa83d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bcc6 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143787.621194:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 4964768, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x15f0 00010000:00010000:0.0:1746143787.621201:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.621202:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.621205:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73aa83d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcc6 expref: 23 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.621214:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73aa83d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcc6 expref: 23 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.621225:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b47a200, rc 0) 00000100:00100000:0.0:1746143787.621238:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622771968:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 66us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.621242:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12495 00000100:00100000:0.0:1746143787.621289:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.621301:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622772096 00000100:00100000:0.0:1746143787.621305:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622772096 00000100:00100000:0.0:1746143787.621322:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12496 00000100:00100000:0.0:1746143787.621326:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963622772096:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143787.621332:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143787.621342:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73aa844 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bccd expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143787.621354:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 4194304, mtime: 0x68140a2a, atime: 0x68140a2a, ctime: 0x68140a2a, blocks: 0x1008 00010000:00010000:0.0:1746143787.621362:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.621363:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.621368:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73aa844 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bccd expref: 24 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.621376:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73aa844 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bccd expref: 24 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.621382:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b47aa00, rc 0) 00000100:00100000:0.0:1746143787.621396:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622772096:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 70us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.621405:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12496 00000100:00100000:0.0:1746143787.625124:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.625155:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.625175:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.626020:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.626251:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.626269:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622772224 00000100:00100000:1.0:1746143787.626280:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622772224 00000100:00100000:1.0:1746143787.626326:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622772352 00000100:00100000:1.0:1746143787.626329:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622772352 00000100:00100000:1.0:1746143787.626344:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622772480 00000100:00100000:1.0:1746143787.626346:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622772480 00000100:00100000:1.0:1746143787.626358:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622772608 00000100:00100000:1.0:1746143787.626360:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622772608 00000100:00100000:1.0:1746143787.626373:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12497 00000100:00100000:1.0:1746143787.626382:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622772224:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143787.626503:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622772224:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 122us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.626510:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12497 00000100:00100000:1.0:1746143787.626524:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12498 00000100:00100000:1.0:1746143787.626528:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963622772352:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143787.626563:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963622772352:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 34us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.626568:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12498 00000100:00100000:1.0:1746143787.626575:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12499 00000100:00100000:1.0:1746143787.626580:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622772480:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143787.626605:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622772480:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 25us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.626609:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12499 00000100:00100000:1.0:1746143787.626616:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12500 00000100:00100000:1.0:1746143787.626620:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622772608:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143787.626643:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622772608:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 23us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.626648:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12500 00000100:00100000:0.0:1746143787.627660:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622772736 00000100:00100000:0.0:1746143787.627667:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622772736 00000100:00100000:0.0:1746143787.628070:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12501 00000100:00100000:0.0:1746143787.628077:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622772736:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143787.628145:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622772736:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 68us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.628150:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12501 00000100:00100000:0.0:1746143787.628251:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.628264:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622772864 00000100:00100000:0.0:1746143787.628267:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622772864 00000100:00100000:0.0:1746143787.628283:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12502 00000100:00100000:0.0:1746143787.628287:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622772864:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143787.628323:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622772864:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 36us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.628328:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12502 00000100:00100000:0.0:1746143787.631432:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.631466:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.631486:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.632241:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.632478:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622773120 00000100:00100000:3.0:1746143787.632488:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622773120 00000100:00100000:3.0:1746143787.632531:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622773376 00000100:00100000:3.0:1746143787.632533:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622773376 00000100:00100000:3.0:1746143787.632544:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622773632 00000100:00100000:3.0:1746143787.632546:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622773632 00000100:00100000:3.0:1746143787.632555:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622772992 00000100:00100000:3.0:1746143787.632556:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622772992 00000100:00100000:3.0:1746143787.632567:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12503 00000100:00100000:3.0:1746143787.632574:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963622773120:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143787.632675:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963622773120:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 101us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.632681:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12503 00000100:00100000:3.0:1746143787.632695:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12504 00000100:00100000:3.0:1746143787.632699:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622773376:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143787.632730:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622773376:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 30us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.632735:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12504 00000100:00100000:3.0:1746143787.632741:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12505 00000100:00100000:3.0:1746143787.632744:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622773632:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143787.632766:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622773632:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 22us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.632771:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12505 00000100:00100000:3.0:1746143787.632776:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12506 00000100:00100000:3.0:1746143787.632780:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622772992:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143787.632800:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622772992:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 19us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.632804:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12506 00000100:00100000:1.0:1746143787.633140:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.633155:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622773248 00000100:00100000:1.0:1746143787.633158:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622773248 00000100:00100000:1.0:1746143787.633173:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12507 00000100:00100000:1.0:1746143787.633178:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622773248:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143787.633213:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963622773248:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 35us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.633217:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12507 00000100:00100000:1.0:1746143787.633290:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.633302:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622773504 00000100:00100000:1.0:1746143787.633305:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622773504 00000100:00100000:1.0:1746143787.633318:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12508 00000100:00100000:1.0:1746143787.633322:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622773504:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143787.633353:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963622773504:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 30us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.633357:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12508 00000100:00100000:0.0:1746143787.635723:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.635813:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622773760 00000100:00100000:2.0:1746143787.635821:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622773760 00000100:00100000:2.0:1746143787.635887:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12509 00000100:00100000:2.0:1746143787.635894:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:32485:x1830963622773760:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143787.635931:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143787.635953:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73aa84b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bcd4 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143787.635975:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x394:0x0] initial LVB size: 2084864, mtime: 0x681409f7, atime: 0x681409ec, ctime: 0x681409f7, blocks: 0xb10 00010000:00010000:2.0:1746143787.635998:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.636000:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.636009:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73aa84b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcd4 expref: 25 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.636023:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73aa84b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcd4 expref: 25 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.636033:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4abc00, rc 0) 00000100:00100000:2.0:1746143787.636070:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+25:32485:x1830963622773760:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 177us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143787.636077:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12509 00000100:00100000:0.0:1746143787.638137:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.638262:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622773888 00000100:00100000:1.0:1746143787.638270:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622773888 00000100:00100000:1.0:1746143787.638318:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12510 00000100:00100000:1.0:1746143787.638325:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622773888:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:1.0:1746143787.638499:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:1.0:1746143787.638502:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143787.638504:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:1.0:1746143787.638506:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:1.0:1746143787.638508:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:1.0:1746143787.638550:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622773888:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 226us (421us total) trans 17179873136 rc 0/0 00000100:00100000:1.0:1746143787.638555:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12510 00000100:00100000:0.0:1746143787.640463:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.640616:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622774016 00000100:00100000:2.0:1746143787.640624:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622774016 00000100:00100000:2.0:1746143787.640663:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12511 00000100:00100000:2.0:1746143787.640669:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:32485:x1830963622774016:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143787.640685:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143787.640707:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e505c00/0x87925e4cb73aa852 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bcdb expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143787.640726:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3b4:0x0] initial LVB size: 2084864, mtime: 0x681409f7, atime: 0x0, ctime: 0x681409f7, blocks: 0xb10 00010000:00010000:2.0:1746143787.640747:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.640749:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.640756:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e505c00/0x87925e4cb73aa852 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcdb expref: 24 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.640774:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e505c00/0x87925e4cb73aa852 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcdb expref: 24 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.640785:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e505c00, rc 0) 00000100:00100000:2.0:1746143787.640818:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:32485:x1830963622774016:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143787.640824:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12511 00000100:00100000:0.0:1746143787.642664:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.642769:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622774144 00000100:00100000:2.0:1746143787.642777:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622774144 00000100:00100000:2.0:1746143787.642819:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12512 00000100:00100000:2.0:1746143787.642838:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963622774144:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:2.0:1746143787.643167:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:2.0:1746143787.643170:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143787.643173:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143787.643174:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:2.0:1746143787.643176:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:2.0:1746143787.643447:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622774144:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 618us (790us total) trans 21474840468 rc 0/0 00000100:00100000:2.0:1746143787.643453:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12512 00000100:00100000:0.0:1746143787.651892:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.653604:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622774656 00000100:00100000:1.0:1746143787.653618:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622774656 00000100:00100000:1.0:1746143787.653706:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3687 00000100:00100000:1.0:1746143787.653716:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622774656:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143787.653758:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73aa859 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.653773:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143787.653775:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143787.653780:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73aa859 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.653794:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73aa859 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143787.654711:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.654736:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.654762:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.654776:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143787.654804:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.654943:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622774528 00000100:00100000:3.0:1746143787.654948:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622774528 00000100:00100000:3.0:1746143787.654980:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622774784 00000100:00100000:3.0:1746143787.654982:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622774784 00000100:00100000:3.0:1746143787.654997:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622775168 00000100:00100000:3.0:1746143787.654998:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622775168 00000100:00100000:3.0:1746143787.655010:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622775040 00000100:00100000:3.0:1746143787.655012:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622775040 00000100:00100000:3.0:1746143787.655025:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622775296 00000100:00100000:3.0:1746143787.655027:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622775296 00000100:00100000:3.0:1746143787.655041:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3688 00000100:00100000:3.0:1746143787.655048:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622774528:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143787.655071:0:29555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa860 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.655081:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.655083:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.655085:0:29555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa860 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.655095:0:29555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa860 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143787.655664:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3689 00000100:00100000:2.0:1746143787.655674:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622774784:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143787.655692:0:20386:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa867 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.655704:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.655705:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.655708:0:20386:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa867 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.655716:0:20386:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa867 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143787.657035:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3690 00000100:00100000:2.0:1746143787.657045:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622775168:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143787.657071:0:29558:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73aa86e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.657080:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.657081:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.657084:0:29558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73aa86e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.657095:0:29558:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73aa86e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143787.657747:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3691 00000100:00100000:2.0:1746143787.657754:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622775040:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143787.657770:0:20387:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73aa875 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.657778:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.657780:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.657782:0:20387:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73aa875 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.657790:0:20387:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73aa875 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143787.657819:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3692 00000100:00100000:3.0:1746143787.657838:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622775296:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143787.657857:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092d0a400/0x87925e4cb73aa87c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.657865:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.657867:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.657870:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a400/0x87925e4cb73aa87c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.657879:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0a400/0x87925e4cb73aa87c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.672472:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73aa859 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.672490:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73aa859 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.672498:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73aa859 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.672504:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082048600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143787.672508:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73aa859 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.672515:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73aa859 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.672533:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73aa859 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.672538:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082048600/0x87925e4cb73aa859 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143787.672618:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963622774656:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 18898us (20731us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143787.672628:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3687 00010000:00010000:3.0:1746143787.682691:0:20386:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa867 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.682709:0:20386:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa867 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.682718:0:20386:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa867 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.682726:0:20386:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5ace00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143787.682730:0:20386:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa867 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.682738:0:20386:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa867 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.682756:0:20386:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa867 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.682762:0:20386:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73aa867 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143787.685549:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622774784:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 29862us (30797us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143787.685566:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3689 00010000:00010000:2.0:1746143787.696314:0:29558:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73aa86e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.696333:0:29558:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73aa86e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.696341:0:29558:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73aa86e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.696348:0:29558:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5acc00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143787.696352:0:29558:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73aa86e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.696360:0:29558:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73aa86e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.696378:0:29558:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73aa86e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.696384:0:29558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5acc00/0x87925e4cb73aa86e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143787.696588:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622775168:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 39539us (41818us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143787.696600:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3690 00010000:00010000:3.0:1746143787.711282:0:29555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa860 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.711300:0:29555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa860 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.711307:0:29555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.711313:0:29555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189dc00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143787.711318:0:29555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.711325:0:29555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa860 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.711343:0:29555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa860 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.711348:0:29555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa860 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143787.711445:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622774528:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 56391us (56731us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143787.711456:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3688 00010000:00010000:2.0:1746143787.719285:0:20387:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73aa875 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.719305:0:20387:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73aa875 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.719315:0:20387:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73aa875 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.719321:0:20387:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5ad800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143787.719325:0:20387:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73aa875 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.719334:0:20387:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73aa875 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.719353:0:20387:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73aa875 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.719359:0:20387:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73aa875 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [24576->1048575] (req 24576->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143787.721080:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622775040:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 63314us (66289us total) trans 0 rc 1024000/1024000 00000100:00100000:2.0:1746143787.721093:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3691 00010000:00010000:3.0:1746143787.725426:0:13453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092d0a400/0x87925e4cb73aa87c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.725445:0:13453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a400/0x87925e4cb73aa87c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.725453:0:13453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092d0a400/0x87925e4cb73aa87c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.725460:0:13453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0a400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143787.725464:0:13453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d0a400/0x87925e4cb73aa87c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.725471:0:13453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d0a400/0x87925e4cb73aa87c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.725491:0:13453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092d0a400/0x87925e4cb73aa87c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.725496:0:13453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a400/0x87925e4cb73aa87c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143787.726822:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963622775296:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 68984us (72004us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143787.726842:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3692 00000100:00100000:0.0:1746143787.735379:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.737391:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622775680 00000100:00100000:1.0:1746143787.737408:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622775680 00000100:00100000:1.0:1746143787.737484:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13015 00000100:00100000:1.0:1746143787.737493:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:32485:x1830963622775680:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:1.0:1746143787.737555:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143787.737586:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6bb200/0x87925e4cb73aa81a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bca3 expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.738311:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.738318:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143787.738370:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.738383:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.738392:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00010000:1.0:1746143787.738507:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880092147480 reply state ffff8800924cf000 transno 8589943787 ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.738515:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143787.738520:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.738522:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746143787.738525:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746143787.740342:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:32485:x1830963622775680:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 2837us (4961us total) trans 8589943787 rc 0/0 00000100:00100000:1.0:1746143787.740352:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13015 00000100:00100000:0.0:1746143787.742592:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.742659:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622775808 00000100:00100000:2.0:1746143787.742670:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622775808 00000100:00100000:2.0:1746143787.742730:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12513 00000100:00100000:2.0:1746143787.742739:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:32485:x1830963622775808:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143787.742759:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143787.742778:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73aa88a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bce2 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.742809:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa821 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcaa expref: 26 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143787.742817:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.742819:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.742822:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73aa88a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bce2 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.742861:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcaa expref: 26 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143787.742873:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa821 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcaa expref: 26 pid: 12327 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143787.742885:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626846208:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143787.743000:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143787.748519:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626846208:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143787.748551:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73aa88a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bce2 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.748577:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550800, rc 0) 00000100:00100000:2.0:1746143787.748627:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:32485:x1830963622775808:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5888us (6044us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143787.748635:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12513 00000100:00100000:0.0:1746143787.748747:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.748874:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622775936 00000100:00100000:2.0:1746143787.748880:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622775936 00010000:00010000:2.0:1746143787.748907:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa821 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcaa expref: 26 pid: 12327 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143787.749081:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5913 00000100:00100000:2.0:1746143787.749091:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622775936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143787.749107:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143787.749129:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa821 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcaa expref: 26 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143787.749140:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcaa expref: 26 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143787.749162:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1a00/0x87925e4cb73aa821 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcaa expref: 26 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143787.749178:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.749180:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.749186:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73aa88a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bce2 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.749199:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73aa88a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bce2 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.749226:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73aa88a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bce2 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143787.749238:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626846336:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143787.749283:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143787.751018:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626846336:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143787.751036:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143787.751080:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622775936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1989us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143787.751088:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5913 00000100:00100000:0.0:1746143787.751323:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.751417:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622776064 00000100:00100000:2.0:1746143787.751422:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622776064 00000100:00100000:2.0:1746143787.751449:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12514 00000100:00100000:2.0:1746143787.751455:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:32485:x1830963622776064:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143787.751472:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143787.751488:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73aa891 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bce9 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.751513:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1400/0x87925e4cb73aa828 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb1 expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143787.751519:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.751522:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.751525:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73aa891 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bce9 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.751548:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c1400/0x87925e4cb73aa828 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb1 expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143787.751559:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1400/0x87925e4cb73aa828 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb1 expref: 27 pid: 12327 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143787.751570:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626846464:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143787.751623:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143787.753369:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626846464:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143787.753478:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73aa891 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bce9 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.753494:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551600, rc 0) 00000100:00100000:2.0:1746143787.753531:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:32485:x1830963622776064:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2075us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143787.753538:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12514 00000100:00100000:0.0:1746143787.753820:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.754010:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622776192 00000100:00100000:2.0:1746143787.754016:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622776192 00010000:00010000:2.0:1746143787.754039:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1400/0x87925e4cb73aa828 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb1 expref: 27 pid: 12327 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143787.754072:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5914 00000100:00100000:2.0:1746143787.754078:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622776192:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143787.754092:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143787.754111:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1400/0x87925e4cb73aa828 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb1 expref: 27 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143787.754121:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c1400/0x87925e4cb73aa828 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb1 expref: 27 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143787.754141:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1400/0x87925e4cb73aa828 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x395:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb1 expref: 27 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143787.754165:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.754167:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.754173:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73aa891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bce9 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.754180:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73aa891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bce9 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.754205:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73aa891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bce9 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143787.754216:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626846592:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143787.754279:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143787.756708:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.756771:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622776320 00000100:00100000:2.0:1746143787.756784:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622776320 00000100:00100000:2.0:1746143787.756845:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12515 00000100:00100000:2.0:1746143787.756852:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:32485:x1830963622776320:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143787.756870:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143787.756887:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73aa898 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bcf0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.756936:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73aa82f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb8 expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143787.756943:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.756945:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.756948:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73aa898 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcf0 expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143787.757022:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626846592:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143787.757040:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143787.757084:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622776192:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3005us (3264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.757092:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5914 00010000:00010000:2.0:1746143787.757193:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73aa82f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb8 expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143787.757205:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73aa82f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb8 expref: 27 pid: 12327 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143787.757216:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626846720:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143787.757275:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143787.761775:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094194700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626846720:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143787.761811:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73aa898 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcf0 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.761842:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551e00, rc 0) 00000100:00100000:2.0:1746143787.761900:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:32485:x1830963622776320:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5047us (5200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143787.761933:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12515 00000100:00100000:0.0:1746143787.763868:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.764460:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622776448 00000100:00100000:3.0:1746143787.764469:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622776448 00010000:00010000:3.0:1746143787.764507:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73aa82f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb8 expref: 27 pid: 12327 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143787.764537:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5915 00000100:00100000:3.0:1746143787.764545:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963622776448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143787.764561:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143787.764584:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73aa82f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb8 expref: 27 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143787.764601:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73aa82f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb8 expref: 27 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143787.764626:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73aa82f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcb8 expref: 27 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143787.764656:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.764658:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.764665:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73aa898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcf0 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.764672:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73aa898 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcf0 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.764709:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551e00/0x87925e4cb73aa898 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcf0 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143787.764721:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626846848:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143787.766338:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143787.768775:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.768958:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626846848:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143787.768980:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143787.769035:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622776448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4490us (5173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.769046:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5915 00000100:00100000:0.0:1746143787.769973:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622776576 00000100:00100000:0.0:1746143787.769980:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622776576 00000100:00100000:0.0:1746143787.770025:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12516 00000100:00100000:0.0:1746143787.770032:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:32485:x1830963622776576:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143787.770051:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143787.770069:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa89f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bcf7 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.770095:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa836 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcbf expref: 26 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.770102:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.770104:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143787.770107:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa89f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcf7 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143787.770134:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa836 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcbf expref: 26 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143787.770144:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa836 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcbf expref: 26 pid: 12327 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746143787.770155:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626846976:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143787.770231:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143787.773345:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626846976:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143787.773383:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa89f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcf7 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.773407:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4a00, rc 0) 00000100:00100000:2.0:1746143787.773469:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:32485:x1830963622776576:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3435us (4703us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143787.773479:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12516 00000100:00100000:0.0:1746143787.773744:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.773872:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622776704 00000100:00100000:3.0:1746143787.773881:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622776704 00010000:00010000:3.0:1746143787.773937:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa836 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcbf expref: 26 pid: 12327 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143787.773971:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5916 00000100:00100000:3.0:1746143787.773978:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622776704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143787.773991:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143787.774012:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa836 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcbf expref: 26 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143787.774025:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa836 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcbf expref: 26 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143787.774048:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73aa836 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcbf expref: 26 pid: 12327 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143787.774075:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.774077:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.774084:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa89f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcf7 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.774092:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa89f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcf7 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.774123:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73aa89f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcf7 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143787.774134:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626847104:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143787.774198:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143787.777037:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626847104:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143787.777055:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143787.777094:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622776704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3116us (3350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.777103:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5916 00000100:00100000:0.0:1746143787.777651:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.777785:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622776832 00000100:00100000:3.0:1746143787.777791:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622776832 00000100:00100000:3.0:1746143787.779050:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12517 00000100:00100000:3.0:1746143787.779060:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:32485:x1830963622776832:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143787.779075:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143787.779091:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73aa8a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bcfe expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.779116:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73aa83d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcc6 expref: 26 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143787.779123:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.779125:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.779128:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73aa8a6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcfe expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.779152:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73aa83d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcc6 expref: 26 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143787.779163:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73aa83d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcc6 expref: 26 pid: 12327 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143787.779178:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626847232:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143787.779250:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143787.782640:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963626847232:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143787.782667:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73aa8a6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcfe expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.782683:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189c200, rc 0) 00000100:00100000:3.0:1746143787.783711:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:32485:x1830963622776832:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4649us (6056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.783721:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12517 00000100:00100000:0.0:1746143787.784320:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.784692:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622776960 00000100:00100000:3.0:1746143787.784701:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622776960 00010000:00010000:3.0:1746143787.784727:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73aa83d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcc6 expref: 26 pid: 12327 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143787.784988:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5917 00000100:00100000:3.0:1746143787.784995:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622776960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143787.785007:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143787.785023:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73aa83d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcc6 expref: 26 pid: 12327 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143787.785033:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73aa83d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcc6 expref: 26 pid: 12327 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143787.785060:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b47a200/0x87925e4cb73aa83d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcc6 expref: 26 pid: 12327 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143787.786851:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.786856:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.786868:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73aa8a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcfe expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.786878:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73aa8a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcfe expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.786935:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73aa8a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bcfe expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143787.786948:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626847360:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143787.787031:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143787.790071:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963626847360:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143787.790094:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143787.790146:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963622776960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5149us (5824us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.790158:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5917 00000100:00100000:0.0:1746143787.790293:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.790389:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622777088 00000100:00100000:3.0:1746143787.790396:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622777088 00000100:00100000:3.0:1746143787.790434:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12518 00000100:00100000:3.0:1746143787.790442:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:32485:x1830963622777088:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143787.790464:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143787.790482:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa8ad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bd05 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.790512:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73aa844 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bccd expref: 27 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143787.790520:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.790522:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143787.790525:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa8ad lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bd05 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.790554:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73aa844 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bccd expref: 27 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143787.790566:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73aa844 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bccd expref: 27 pid: 12328 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143787.790579:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626847488:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143787.790653:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143787.792130:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143787.792220:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963626847488:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143787.792240:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa8ad lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bd05 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143787.792255:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189dc00, rc 0) 00000100:00100000:3.0:1746143787.792294:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:32485:x1830963622777088:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1852us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143787.792301:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12518 00000100:00100000:2.0:1746143787.792590:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622777216 00000100:00100000:2.0:1746143787.792605:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622777216 00010000:00010000:2.0:1746143787.792637:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73aa844 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bccd expref: 27 pid: 12328 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143787.792670:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5918 00000100:00100000:2.0:1746143787.792808:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963622777216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143787.792822:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143787.792848:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73aa844 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bccd expref: 27 pid: 12328 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143787.792859:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73aa844 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bccd expref: 27 pid: 12328 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143787.792878:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73aa844 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x397:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bccd expref: 27 pid: 12328 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143787.793265:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.793267:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143787.793274:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa8ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bd05 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.793281:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa8ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bd05 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.793310:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73aa8ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bd05 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143787.793320:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626847616:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143787.794651:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143787.796687:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963626847616:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143787.796705:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143787.797295:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622777216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4491us (5168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143787.797305:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5918 00000100:00100000:1.0:1746143787.797470:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.797531:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.797547:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.797561:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622777344 00000100:00100000:1.0:1746143787.797567:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622777344 00000100:00100000:1.0:1746143787.797590:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622777472 00000100:00100000:1.0:1746143787.797592:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622777472 00000100:00100000:1.0:1746143787.797608:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622777728 00000100:00100000:1.0:1746143787.797610:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622777728 00000100:00100000:1.0:1746143787.797622:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12519 00000100:00100000:1.0:1746143787.797632:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963622777344:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:1.0:1746143787.797744:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143787.797747:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.797749:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.797751:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143786 -> 1746143788 00002000:00010000:1.0:1746143787.797753:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:1.0:1746143787.797776:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963622777344:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 148us (306us total) trans 21474840469 rc 0/0 00000100:00100000:1.0:1746143787.797782:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12519 00000100:00100000:1.0:1746143787.797792:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12520 00000100:00100000:1.0:1746143787.797797:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622777472:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:1.0:1746143787.797865:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143787.797867:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.797869:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.797870:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143786 -> 1746143788 00002000:00010000:1.0:1746143787.797872:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143787.797888:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622777472:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 91us (357us total) trans 17179873137 rc 0/0 00000100:00100000:1.0:1746143787.797894:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12520 00000100:00100000:1.0:1746143787.797903:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12521 00000100:00100000:1.0:1746143787.797908:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963622777728:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:1.0:1746143787.797965:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143787.797968:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.797969:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.797971:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143786 -> 1746143788 00002000:00010000:1.0:1746143787.797973:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143787.797989:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622777728:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 80us (441us total) trans 21474840470 rc 0/0 00000100:00100000:1.0:1746143787.797995:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12521 00000100:00100000:1.0:1746143787.798023:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.798034:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622777984 00000100:00100000:1.0:1746143787.798037:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622777984 00000100:00100000:1.0:1746143787.798051:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12522 00000100:00100000:1.0:1746143787.798056:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622777984:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:1.0:1746143787.798096:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143787.798098:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.798100:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.798102:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143786 -> 1746143788 00002000:00010000:1.0:1746143787.798103:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143787.798119:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622777984:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 62us (95us total) trans 17179873138 rc 0/0 00000100:00100000:1.0:1746143787.798124:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12522 00000100:00100000:1.0:1746143787.798158:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.798168:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622777600 00000100:00100000:1.0:1746143787.798171:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622777600 00000100:00100000:1.0:1746143787.798183:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12523 00000100:00100000:1.0:1746143787.798188:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622777600:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:1.0:1746143787.798222:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143787.798224:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.798226:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.798227:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143786 -> 1746143788 00002000:00010000:1.0:1746143787.798229:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746143787.798243:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963622777600:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 54us (84us total) trans 17179873139 rc 0/0 00000100:00100000:1.0:1746143787.798248:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12523 00000100:00100000:1.0:1746143787.798289:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.798299:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622777856 00000100:00100000:1.0:1746143787.798301:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622777856 00000100:00100000:1.0:1746143787.798315:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12524 00000100:00100000:1.0:1746143787.798318:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963622777856:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:1.0:1746143787.798357:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:1.0:1746143787.798359:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.798360:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.798362:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143786 -> 1746143788 00002000:00010000:1.0:1746143787.798364:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00000100:00100000:1.0:1746143787.798379:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963622777856:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 60us (89us total) trans 21474840471 rc 0/0 00000100:00100000:1.0:1746143787.798383:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12524 00000100:00100000:0.0:1746143787.801289:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.801712:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622778240 00000100:00100000:2.0:1746143787.801720:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622778240 00000100:00100000:2.0:1746143787.801775:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4797 00000100:00100000:2.0:1746143787.801782:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:32485:x1830963622778240:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:2.0:1746143787.801842:0:7247:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x34a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73aa7cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc95 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.801880:0:7247:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143787.801890:0:7247:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73aa80c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc9c expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.801896:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143787.801940:0:7247:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73aa80c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc9c expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143787.801949:0:7247:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73aa80c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc9c expref: 264 pid: 6587 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143787.801960:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830963626847744:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143787.802156:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143787.803876:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.804041:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622778368 00000100:00100000:1.0:1746143787.804047:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622778368 00010000:00010000:1.0:1746143787.804069:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73aa80c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc9c expref: 265 pid: 6587 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143787.804096:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5919 00000100:00100000:1.0:1746143787.804102:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:2008:x1830963622778368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143787.804111:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143787.804116:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73aa80c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc9c expref: 265 pid: 6587 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143787.804125:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73aa80c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc9c expref: 265 pid: 6587 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143787.804139:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.804143:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143787.804150:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143787.804155:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143787.804169:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143787.804197:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:2008:x1830963622778368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 94us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.804202:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5919 00010000:00010000:2.0:1746143787.804292:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73aa80c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc9c expref: 264 pid: 6587 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143787.804320:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830963626847744:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143787.804334:0:7247:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143787.804341:0:7247:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143787.804346:0:7247:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000040:00080000:2.0:1746143787.804736:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2763, 88 off230872 00000004:00080000:2.0:1746143787.804741:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847028828910ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143787.804772:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2714, 88 off226904 00000004:00080000:2.0:1746143787.804775:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847028863005ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143787.804797:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2715, 88 off226992 00000004:00080000:2.0:1746143787.804800:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847028887430ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143787.804807:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2764, 88 off230960 00000004:00080000:2.0:1746143787.804810:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847028897863ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143787.804817:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2765, 88 off231048 00000004:00080000:2.0:1746143787.804819:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847028907030ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143787.805020:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2716, 88 off227080 00000004:00080000:2.0:1746143787.805025:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847029113235ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143787.805050:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2717, 88 off227168 00000004:00080000:2.0:1746143787.805053:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847029140783ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143787.805060:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2718, 88 off227256 00000004:00080000:2.0:1746143787.805062:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847029150437ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143787.805070:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2766, 88 off231136 00000004:00080000:2.0:1746143787.805072:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847029159673ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143787.805078:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2719, 88 off227344 00000004:00080000:2.0:1746143787.805081:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847029168476ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143787.805087:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2767, 88 off231224 00000004:00080000:2.0:1746143787.805089:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847029177130ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143787.805096:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2720, 88 off227432 00000004:00080000:2.0:1746143787.805098:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847029185793ns, next at 770855090093ns, rc = 0 00000040:00080000:2.0:1746143787.805104:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2768, 88 off231312 00000004:00080000:2.0:1746143787.805106:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847029193895ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143787.805113:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2769, 88 off231400 00000004:00080000:2.0:1746143787.805115:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847029202875ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143787.805121:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2770, 88 off231488 00000004:00080000:2.0:1746143787.805123:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847029211445ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143787.805130:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2771, 88 off231576 00000004:00080000:2.0:1746143787.805132:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847029219861ns, next at 775898816462ns, rc = 0 00000040:00080000:2.0:1746143787.805138:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2721, 88 off227520 00000004:00080000:2.0:1746143787.805140:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847029228260ns, next at 770855090093ns, rc = 0 00000001:00080000:3.0:1746143787.806741:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943788 is committed 00000004:00080000:3.0:1746143787.806757:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1950 committed 00000004:00080000:3.0:1746143787.806772:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1997 committed 00000004:00080000:3.0:1746143787.806784:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1996 committed 00000004:00080000:3.0:1746143787.806786:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1995 committed 00000004:00080000:3.0:1746143787.806787:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1994 committed 00000004:00080000:3.0:1746143787.806789:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1949 committed 00000004:00080000:3.0:1746143787.806790:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1993 committed 00000004:00080000:3.0:1746143787.806791:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1948 committed 00000004:00080000:3.0:1746143787.806792:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1992 committed 00000004:00080000:3.0:1746143787.806794:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1947 committed 00000004:00080000:3.0:1746143787.806795:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1946 committed 00000004:00080000:3.0:1746143787.806796:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1945 committed 00000004:00080000:3.0:1746143787.806797:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1991 committed 00000004:00080000:3.0:1746143787.806798:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1990 committed 00000004:00080000:3.0:1746143787.806800:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1944 committed 00000004:00080000:3.0:1746143787.806801:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1943 committed 00000004:00080000:3.0:1746143787.806802:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1989 committed 00010000:00010000:0.0:1746143787.806855:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.806863:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.806870:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.806874:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082049600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143787.806878:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.806883:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.806894:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:0.0:1746143787.806897:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143787.806900:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143787.806904:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73aa883 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143787.806907:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626848000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.806943:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626847872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.806966:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143787.806983:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.806987:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626848512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.807000:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626848384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.807002:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.807019:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143787.807020:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.807024:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626848128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.807033:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143787.807038:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143787.807038:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626848256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.807050:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626848640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.807053:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.807064:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143787.807065:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626848768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.807077:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.807091:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626848000 00000100:00100000:0.0:1746143787.807093:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626847872 00000100:00100000:1.0:1746143787.807097:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626848000 00000100:00100000:0.0:1746143787.807097:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626847872 00000100:00100000:0.0:1746143787.807119:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626848512 00000100:00100000:0.0:1746143787.807120:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626848512 00000100:00100000:3.0:1746143787.807281:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626848384 00000100:00100000:3.0:1746143787.807285:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626848384 00000100:00100000:2.0:1746143787.807396:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626849280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143787.807417:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143787.807431:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626849792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143787.807443:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143787.807453:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143787.807457:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626848896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143787.807468:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143787.807476:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626849408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143787.807490:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143787.807505:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626848128 00000100:00100000:2.0:1746143787.807508:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626848128 00000100:00100000:1.0:1746143787.808283:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626848256 00000100:00100000:1.0:1746143787.808287:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626848256 00000100:00100000:1.0:1746143787.808298:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626848640 00000100:00100000:1.0:1746143787.808299:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626848640 00000100:00100000:1.0:1746143787.808306:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626848768 00000100:00100000:1.0:1746143787.808308:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626848768 00000100:00100000:1.0:1746143787.808314:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626849280 00000100:00100000:1.0:1746143787.808315:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626849280 00000100:00100000:1.0:1746143787.808322:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626849792 00000100:00100000:1.0:1746143787.808324:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626849792 00000100:00100000:1.0:1746143787.808329:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626848896 00000100:00100000:1.0:1746143787.808331:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626848896 00000100:00100000:1.0:1746143787.808337:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626849408 00000100:00100000:1.0:1746143787.808338:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626849408 00000100:00100000:0.0:1746143787.808352:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12525 00000100:00100000:1.0:1746143787.808361:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12526 00000100:00100000:0.0:1746143787.808365:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963626847872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.808368:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963626848000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143787.808374:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12527 00000100:00100000:3.0:1746143787.808382:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963626848256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.808454:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626849152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143787.808458:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12528 00000100:00100000:3.0:1746143787.808463:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3773:x1830963626848640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.808477:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746143787.808480:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143787.808483:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:0.0:1746143787.808485:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:0.0:1746143787.808486:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb ctime from disk: 1746143788 -> 1746143788 00002000:00010000:0.0:1746143787.808487:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b3:0x0] updating lvb blocks from disk: 2008 -> 2008 00000100:00100000:1.0:1746143787.808488:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626849664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.808500:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143787.808512:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143787.808516:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626849024:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143787.808517:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:3.0:1746143787.808520:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143787.808522:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143787.808524:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:3.0:1746143787.808526:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b4:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143787.808529:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3772:x1830963626847872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (1545us total) trans 21474840472 rc 0/0 00000100:00100000:1.0:1746143787.808532:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143787.808533:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12525 00000100:00100000:1.0:1746143787.808539:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626849536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143787.808545:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626849152 00000100:00100000:0.0:1746143787.808550:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626849152 00000100:00100000:3.0:1746143787.808553:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3773:x1830963626848640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1487us total) trans 21474840475 rc 0/0 00000100:00100000:1.0:1746143787.808553:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143787.808558:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626849664 00000100:00100000:3.0:1746143787.808559:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12528 00000100:00100000:0.0:1746143787.808560:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626849664 00000100:00100000:0.0:1746143787.808565:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626849024 00000100:00100000:0.0:1746143787.808566:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626849024 00000100:00100000:0.0:1746143787.808571:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626849536 00000100:00100000:0.0:1746143787.808572:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626849536 00000100:00100000:3.0:1746143787.808573:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12529 00000100:00100000:3.0:1746143787.808577:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626848768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.808578:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12530 00000004:00080000:1.0:1746143787.808580:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e32300/2, rc 0, transno 21474840475 00000100:00100000:0.0:1746143787.808581:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626849280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.808588:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626848640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.808601:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12531 00000100:00100000:1.0:1746143787.808606:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626849792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143787.808628:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb size from disk: 2084864 -> 2084864 00002000:00010000:0.0:1746143787.808629:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb mtime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143787.808631:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb atime from disk: 1746143724 -> 1746143724 00002000:00010000:0.0:1746143787.808632:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb ctime from disk: 1746143735 -> 1746143735 00002000:00010000:0.0:1746143787.808633:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x394:0x0] updating lvb blocks from disk: 2832 -> 2832 00000100:00100000:0.0:1746143787.808652:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3771:x1830963626849280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1234us total) trans 17179873140 rc 0/0 00000100:00100000:0.0:1746143787.808656:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12530 00000100:00100000:0.0:1746143787.808664:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12532 00000100:00100000:0.0:1746143787.808667:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963626848512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.808678:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626849792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1232us total) trans 17179873141 rc 0/0 00000100:00100000:1.0:1746143787.808683:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12531 00000100:00100000:1.0:1746143787.808694:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12533 00000100:00100000:1.0:1746143787.808698:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626848896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143787.808708:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3773:x1830963626848512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (1705us total) trans 21474840476 rc 0/0 00000100:00100000:0.0:1746143787.808712:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12532 00000100:00100000:0.0:1746143787.808718:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12534 00000100:00100000:0.0:1746143787.808721:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963626849408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143787.808735:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12535 00000100:00100000:0.0:1746143787.808738:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626848384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143787.808742:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143787.808745:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.808747:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.808749:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb ctime from disk: 1746143788 -> 1746143788 00002000:00010000:1.0:1746143787.808750:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x395:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143787.808767:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626848896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1297us total) trans 17179873142 rc 0/0 00000100:00100000:1.0:1746143787.808773:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12533 00000100:00100000:0.0:1746143787.808777:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3772:x1830963626848384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (1756us total) trans 21474840477 rc 0/0 00000100:00100000:0.0:1746143787.808780:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12535 00000100:00100000:1.0:1746143787.808784:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12536 00000100:00100000:1.0:1746143787.808789:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963626849152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143787.808789:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12537 00000100:00100000:0.0:1746143787.808792:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963626849664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143787.808840:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143787.808843:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.808845:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.808847:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb ctime from disk: 1746143788 -> 1746143788 00002000:00010000:1.0:1746143787.808848:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x397:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143787.808849:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963626849664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (347us total) trans 17179873143 rc 0/0 00000100:00100000:2.0:1746143787.808858:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12538 00000100:00100000:2.0:1746143787.808866:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963626849024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.808867:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963626849152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (389us total) trans 17179873144 rc 0/0 00000100:00100000:0.0:1746143787.808867:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12537 00000100:00100000:1.0:1746143787.808873:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12536 00000100:00100000:0.0:1746143787.808880:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12539 00000100:00100000:0.0:1746143787.808884:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963626849536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.808885:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12540 00000100:00100000:1.0:1746143787.808890:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963626848128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143787.808927:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143787.808930:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:2.0:1746143787.808932:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:2.0:1746143787.808934:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb ctime from disk: 1746143788 -> 1746143788 00002000:00010000:2.0:1746143787.808935:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x396:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:1.0:1746143787.808945:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb size from disk: 4964768 -> 4964768 00002000:00010000:1.0:1746143787.808947:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.808949:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.808950:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb ctime from disk: 1746143788 -> 1746143788 00002000:00010000:1.0:1746143787.808952:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b6:0x0] updating lvb blocks from disk: 5616 -> 5616 00000100:00100000:2.0:1746143787.808957:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963626849024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (424us total) trans 17179873145 rc 0/0 00000100:00100000:2.0:1746143787.808962:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12538 00000100:00100000:0.0:1746143787.808971:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963626849536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (416us total) trans 17179873146 rc 0/0 00000100:00100000:1.0:1746143787.808973:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3773:x1830963626848128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1934us total) trans 21474840478 rc 0/0 00000100:00100000:0.0:1746143787.808976:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12539 00000100:00100000:1.0:1746143787.808980:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12540 00000004:00010000:2.0:1746143787.809002:0:7247:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009391fb80 reply state ffff88007f618800 transno 8589943788 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000004:00080000:1.0:1746143787.809007:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094197800/2, rc 0, transno 17179873145 00000100:00100000:1.0:1746143787.809010:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626849024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143787.809011:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093414a80/2, rc 0, transno 21474840472 00010000:00010000:2.0:1746143787.809014:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00000100:00100000:0.0:1746143787.809016:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626847872:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143787.809019:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cd880/2, rc 0, transno 17179873146 00000100:00100000:1.0:1746143787.809022:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626849536:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143787.809024:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00000004:00080000:0.0:1746143787.809024:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33800/2, rc 0, transno 21474840477 00010000:00010000:2.0:1746143787.809026:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746143787.809027:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3772:x1830963626848768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 449us (1948us total) trans 21474840479 rc 0/0 00000100:00100000:0.0:1746143787.809027:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626848384:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143787.809028:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094197100/2, rc 0, transno 17179873144 00000100:00100000:2.0:1746143787.809029:0:7247:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746143787.809031:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626849152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143787.809033:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12529 00010000:00010000:2.0:1746143787.809034:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:2.0:1746143787.809035:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:0.0:1746143787.809037:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30e00/2, rc 0, transno 21474840479 00000004:00080000:1.0:1746143787.809038:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cdf80/2, rc 0, transno 17179873143 00010000:00010000:2.0:1746143787.809040:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73aa7cd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bc95 expref: 261 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143787.809041:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963626849664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143787.809045:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626848768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143787.809057:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093414380/2, rc 0, transno 21474840478 00000100:00100000:1.0:1746143787.809061:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626848128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143787.809067:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094194a80/2, rc 0, transno 17179873142 00000004:00080000:1.0:1746143787.809068:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30a80/2, rc 0, transno 21474840476 00000100:00100000:1.0:1746143787.809071:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626848512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143787.809071:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626848896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143787.809077:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963626848256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 697us (2022us total) trans 21474840474 rc 0/0 00000004:00080000:0.0:1746143787.809079:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f9180/2, rc 0, transno 17179873140 00000100:00100000:3.0:1746143787.809081:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12527 00000100:00100000:0.0:1746143787.809082:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626849280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143787.809089:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cc000/2, rc 0, transno 17179873141 00000100:00100000:0.0:1746143787.809092:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626849792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143787.809097:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00080000:2.0:1746143787.809098:0:7247:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746143787.809106:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626849920:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143787.809107:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746143787.809108:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+261:32485:x1830963622778240:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 7327us (7827us total) trans 8589943788 rc 0/0 00002000:00010000:1.0:1746143787.809109:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb mtime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.809111:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb atime from disk: 1746143786 -> 1746143786 00002000:00010000:1.0:1746143787.809112:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb ctime from disk: 1746143788 -> 1746143788 00002000:00010000:1.0:1746143787.809114:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3b5:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143787.809115:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4797 00010000:00010000:3.0:1746143787.809116:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143787.809122:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143787.809128:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143787.809132:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551a00 already unused, calling callback (ffffffffa0f2a690) 00000100:00100000:0.0:1746143787.809133:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143787.809134:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746143787.809135:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963626848000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 768us (2168us total) trans 21474840473 rc 0/0 00000100:00100000:1.0:1746143787.809139:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12526 00010000:00010000:3.0:1746143787.809143:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746143787.809147:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626849920 00000100:00100000:1.0:1746143787.809149:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626849920 00010000:00010000:3.0:1746143787.809151:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:3.0:1746143787.809154:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143787.809156:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143787.809160:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73aa8b4 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746143787.809160:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12541 00000100:00100000:1.0:1746143787.809163:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3771:x1830963626849920:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143787.809165:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e31c00/2, rc 0, transno 21474840474 00000100:00100000:0.0:1746143787.809168:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963626848256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.809207:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963626849920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (73us total) trans 21474840480 rc 0/0 00000100:00100000:1.0:1746143787.809211:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12541 00000004:00080000:0.0:1746143787.809220:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972e8e00/2, rc 0, transno 21474840480 00000100:00100000:0.0:1746143787.809224:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626849920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143787.809231:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093415500/2, rc 0, transno 21474840473 00000100:00100000:1.0:1746143787.809235:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963626848000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143787.809293:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963626849408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 571us (1802us total) trans 17179873147 rc 0/0 00000004:00080000:0.0:1746143787.809307:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e359500/2, rc 0, transno 17179873147 00000100:00100000:0.0:1746143787.809311:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963626849408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143787.810664:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12534 00000100:00100000:0.0:1746143787.812813:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143787.812877:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622778496 00000100:00100000:1.0:1746143787.812888:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622778496 00000100:00100000:1.0:1746143787.812959:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13016 00000100:00100000:1.0:1746143787.812966:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+260:32485:x1830963622778496:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143787.812985:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143787.813002:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73aa8bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840bd0c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.813056:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73aa8bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bd0c expref: 261 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.813073:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73aa8bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bd0c expref: 261 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143787.813090:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34a:0x0].0x0 (ffff8800a8134300) 00010000:00010000:1.0:1746143787.813093:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143787.813096:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c000, rc 0) 00000100:00100000:1.0:1746143787.813154:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+261:32485:x1830963622778496:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 188us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143787.813159:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13016 00000100:00100000:0.0:1746143787.816567:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143787.816687:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963622778752 00000100:00100000:2.0:1746143787.816699:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963622778752 00000100:00100000:2.0:1746143787.816748:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4798 00000100:00100000:2.0:1746143787.816755:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+261:32485:x1830963622778752:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1746143787.816962:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:32485:x1830963622778752:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 207us (402us total) trans 8589943789 rc 0/0 00000100:00100000:2.0:1746143787.816968:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4798 00010000:00010000:3.0:1746143787.850105:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143788.439768:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626850048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746143788.439827:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143788.439846:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963626850048 00000100:00100000:0.0:1746143788.439853:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963626850048 00000100:00100000:0.0:1746143788.439891:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1746143788.439899:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963626850048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746143788.439937:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490134720 pending 0 free 3912818688 avail 3681296384 00000100:00100000:0.0:1746143788.439981:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963626850048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143788.439987:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00080000:3.0:1746143788.440035:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143788.440296:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963626850048:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1746143788.482408:0:13519:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed 00010000:00010000:0.0:1746143788.851091:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 70436 lines, 70436 kept, 0 dropped, 0 bad.